Sep 04 17:43:11 devstack cinder-volume[76351]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 04 17:43:11 devstack cinder-volume[76351]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 04 17:43:11 devstack cinder-volume[76351]: we strongly recommend against using it for new projects. Sep 04 17:43:11 devstack cinder-volume[76351]: If you are already using Eventlet, we recommend migrating to a different Sep 04 17:43:11 devstack cinder-volume[76351]: framework. For more detail see Sep 04 17:43:11 devstack cinder-volume[76351]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 04 17:43:11 devstack cinder-volume[76351]: import eventlet # noqa Sep 04 17:43:13 devstack cinder-volume[76351]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76351) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 04 17:43:13 devstack cinder-volume[76351]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76351) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 04 17:43:13 devstack cinder-volume[76351]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76351) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 04 17:43:14 devstack cinder-volume[76351]: INFO dbcounter [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] Registered counter for database cinder Sep 04 17:43:14 devstack cinder-volume[76351]: DEBUG oslo_db.sqlalchemy.engines [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76351) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 17:43:15 devstack cinder-volume[76351]: DEBUG dbcounter [-] [76351] Writer thread running {{(pid=76351) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 04 17:43:15 devstack cinder-volume[76351]: INFO cinder.rpc [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 04 17:43:15 devstack cinder-volume[76351]: INFO cinder.rpc [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 04 17:43:15 devstack cinder-volume[76351]: DEBUG oslo_db.sqlalchemy.engines [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76351) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 17:43:15 devstack cinder-volume[76351]: INFO cinder.volume.manager [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] Determined volume DB was empty at startup. Sep 04 17:43:15 devstack cinder-volume[76351]: DEBUG cinder.volume.manager [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76351) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 04 17:43:15 devstack cinder-volume[76351]: INFO cinder.volume.manager [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 04 17:43:15 devstack cinder-volume[76351]: WARNING stevedore.named [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 04 17:43:15 devstack cinder-volume[76351]: WARNING castellan.key_manager [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 04 17:43:15 devstack cinder-volume[76351]: WARNING cinder.keymgr.conf_key_mgr [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 04 17:43:15 devstack cinder-volume[76351]: DEBUG cinder.volume.drivers.lvm [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76351) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 04 17:43:15 devstack cinder-volume[76351]: DEBUG oslo_concurrency.processutils [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76351) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:43:15 devstack cinder-volume[76351]: DEBUG oslo_concurrency.processutils [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] CMD "cinder-rtstool verify" returned: 0 in 0.423s {{(pid=76351) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:43:15 devstack cinder-volume[76351]: DEBUG oslo_db.sqlalchemy.engines [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76351) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 17:43:15 devstack cinder-volume[76351]: INFO cinder.rpc [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 04 17:43:15 devstack cinder-volume[76351]: INFO cinder.rpc [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 04 17:43:15 devstack cinder-volume[76351]: WARNING stevedore.named [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 04 17:43:15 devstack cinder-volume[76351]: WARNING castellan.key_manager [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 04 17:43:15 devstack cinder-volume[76351]: INFO cinder.volume.manager [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_db.sqlalchemy.engines [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76351) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 17:43:16 devstack cinder-volume[76351]: INFO oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] Starting 1 workers Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] Started child 76505 {{(pid=76351) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] Full set of CONF: {{(pid=76351) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] ******************************************************************************** {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] Configuration options gathered from: {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] ================================================================================ {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] allow_availability_zone_fallback = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] allow_compression_on_image_upload = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] allowed_direct_url_schemes = [] {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] api_rate_limit = True {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] auth_strategy = keystone {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] az_cache_duration = 3600 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_availability_zone = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_host = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_name = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_stats_polling_interval = 60 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backup_api_class = cinder.backup.api.API {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backup_name_template = backup-%s {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backup_use_same_host = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backup_use_temp_snapshot = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] chap_password = **** {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] chap_username = {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] cinder_internal_tenant_project_id = 9af037f0c13448799a126c3709678005 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76505]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] cinder_internal_tenant_user_id = 836da7acec9c4e8a809d01a60fef7071 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] cloned_volume_same_az = True {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] cluster = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] compression_format = gzip {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] compute_api_class = cinder.compute.nova.API {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] config_dir = [] {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] config_source = [] {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] control_exchange = openstack {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] debug = True {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] default_availability_zone = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] default_group_type = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] default_volume_type = lvmdriver-1 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] disk_geometry = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] driver_client_cert = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] driver_client_cert_key = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] driver_data_namespace = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] driver_ssl_cert_path = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] driver_ssl_cert_verify = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] driver_use_ssl = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] enable_force_upload = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] enable_new_services = True {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] enable_unsupported_driver = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] enforce_multipath_for_image_xfer = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] filter_function = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] glance_api_insecure = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] glance_api_servers = ['http://192.168.122.117/image'] {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] glance_api_ssl_compression = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] glance_ca_certificates_file = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] glance_catalog_info = image:glance:publicURL {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] glance_certfile = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] glance_keyfile = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] glance_num_retries = 3 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] glance_request_timeout = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] goodness_function = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] graceful_shutdown_timeout = 5 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] group_api_class = cinder.group.api.API {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] host = devstack {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] image_compress_on_upload = True {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] image_conversion_address_space_limit = 1 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] image_conversion_cpu_limit = 60 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] image_conversion_disable = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] image_upload_use_cinder_backend = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] image_upload_use_internal_tenant = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] image_volume_cache_enabled = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] image_volume_cache_max_count = 0 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] image_volume_cache_max_size_gb = 0 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] init_host_max_objects_retrieval = 0 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] instance_format = [instance: %(uuid)s] {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] iscsi_target_flags = {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] iscsi_write_cache = on {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] iser_helper = tgtadm {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] iser_ip_address = 192.168.122.117 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] iser_port = 3260 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] log_color = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] log_config_append = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] log_dir = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] log_file = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] log_options = True {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] log_rotate_interval = 1 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] log_rotate_interval_type = days {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] log_rotation_type = none {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] max_age = 0 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] max_logfile_count = 30 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] max_logfile_size_mb = 200 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] max_over_subscription_ratio = 20.0 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] message_reap_interval = 86400 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] message_ttl = 2592000 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] migration_create_volume_timeout_secs = 300 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] monkey_patch = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] monkey_patch_modules = [] {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] my_ip = 192.168.122.117 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] no_snapshot_gb_quota = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] num_iser_scan_tries = 3 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] num_shell_tries = 3 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] num_volume_device_scan_tries = 3 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] nvmeof_conn_info_version = 1 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] nvmet_ns_id = 10 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] nvmet_port_id = 1 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] osapi_max_limit = 1000 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] osapi_volume_ext_list = [] {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] osapi_volume_listen_port = 8776 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] osapi_volume_use_ssl = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] osapi_volume_workers = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] per_volume_size_limit = -1 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] periodic_fuzzy_delay = 60 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] periodic_interval = 60 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] public_endpoint = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] publish_errors = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] quota_backup_gigabytes = 1000 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] quota_backups = 10 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] quota_gigabytes = 1000 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] quota_groups = 10 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] quota_snapshots = 10 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] quota_volumes = 10 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] rate_limit_burst = 0 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] rate_limit_except_level = CRITICAL {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] rate_limit_interval = 0 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] reinit_driver_count = 3 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] replication_device = **** {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] report_discard_supported = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] report_interval = 120 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] reservation_clean_interval = 86400 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] reservation_expire = 86400 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] reserved_image_namespaces = [] {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] reserved_percentage = 0 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] rpc_response_timeout = 120 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] run_external_periodic_tasks = True {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] scst_target_driver = iscsi {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] scst_target_iqn_name = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] service_down_time = 720 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] shell_completion = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] snapshot_name_template = snapshot-%s {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] snapshot_same_host = True {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] split_loggers = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] state_path = /opt/stack/data/cinder {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] storage_availability_zone = nova {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] storage_protocol = iSCSI {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] syslog_log_facility = LOG_USER {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] target_helper = lioadm {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] target_ip_address = 192.168.122.117 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] target_port = 3260 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] target_protocol = iscsi {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] target_secondary_ip_addresses = [] {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] trace_flags = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] transport_url = **** {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] until_refresh = 0 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] use_chap_auth = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] use_default_quota_class = True {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] use_journal = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] use_json = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] use_multipath_for_image_xfer = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] use_stderr = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] use_syslog = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] verify_glance_signatures = enabled {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] volume_api_class = cinder.volume.api.API {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] volume_backend_name = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] volume_clear = zero {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] volume_clear_ionice = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] volume_clear_size = 0 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] volume_copy_bps_limit = 0 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] volume_dd_blocksize = 1M {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] volume_name_template = volume-%s {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] volume_service_inithost_offload = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] volume_usage_audit_period = month {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] zoning_mode = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_concurrency.disable_process_locking = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76505]: INFO cinder.volume.manager [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] keystone_authtoken.auth_section = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] keystone_authtoken.auth_type = password {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] keystone_authtoken.auth_version = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] keystone_authtoken.cache = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] keystone_authtoken.certfile = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] keystone_authtoken.include_service_catalog = True {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] keystone_authtoken.insecure = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] keystone_authtoken.interface = public {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] keystone_authtoken.keyfile = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] keystone_authtoken.memcache_password = **** {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] keystone_authtoken.memcache_username = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] keystone_authtoken.region_name = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] keystone_authtoken.service_type = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.117/identity {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] cache.backend = dogpile.cache.null {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] cache.backend_argument = **** {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] cache.backend_expiration_time = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] cache.config_prefix = cache.oslo {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] cache.debug_cache_backend = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] cache.enable_retry_client = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] cache.enable_socket_keepalive = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] cache.enabled = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] cache.expiration_time = 600 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] cache.hashclient_retry_attempts = 2 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] cache.memcache_dead_retry = 300 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] cache.memcache_pool_maxsize = 10 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] cache.memcache_sasl_enabled = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] cache.password = **** {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] cache.proxies = [] {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] cache.redis_db = 0 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] cache.redis_server = localhost:6379 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] cache.retry_attempts = 2 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] cache.retry_delay = 0.0 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] cache.socket_keepalive_count = 1 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] cache.socket_keepalive_idle = 1 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] cache.socket_keepalive_interval = 1 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] cache.socket_timeout = 1.0 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] cache.tls_allowed_ciphers = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] cache.tls_cafile = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] cache.tls_certfile = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] cache.tls_enabled = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] cache.tls_keyfile = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] cache.username = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] coordination.backend_url = **** {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] database.asyncio_connection = **** {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] database.asyncio_slave_connection = **** {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] database.backend = sqlalchemy {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] database.connection = **** {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] database.connection_debug = 0 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] database.connection_parameters = {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] database.connection_recycle_time = 3600 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] database.connection_trace = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] database.db_inc_retry_interval = True {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] database.db_max_retries = 20 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] database.db_max_retry_interval = 10 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] database.db_retry_interval = 1 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] database.max_overflow = 50 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] database.max_pool_size = 5 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] database.max_retries = 10 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] database.mysql_wsrep_sync_wait = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] database.pool_timeout = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] database.retry_interval = 10 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] database.slave_connection = **** {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] database.sqlite_synchronous = True {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.046s {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] database.synchronous_reader = True {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] database.use_db_reconnect = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_messaging_tracing.insecure = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] profiler.connection_string = messaging:// {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] profiler.enabled = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] profiler.es_doc_type = notification {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] profiler.es_scroll_size = 10000 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] profiler.es_scroll_time = 2m {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] profiler.filter_error_trace = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] profiler.hmac_keys = **** {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] profiler.sentinel_service_name = mymaster {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] profiler.socket_timeout = 0.1 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] profiler.trace_requests = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] profiler.trace_sqlalchemy = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] profiler_jaeger.process_tags = {} {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] profiler_jaeger.service_name_prefix = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] profiler_otlp.service_name_prefix = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_policy.enforce_new_defaults = True {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_policy.policy_default_rule = default {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_policy.policy_file = policy.yaml {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] privsep_osbrick.group = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] privsep_osbrick.helper_command = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] privsep_osbrick.user = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] cinder_sys_admin.group = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] cinder_sys_admin.helper_command = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] cinder_sys_admin.user = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] service_user.auth_section = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] service_user.auth_type = password {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] service_user.cafile = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] service_user.certfile = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] service_user.collect_timing = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] service_user.insecure = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] service_user.keyfile = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] service_user.send_service_user_token = True {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] service_user.split_loggers = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] service_user.timeout = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] service_user.tls_ciphers = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] service_user.tls_min_version = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] glance.auth_section = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] glance.auth_type = password {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] glance.certfile = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] glance.collect_timing = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] glance.insecure = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] glance.keyfile = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] glance.region_name = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] glance.split_loggers = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] glance.timeout = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] glance.tls_ciphers = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] glance.tls_min_version = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.backend_availability_zone = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.chap_password = **** {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.chap_username = {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.disk_geometry = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.driver_client_cert = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.driver_client_cert_key = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.driver_data_namespace = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.driver_use_ssl = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.extra_capabilities = {} {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.filter_function = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.goodness_function = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.iscsi_target_flags = {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.iscsi_write_cache = on {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.iser_helper = tgtadm {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.iser_ip_address = 192.168.122.117 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.iser_port = 3260 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.lvm_share_target = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.lvm_type = auto {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.num_shell_tries = 3 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.replication_device = **** {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.report_discard_supported = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.reserved_percentage = 0 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.target_helper = tgtadm {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.target_ip_address = 192.168.122.117 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.target_port = 3260 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.target_protocol = iscsi {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.trace_flags = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.unique_fqdn_network = True {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.use_chap_auth = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.volume_backend_name = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.volume_clear = zero {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.volume_clear_ionice = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.volume_clear_size = 0 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_reports.file_event_handler = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_reports.log_dir = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack sudo[76509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.backend_host = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.chap_password = **** {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack sudo[76509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:43:16 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.044s {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:43:16 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.chap_username = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.disk_geometry = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.driver_client_cert = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.extra_capabilities = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.filter_function = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.goodness_function = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.iser_helper = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.iser_ip_address = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.iser_port = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.lvm_share_target = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.lvm_type = auto {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.num_shell_tries = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.replication_device = **** {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.report_discard_supported = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.reserved_percentage = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.scst_target_driver = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.storage_protocol = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.target_helper = lioadm {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.target_ip_address = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.target_port = 3260 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.trace_flags = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.use_chap_auth = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.volume_clear = zero {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.volume_clear_size = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] lvmdriver-1.volumes_dir = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_messaging_rabbit.ssl = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_messaging_notifications.driver = [] {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_messaging_notifications.retry = -1 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] key_manager.fixed_key = **** {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] barbican.barbican_api_version = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] barbican.barbican_endpoint = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] barbican.barbican_endpoint_type = public {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] barbican.barbican_region_name = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] barbican.cafile = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] barbican.certfile = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] barbican.collect_timing = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] barbican.insecure = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] barbican.keyfile = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] barbican.number_of_retries = 60 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] barbican.retry_delay = 1 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] barbican.send_service_user_token = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] barbican.split_loggers = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] barbican.timeout = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] barbican.tls_ciphers = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] barbican.tls_min_version = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] barbican.verify_ssl = True {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] barbican.verify_ssl_path = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] barbican_service_user.auth_section = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] barbican_service_user.auth_type = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] barbican_service_user.cafile = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] barbican_service_user.certfile = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] barbican_service_user.collect_timing = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] barbican_service_user.insecure = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] barbican_service_user.keyfile = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] barbican_service_user.split_loggers = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] barbican_service_user.timeout = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] barbican_service_user.tls_ciphers = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] barbican_service_user.tls_min_version = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] vault.approle_role_id = **** {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] vault.approle_secret_id = **** {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] vault.auth_method = approle {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] vault.auth_path = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] vault.kv_mountpoint = secret {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] vault.kv_path = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] vault.kv_version = 2 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] vault.namespace = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] vault.root_token_id = **** {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] vault.ssl_ca_crt_file = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] vault.timeout = 60.0 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] vault.token_file = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] vault.token_role = None {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] vault.use_ssl = False {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:43:16 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] ******************************************************************************** {{(pid=76351) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 04 17:43:16 devstack sudo[76509]: pam_unix(sudo:session): session closed for user root Sep 04 17:43:16 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.334s {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:43:16 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:43:16 devstack sudo[76637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 17:43:16 devstack sudo[76637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:43:16 devstack sudo[76637]: pam_unix(sudo:session): session closed for user root Sep 04 17:43:16 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.304s {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:43:16 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 17:43:16 devstack cinder-volume[76505]: INFO cinder.brick.local_dev.lvm [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 04 17:43:16 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:43:16 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:43:16 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:43:16 devstack sudo[76739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 04 17:43:16 devstack sudo[76739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:43:17 devstack sudo[76739]: pam_unix(sudo:session): session closed for user root Sep 04 17:43:17 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.324s {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:43:17 devstack cinder-volume[76505]: DEBUG cinder.brick.local_dev.lvm [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76505) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 04 17:43:17 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:43:17 devstack sudo[76823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 17:43:17 devstack sudo[76823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:43:17 devstack sudo[76823]: pam_unix(sudo:session): session closed for user root Sep 04 17:43:17 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.513s {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:43:17 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:43:17 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:43:17 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:43:17 devstack sudo[77028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 17:43:17 devstack sudo[77028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:43:18 devstack sudo[77028]: pam_unix(sudo:session): session closed for user root Sep 04 17:43:18 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.309s {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:43:18 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:43:18 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:43:18 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:43:18 devstack sudo[77120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 04 17:43:18 devstack sudo[77120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:43:18 devstack sudo[77120]: pam_unix(sudo:session): session closed for user root Sep 04 17:43:18 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.274s {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:43:18 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:43:18 devstack sudo[77124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 04 17:43:18 devstack sudo[77124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:43:18 devstack sudo[77124]: pam_unix(sudo:session): session closed for user root Sep 04 17:43:18 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.292s {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:43:18 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:43:18 devstack sudo[77207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 04 17:43:18 devstack sudo[77207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:43:18 devstack sudo[77207]: pam_unix(sudo:session): session closed for user root Sep 04 17:43:18 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:43:18 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:43:18 devstack sudo[77210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 17:43:18 devstack sudo[77210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:43:19 devstack sudo[77210]: pam_unix(sudo:session): session closed for user root Sep 04 17:43:19 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:43:19 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:43:19 devstack sudo[77260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 17:43:19 devstack sudo[77260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:43:19 devstack sudo[77260]: pam_unix(sudo:session): session closed for user root Sep 04 17:43:19 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.273s {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:43:19 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:43:19 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:43:19 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:43:19 devstack sudo[77303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 17:43:19 devstack sudo[77303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:43:19 devstack sudo[77303]: pam_unix(sudo:session): session closed for user root Sep 04 17:43:19 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:43:19 devstack cinder-volume[76505]: INFO cinder.volume.drivers.lvm [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 04 17:43:19 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:43:19 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:43:19 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:43:19 devstack sudo[77307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 17:43:19 devstack sudo[77307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:43:20 devstack sudo[77307]: pam_unix(sudo:session): session closed for user root Sep 04 17:43:20 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.282s {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:43:20 devstack cinder-volume[76505]: DEBUG cinder.volume.drivers.lvm [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] Updating volume stats {{(pid=76505) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 04 17:43:20 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:43:20 devstack sudo[77310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 04 17:43:20 devstack sudo[77310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:43:20 devstack sudo[77310]: pam_unix(sudo:session): session closed for user root Sep 04 17:43:20 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:43:20 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:43:20 devstack sudo[77319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 17:43:20 devstack sudo[77319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:43:20 devstack sudo[77319]: pam_unix(sudo:session): session closed for user root Sep 04 17:43:20 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:43:20 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:43:20 devstack sudo[77322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 17:43:20 devstack sudo[77322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:43:20 devstack sudo[77322]: pam_unix(sudo:session): session closed for user root Sep 04 17:43:20 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:43:20 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:43:20 devstack sudo[77325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 17:43:20 devstack sudo[77325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:43:21 devstack sudo[77325]: pam_unix(sudo:session): session closed for user root Sep 04 17:43:21 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:43:21 devstack cinder-volume[76505]: INFO cinder.volume.driver [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] Driver hasn't implemented _init_vendor_properties() Sep 04 17:43:21 devstack cinder-volume[76505]: DEBUG cinder.volume.driver [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76505) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 04 17:43:21 devstack cinder-volume[76505]: DEBUG oslo_db.sqlalchemy.engines [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76505) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 17:43:21 devstack cinder-volume[76505]: DEBUG dbcounter [-] [76505] Writer thread running {{(pid=76505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 04 17:43:21 devstack cinder-volume[76505]: DEBUG cinder.db.api [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] Building query based on filter {{(pid=76505) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 04 17:43:21 devstack cinder-volume[76505]: DEBUG cinder.image.image_utils [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76505) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 04 17:43:21 devstack cinder-volume[76505]: INFO cinder.keymgr.migration [None req-4614c0a8-de52-45c8-8c88-5120086d9d91 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 04 17:43:21 devstack cinder-volume[76505]: DEBUG cinder.volume.drivers.lvm [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] Updating volume stats {{(pid=76505) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 04 17:43:21 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:43:21 devstack sudo[77328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 04 17:43:21 devstack sudo[77328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:43:21 devstack sudo[77328]: pam_unix(sudo:session): session closed for user root Sep 04 17:43:21 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:43:21 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:43:21 devstack sudo[77334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 17:43:21 devstack sudo[77334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:43:21 devstack sudo[77334]: pam_unix(sudo:session): session closed for user root Sep 04 17:43:21 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:43:21 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:43:21 devstack sudo[77337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 17:43:21 devstack sudo[77337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:43:22 devstack sudo[77337]: pam_unix(sudo:session): session closed for user root Sep 04 17:43:22 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:43:22 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:43:22 devstack sudo[77340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 17:43:22 devstack sudo[77340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:43:22 devstack sudo[77340]: pam_unix(sudo:session): session closed for user root Sep 04 17:43:22 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:43:22 devstack cinder-volume[76505]: DEBUG cinder.manager [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] Notifying Schedulers of capabilities ... {{(pid=76505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:43:22 devstack cinder-volume[76505]: INFO cinder.volume.manager [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] Driver initialization completed successfully. Sep 04 17:43:22 devstack cinder-volume[76505]: INFO cinder.manager [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] Initiating service 2 cleanup Sep 04 17:43:22 devstack cinder-volume[76505]: INFO cinder.manager [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] Service 2 cleanup completed. Sep 04 17:43:22 devstack cinder-volume[76505]: DEBUG cinder.service [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] Creating RPC server for service cinder-volume {{(pid=76505) start /opt/stack/cinder/cinder/service.py:231}} Sep 04 17:43:22 devstack cinder-volume[76505]: DEBUG cinder.service [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76505) start /opt/stack/cinder/cinder/service.py:237}} Sep 04 17:43:22 devstack cinder-volume[76505]: INFO cinder.volume.manager [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 04 17:43:22 devstack cinder-volume[76505]: DEBUG cinder.volume.drivers.lvm [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] Updating volume stats {{(pid=76505) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 04 17:43:22 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:43:22 devstack sudo[77345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 04 17:43:22 devstack sudo[77345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:43:22 devstack sudo[77345]: pam_unix(sudo:session): session closed for user root Sep 04 17:43:22 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:43:22 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:43:22 devstack sudo[77350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 17:43:22 devstack sudo[77350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:43:23 devstack sudo[77350]: pam_unix(sudo:session): session closed for user root Sep 04 17:43:23 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:43:23 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:43:23 devstack sudo[77353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 17:43:23 devstack sudo[77353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:43:23 devstack sudo[77353]: pam_unix(sudo:session): session closed for user root Sep 04 17:43:23 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:43:23 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:43:23 devstack sudo[77356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 17:43:23 devstack sudo[77356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:43:23 devstack sudo[77356]: pam_unix(sudo:session): session closed for user root Sep 04 17:43:23 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:43:23 devstack cinder-volume[76505]: INFO cinder.volume.manager [None req-6629bea4-e877-4b54-880b-b10b7a9428a4 None None] Driver post RPC initialization completed successfully. Sep 04 17:43:26 devstack cinder-volume[76351]: DEBUG dbcounter [-] [76351] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76351) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 17:43:33 devstack cinder-volume[76505]: DEBUG dbcounter [-] [76505] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 17:43:33 devstack cinder-volume[76505]: DEBUG dbcounter [-] [76505] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 17:44:16 devstack cinder-volume[76505]: DEBUG oslo_service.periodic_task [None req-19c20231-62a9-45d4-900b-d1b68bea7c87 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76505) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 17:44:16 devstack cinder-volume[76505]: DEBUG cinder.volume.drivers.lvm [None req-19c20231-62a9-45d4-900b-d1b68bea7c87 None None] Updating volume stats {{(pid=76505) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 04 17:44:16 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-19c20231-62a9-45d4-900b-d1b68bea7c87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:44:16 devstack sudo[79292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 04 17:44:16 devstack sudo[79292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:44:17 devstack sudo[79292]: pam_unix(sudo:session): session closed for user root Sep 04 17:44:17 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-19c20231-62a9-45d4-900b-d1b68bea7c87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:44:17 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-19c20231-62a9-45d4-900b-d1b68bea7c87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:44:17 devstack sudo[79295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 17:44:17 devstack sudo[79295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:44:17 devstack sudo[79295]: pam_unix(sudo:session): session closed for user root Sep 04 17:44:17 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-19c20231-62a9-45d4-900b-d1b68bea7c87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:44:17 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-19c20231-62a9-45d4-900b-d1b68bea7c87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:44:17 devstack sudo[79298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 17:44:17 devstack sudo[79298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:44:17 devstack sudo[79298]: pam_unix(sudo:session): session closed for user root Sep 04 17:44:17 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-19c20231-62a9-45d4-900b-d1b68bea7c87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.281s {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:44:17 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-19c20231-62a9-45d4-900b-d1b68bea7c87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:44:17 devstack sudo[79301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 17:44:17 devstack sudo[79301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:44:17 devstack sudo[79301]: pam_unix(sudo:session): session closed for user root Sep 04 17:44:17 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-19c20231-62a9-45d4-900b-d1b68bea7c87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:44:17 devstack cinder-volume[76505]: DEBUG cinder.manager [None req-19c20231-62a9-45d4-900b-d1b68bea7c87 None None] Notifying Schedulers of capabilities ... {{(pid=76505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:44:17 devstack cinder-volume[76505]: DEBUG oslo_service.periodic_task [None req-19c20231-62a9-45d4-900b-d1b68bea7c87 None None] Running periodic task VolumeManager._thread_info {{(pid=76505) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 17:44:17 devstack cinder-volume[76505]: DEBUG cinder.volume.manager [None req-19c20231-62a9-45d4-900b-d1b68bea7c87 None None] thread count: 6 {{(pid=76505) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 17:44:17 devstack cinder-volume[76505]: DEBUG cinder.volume.manager [None req-19c20231-62a9-45d4-900b-d1b68bea7c87 None None] thread info: [<_MainThread(MainThread, started 139179480268928)>, , , , , ] {{(pid=76505) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 17:45:16 devstack cinder-volume[76505]: DEBUG oslo_service.periodic_task [None req-19c20231-62a9-45d4-900b-d1b68bea7c87 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76505) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 17:45:16 devstack cinder-volume[76505]: DEBUG cinder.volume.drivers.lvm [None req-19c20231-62a9-45d4-900b-d1b68bea7c87 None None] Updating volume stats {{(pid=76505) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 04 17:45:16 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-19c20231-62a9-45d4-900b-d1b68bea7c87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:45:16 devstack sudo[82621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 04 17:45:16 devstack sudo[82621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:45:16 devstack sudo[82621]: pam_unix(sudo:session): session closed for user root Sep 04 17:45:16 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-19c20231-62a9-45d4-900b-d1b68bea7c87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:45:16 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-19c20231-62a9-45d4-900b-d1b68bea7c87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:45:17 devstack sudo[82640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 17:45:17 devstack sudo[82640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:45:17 devstack sudo[82640]: pam_unix(sudo:session): session closed for user root Sep 04 17:45:17 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-19c20231-62a9-45d4-900b-d1b68bea7c87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:45:17 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-19c20231-62a9-45d4-900b-d1b68bea7c87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:45:17 devstack sudo[82643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 17:45:17 devstack sudo[82643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:45:17 devstack sudo[82643]: pam_unix(sudo:session): session closed for user root Sep 04 17:45:17 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-19c20231-62a9-45d4-900b-d1b68bea7c87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:45:17 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-19c20231-62a9-45d4-900b-d1b68bea7c87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:45:17 devstack sudo[82647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 17:45:17 devstack sudo[82647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:45:17 devstack sudo[82647]: pam_unix(sudo:session): session closed for user root Sep 04 17:45:17 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-19c20231-62a9-45d4-900b-d1b68bea7c87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:45:17 devstack cinder-volume[76505]: DEBUG cinder.manager [None req-19c20231-62a9-45d4-900b-d1b68bea7c87 None None] Notifying Schedulers of capabilities ... {{(pid=76505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:45:33 devstack cinder-volume[76505]: DEBUG dbcounter [-] [76505] Writing DB stats cinder:SELECT=1 {{(pid=76505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 17:45:33 devstack cinder-volume[76505]: DEBUG dbcounter [-] [76505] Writing DB stats cinder:UPDATE=1 {{(pid=76505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 17:46:16 devstack cinder-volume[76505]: DEBUG oslo_service.periodic_task [None req-19c20231-62a9-45d4-900b-d1b68bea7c87 None None] Running periodic task VolumeManager._thread_info {{(pid=76505) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 17:46:16 devstack cinder-volume[76505]: DEBUG cinder.volume.manager [None req-19c20231-62a9-45d4-900b-d1b68bea7c87 None None] thread count: 6 {{(pid=76505) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 17:46:16 devstack cinder-volume[76505]: DEBUG cinder.volume.manager [None req-19c20231-62a9-45d4-900b-d1b68bea7c87 None None] thread info: [<_MainThread(MainThread, started 139179480268928)>, , , , , ] {{(pid=76505) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 17:47:16 devstack cinder-volume[76505]: DEBUG oslo_service.periodic_task [None req-19c20231-62a9-45d4-900b-d1b68bea7c87 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76505) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 17:47:16 devstack cinder-volume[76505]: DEBUG cinder.volume.drivers.lvm [None req-19c20231-62a9-45d4-900b-d1b68bea7c87 None None] Updating volume stats {{(pid=76505) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 04 17:47:16 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-19c20231-62a9-45d4-900b-d1b68bea7c87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:47:16 devstack sudo[85875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 04 17:47:16 devstack sudo[85875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:47:17 devstack sudo[85875]: pam_unix(sudo:session): session closed for user root Sep 04 17:47:17 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-19c20231-62a9-45d4-900b-d1b68bea7c87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:47:17 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-19c20231-62a9-45d4-900b-d1b68bea7c87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:47:17 devstack sudo[85878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 17:47:17 devstack sudo[85878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:47:17 devstack sudo[85878]: pam_unix(sudo:session): session closed for user root Sep 04 17:47:17 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-19c20231-62a9-45d4-900b-d1b68bea7c87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:47:17 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-19c20231-62a9-45d4-900b-d1b68bea7c87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:47:17 devstack sudo[85884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 17:47:17 devstack sudo[85884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:47:17 devstack sudo[85884]: pam_unix(sudo:session): session closed for user root Sep 04 17:47:17 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-19c20231-62a9-45d4-900b-d1b68bea7c87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:47:17 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-19c20231-62a9-45d4-900b-d1b68bea7c87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:47:17 devstack sudo[85887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 17:47:17 devstack sudo[85887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:47:17 devstack sudo[85887]: pam_unix(sudo:session): session closed for user root Sep 04 17:47:17 devstack cinder-volume[76505]: DEBUG oslo_concurrency.processutils [None req-19c20231-62a9-45d4-900b-d1b68bea7c87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:47:17 devstack cinder-volume[76505]: DEBUG cinder.manager [None req-19c20231-62a9-45d4-900b-d1b68bea7c87 None None] Notifying Schedulers of capabilities ... {{(pid=76505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:47:17 devstack cinder-volume[76505]: DEBUG oslo_service.periodic_task [None req-19c20231-62a9-45d4-900b-d1b68bea7c87 None None] Running periodic task VolumeManager._thread_info {{(pid=76505) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 17:47:17 devstack cinder-volume[76505]: DEBUG cinder.volume.manager [None req-19c20231-62a9-45d4-900b-d1b68bea7c87 None None] thread count: 6 {{(pid=76505) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 17:47:17 devstack cinder-volume[76505]: DEBUG cinder.volume.manager [None req-19c20231-62a9-45d4-900b-d1b68bea7c87 None None] thread info: [<_MainThread(MainThread, started 139179480268928)>, , , , , ] {{(pid=76505) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 17:47:33 devstack cinder-volume[76505]: DEBUG dbcounter [-] [76505] Writing DB stats cinder:SELECT=1 {{(pid=76505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 17:47:33 devstack cinder-volume[76505]: DEBUG dbcounter [-] [76505] Writing DB stats cinder:UPDATE=1 {{(pid=76505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 17:47:38 devstack cinder-volume[76351]: INFO oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] Caught SIGTERM, stopping children Sep 04 17:47:38 devstack cinder-volume[76351]: DEBUG oslo_concurrency.lockutils [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] Acquiring lock "singleton_lock" {{(pid=76351) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 04 17:47:38 devstack cinder-volume[76351]: DEBUG oslo_concurrency.lockutils [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] Acquired lock "singleton_lock" {{(pid=76351) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 04 17:47:38 devstack cinder-volume[76351]: DEBUG oslo_concurrency.lockutils [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] Releasing lock "singleton_lock" {{(pid=76351) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 04 17:47:38 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] Stop services. {{(pid=76351) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 04 17:47:38 devstack cinder-volume[76351]: DEBUG oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] Killing children. {{(pid=76351) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 04 17:47:38 devstack cinder-volume[76351]: INFO oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] Waiting on 1 children to exit Sep 04 17:47:42 devstack cinder-volume[76505]: DEBUG oslo_concurrency.lockutils [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] Acquiring lock "singleton_lock" {{(pid=76505) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 04 17:47:42 devstack cinder-volume[76505]: DEBUG oslo_concurrency.lockutils [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] Acquired lock "singleton_lock" {{(pid=76505) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 04 17:47:42 devstack cinder-volume[76505]: DEBUG oslo_concurrency.lockutils [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] Releasing lock "singleton_lock" {{(pid=76505) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 04 17:47:42 devstack cinder-volume[76505]: WARNING amqp [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 04 17:47:42 devstack cinder-volume[76505]: WARNING amqp [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 04 17:47:42 devstack cinder-volume[76351]: INFO oslo_service.backend._eventlet.service [None req-0a858b2c-6e2f-4dcc-be69-66024c8e98b2 None None] Child 76505 exited with status 0 Sep 04 17:47:42 devstack cinder-volume[86519]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 04 17:47:42 devstack cinder-volume[86519]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 04 17:47:42 devstack cinder-volume[86519]: we strongly recommend against using it for new projects. Sep 04 17:47:42 devstack cinder-volume[86519]: If you are already using Eventlet, we recommend migrating to a different Sep 04 17:47:42 devstack cinder-volume[86519]: framework. For more detail see Sep 04 17:47:42 devstack cinder-volume[86519]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 04 17:47:42 devstack cinder-volume[86519]: import eventlet # noqa Sep 04 17:47:44 devstack cinder-volume[86519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86519) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 04 17:47:44 devstack cinder-volume[86519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86519) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 04 17:47:44 devstack cinder-volume[86519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86519) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 04 17:47:45 devstack cinder-volume[86519]: INFO dbcounter [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] Registered counter for database cinder Sep 04 17:47:45 devstack cinder-volume[86519]: DEBUG oslo_db.sqlalchemy.engines [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86519) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 17:47:45 devstack cinder-volume[86519]: DEBUG dbcounter [-] [86519] Writer thread running {{(pid=86519) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 04 17:47:45 devstack cinder-volume[86519]: INFO cinder.rpc [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 04 17:47:45 devstack cinder-volume[86519]: INFO cinder.rpc [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_db.sqlalchemy.engines [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86519) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 17:47:46 devstack cinder-volume[86519]: INFO cinder.volume.manager [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] Determined volume DB was empty at startup. Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG cinder.volume.manager [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86519) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 04 17:47:46 devstack cinder-volume[86519]: INFO cinder.volume.manager [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 04 17:47:46 devstack cinder-volume[86519]: WARNING stevedore.named [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 04 17:47:46 devstack cinder-volume[86519]: WARNING castellan.key_manager [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 04 17:47:46 devstack cinder-volume[86519]: WARNING cinder.keymgr.conf_key_mgr [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 04 17:47:46 devstack cinder-volume[86519]: INFO cinder.volume.manager [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_db.sqlalchemy.engines [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86519) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 17:47:46 devstack cinder-volume[86519]: INFO oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] Starting 1 workers Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] Started child 86736 {{(pid=86519) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] Full set of CONF: {{(pid=86519) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] ******************************************************************************** {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] Configuration options gathered from: {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] ================================================================================ {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] allow_availability_zone_fallback = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] allow_compression_on_image_upload = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] allowed_direct_url_schemes = [] {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] api_rate_limit = True {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] auth_strategy = keystone {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_availability_zone = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_host = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_name = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_stats_polling_interval = 60 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backup_api_class = cinder.backup.api.API {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backup_name_template = backup-%s {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backup_use_same_host = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backup_use_temp_snapshot = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] chap_password = **** {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] chap_username = {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86736]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] cinder_internal_tenant_project_id = 9af037f0c13448799a126c3709678005 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] cinder_internal_tenant_user_id = 836da7acec9c4e8a809d01a60fef7071 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] cluster = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] compression_format = gzip {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] compute_api_class = cinder.compute.nova.API {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] config_dir = [] {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] config_source = [] {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] control_exchange = openstack {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] debug = True {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] default_availability_zone = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] default_group_type = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] default_volume_type = QuobyteHD {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] disk_geometry = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] driver_client_cert = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] driver_client_cert_key = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] driver_data_namespace = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] driver_ssl_cert_path = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] driver_ssl_cert_verify = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] driver_use_ssl = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] enable_new_services = True {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] enable_unsupported_driver = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] enabled_backends = ['QuobyteHD'] {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] enforce_multipath_for_image_xfer = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] filter_function = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] glance_api_insecure = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] glance_api_servers = ['http://192.168.122.117/image'] {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] glance_api_ssl_compression = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] glance_ca_certificates_file = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] glance_catalog_info = image:glance:publicURL {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] glance_certfile = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] glance_keyfile = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] glance_num_retries = 3 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] glance_request_timeout = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] goodness_function = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] graceful_shutdown_timeout = 5 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] group_api_class = cinder.group.api.API {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] host = devstack {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] image_compress_on_upload = True {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] image_conversion_address_space_limit = 1 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] image_conversion_cpu_limit = 60 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] image_conversion_disable = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] image_upload_use_cinder_backend = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] image_upload_use_internal_tenant = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] image_volume_cache_enabled = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] image_volume_cache_max_count = 0 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] image_volume_cache_max_size_gb = 0 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] init_host_max_objects_retrieval = 0 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] instance_format = [instance: %(uuid)s] {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] iscsi_target_flags = {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] iscsi_write_cache = on {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] iser_helper = tgtadm {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] iser_ip_address = 192.168.122.117 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] iser_port = 3260 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] log_color = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] log_config_append = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] log_dir = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] log_file = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] log_options = True {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] log_rotate_interval = 1 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] log_rotate_interval_type = days {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] log_rotation_type = none {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] max_age = 0 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] max_logfile_count = 30 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] max_logfile_size_mb = 200 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] max_over_subscription_ratio = 20.0 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] message_reap_interval = 86400 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] message_ttl = 2592000 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] migration_create_volume_timeout_secs = 300 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] monkey_patch = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] monkey_patch_modules = [] {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] my_ip = 192.168.122.117 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] no_snapshot_gb_quota = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] num_iser_scan_tries = 3 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] num_shell_tries = 3 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] num_volume_device_scan_tries = 3 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] nvmeof_conn_info_version = 1 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] nvmet_ns_id = 10 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] nvmet_port_id = 1 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] osapi_max_limit = 1000 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] osapi_volume_ext_list = [] {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] osapi_volume_listen = 0.0.0.0 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] osapi_volume_listen_port = 8776 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] osapi_volume_use_ssl = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] osapi_volume_workers = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] per_volume_size_limit = -1 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] periodic_fuzzy_delay = 60 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] periodic_interval = 60 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] project_id_regex = [0-9a-f\-]+ {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] public_endpoint = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] publish_errors = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] quota_backup_gigabytes = 1000 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] quota_backups = 10 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] quota_gigabytes = 1000 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] quota_groups = 10 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] quota_snapshots = 10 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] quota_volumes = 10 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] rate_limit_burst = 0 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] rate_limit_except_level = CRITICAL {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] rate_limit_interval = 0 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] reinit_driver_count = 3 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] replication_device = **** {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] report_discard_supported = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] report_interval = 120 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] reservation_clean_interval = 86400 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] reservation_expire = 86400 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] reserved_image_namespaces = [] {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] reserved_percentage = 0 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] rpc_response_timeout = 120 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] run_external_periodic_tasks = True {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] scst_target_driver = iscsi {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] scst_target_iqn_name = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] service_down_time = 720 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] shell_completion = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] snapshot_name_template = snapshot-%s {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] split_loggers = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] state_path = /opt/stack/data/cinder {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] storage_availability_zone = nova {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] storage_protocol = iSCSI {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] syslog_log_facility = LOG_USER {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] target_helper = lioadm {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] target_ip_address = 192.168.122.117 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] target_port = 3260 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] target_protocol = iscsi {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] target_secondary_ip_addresses = [] {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] trace_flags = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] transfer_api_class = cinder.transfer.api.API {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] transport_url = **** {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] until_refresh = 0 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] use_chap_auth = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] use_default_quota_class = True {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] use_journal = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] use_json = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] use_multipath_for_image_xfer = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] use_stderr = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] use_syslog = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] verify_glance_signatures = enabled {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] volume_api_class = cinder.volume.api.API {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] volume_backend_name = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] volume_clear = zero {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] volume_clear_ionice = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] volume_clear_size = 0 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] volume_copy_bps_limit = 0 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] volume_dd_blocksize = 1M {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] volume_name_template = volume-%s {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] volume_service_inithost_offload = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] volume_usage_audit_period = month {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] zoning_mode = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_concurrency.disable_process_locking = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86736]: INFO cinder.volume.manager [None req-e57af3f0-88f2-4fbe-811f-a2e088823b29 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86736]: DEBUG cinder.volume.drivers.remotefs [None req-e57af3f0-88f2-4fbe-811f-a2e088823b29 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86736) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] keystone_authtoken.auth_section = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] keystone_authtoken.auth_type = password {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] keystone_authtoken.auth_version = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] keystone_authtoken.cache = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] keystone_authtoken.certfile = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] keystone_authtoken.delay_auth_decision = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] keystone_authtoken.http_connect_timeout = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] keystone_authtoken.include_service_catalog = True {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] keystone_authtoken.insecure = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] keystone_authtoken.interface = public {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] keystone_authtoken.keyfile = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] keystone_authtoken.memcache_password = **** {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] keystone_authtoken.memcache_username = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] keystone_authtoken.region_name = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] keystone_authtoken.service_token_roles_required = True {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] keystone_authtoken.service_type = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] keystone_authtoken.token_cache_time = 300 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.117/identity {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] cache.backend = dogpile.cache.null {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] cache.backend_argument = **** {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] cache.backend_expiration_time = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] cache.config_prefix = cache.oslo {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] cache.debug_cache_backend = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] cache.enable_retry_client = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] cache.enable_socket_keepalive = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] cache.enabled = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] cache.expiration_time = 600 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] cache.hashclient_retry_attempts = 2 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] cache.memcache_dead_retry = 300 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] cache.memcache_pool_maxsize = 10 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] cache.memcache_sasl_enabled = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] cache.password = **** {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] cache.proxies = [] {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] cache.redis_db = 0 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] cache.redis_sentinel_service_name = mymaster {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] cache.redis_server = localhost:6379 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] cache.retry_attempts = 2 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] cache.retry_delay = 0.0 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] cache.socket_keepalive_count = 1 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] cache.socket_keepalive_idle = 1 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] cache.socket_keepalive_interval = 1 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] cache.socket_timeout = 1.0 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] cache.tls_allowed_ciphers = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] cache.tls_cafile = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] cache.tls_certfile = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] cache.tls_enabled = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] cache.tls_keyfile = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] cache.username = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] coordination.backend_url = **** {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] database.asyncio_connection = **** {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] database.asyncio_slave_connection = **** {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] database.backend = sqlalchemy {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] database.connection = **** {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] database.connection_debug = 0 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] database.connection_parameters = {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] database.connection_recycle_time = 3600 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] database.connection_trace = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] database.db_inc_retry_interval = True {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] database.db_max_retries = 20 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] database.db_max_retry_interval = 10 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] database.db_retry_interval = 1 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] database.max_overflow = 50 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] database.max_pool_size = 5 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] database.max_retries = 10 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] database.mysql_wsrep_sync_wait = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] database.pool_timeout = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] database.retry_interval = 10 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] database.slave_connection = **** {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] database.sqlite_synchronous = True {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] database.synchronous_reader = True {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] database.use_db_reconnect = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_messaging_tracing.insecure = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] profiler.connection_string = messaging:// {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] profiler.enabled = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] profiler.es_doc_type = notification {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] profiler.es_scroll_size = 10000 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] profiler.es_scroll_time = 2m {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] profiler.filter_error_trace = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] profiler.hmac_keys = **** {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] profiler.sentinel_service_name = mymaster {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] profiler.socket_timeout = 0.1 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] profiler.trace_requests = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] profiler.trace_sqlalchemy = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] profiler_jaeger.process_tags = {} {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] profiler_jaeger.service_name_prefix = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] profiler_otlp.service_name_prefix = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_policy.enforce_new_defaults = True {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_policy.policy_default_rule = default {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_policy.policy_file = policy.yaml {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_policy.remote_timeout = 60.0 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] privsep_osbrick.group = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] privsep_osbrick.helper_command = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] privsep_osbrick.user = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] cinder_sys_admin.group = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] cinder_sys_admin.helper_command = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] cinder_sys_admin.user = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] service_user.auth_section = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] service_user.auth_type = password {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] service_user.cafile = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] service_user.certfile = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] service_user.collect_timing = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] service_user.insecure = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] service_user.keyfile = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] service_user.send_service_user_token = True {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] service_user.split_loggers = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] service_user.timeout = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] service_user.tls_ciphers = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] service_user.tls_min_version = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] glance.auth_section = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] glance.auth_type = password {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] glance.certfile = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] glance.collect_timing = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] glance.insecure = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] glance.keyfile = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] glance.region_name = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] glance.split_loggers = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] glance.timeout = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] glance.tls_ciphers = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] glance.tls_min_version = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.backend_availability_zone = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.chap_password = **** {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.chap_username = {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.disk_geometry = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.driver_client_cert = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.driver_client_cert_key = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.driver_data_namespace = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.driver_use_ssl = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.enable_unsupported_driver = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.extra_capabilities = {} {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.filter_function = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.goodness_function = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.iscsi_target_flags = {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.iscsi_write_cache = on {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.iser_helper = tgtadm {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.iser_ip_address = 192.168.122.117 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.iser_port = 3260 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.nas_host = {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.nas_login = admin {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.nas_mount_options = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.nas_password = **** {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.nas_private_key = {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.nas_share_path = {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.nas_ssh_port = 22 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.num_shell_tries = 3 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.nvmet_port_id = 1 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.quobyte_client_cfg = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.quobyte_volume_url = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.replication_device = **** {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.report_discard_supported = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.reserved_percentage = 0 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.scst_target_driver = iscsi {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.scst_target_iqn_name = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.storage_protocol = iSCSI {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.target_helper = tgtadm {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.target_ip_address = 192.168.122.117 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86736]: DEBUG cinder.volume.drivers.quobyte [None req-e57af3f0-88f2-4fbe-811f-a2e088823b29 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86736) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 04 17:47:46 devstack cinder-volume[86736]: WARNING cinder.volume.drivers.quobyte [None req-e57af3f0-88f2-4fbe-811f-a2e088823b29 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 04 17:47:46 devstack cinder-volume[86736]: WARNING cinder.volume.drivers.quobyte [None req-e57af3f0-88f2-4fbe-811f-a2e088823b29 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.target_port = 3260 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.target_protocol = iscsi {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.trace_flags = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.unique_fqdn_network = True {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.use_chap_auth = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86736]: DEBUG oslo_concurrency.processutils [None req-e57af3f0-88f2-4fbe-811f-a2e088823b29 None None] Running cmd (subprocess): mount.quobyte {{(pid=86736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.volume_backend_name = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.volume_clear = zero {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.volume_clear_ionice = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.volume_clear_size = 0 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_reports.file_event_handler = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_reports.log_dir = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.backend_availability_zone = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.backend_host = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.chap_password = **** {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.chap_username = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.chiscsi_conf = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.disk_geometry = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.driver_client_cert = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.driver_client_cert_key = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.driver_data_namespace = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.driver_use_ssl = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.extra_capabilities = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.filter_function = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.goodness_function = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.iscsi_target_flags = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.iscsi_write_cache = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.iser_helper = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.iser_ip_address = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.iser_port = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.iser_target_prefix = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.nas_host = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.nas_login = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.nas_mount_options = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.nas_password = **** {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.nas_private_key = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.nas_share_path = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.nas_ssh_port = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.num_shell_tries = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.nvmet_ns_id = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.nvmet_port_id = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.replication_device = **** {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.report_discard_supported = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.reserved_percentage = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.scst_target_driver = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.storage_protocol = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.target_helper = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.target_ip_address = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.target_port = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.target_prefix = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.target_protocol = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.trace_flags = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.unique_fqdn_network = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.use_chap_auth = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.volume_clear = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.volume_clear_ionice = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.volume_clear_size = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] QuobyteHD.volumes_dir = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_messaging_rabbit.ssl = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_messaging_rabbit.ssl_version = {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_messaging_notifications.driver = [] {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack quobyte-client[86737]: Reading configuration file: /etc/quobyte/client.cfg Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_messaging_notifications.retry = -1 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] oslo_messaging_notifications.transport_url = **** {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack quobyte-client[86737]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] key_manager.fixed_key = **** {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86736]: DEBUG oslo_concurrency.processutils [None req-e57af3f0-88f2-4fbe-811f-a2e088823b29 None None] CMD "mount.quobyte" returned: 1 in 0.126s {{(pid=86736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:47:46 devstack cinder-volume[86736]: DEBUG oslo_concurrency.lockutils [None req-e57af3f0-88f2-4fbe-811f-a2e088823b29 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:47:46 devstack cinder-volume[86736]: DEBUG oslo_concurrency.lockutils [None req-e57af3f0-88f2-4fbe-811f-a2e088823b29 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:47:46 devstack cinder-volume[86736]: DEBUG cinder.volume.drivers.quobyte [None req-e57af3f0-88f2-4fbe-811f-a2e088823b29 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=86736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] barbican.barbican_api_version = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86736]: INFO cinder.volume.drivers.quobyte [None req-e57af3f0-88f2-4fbe-811f-a2e088823b29 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a ... Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] barbican.barbican_endpoint = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86736]: DEBUG oslo_concurrency.processutils [None req-e57af3f0-88f2-4fbe-811f-a2e088823b29 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 -c /etc/quobyte/client-cinder.cfg {{(pid=86736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] barbican.barbican_endpoint_type = public {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] barbican.barbican_region_name = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] barbican.cafile = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] barbican.certfile = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] barbican.collect_timing = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] barbican.insecure = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] barbican.keyfile = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] barbican.number_of_retries = 60 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] barbican.retry_delay = 1 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] barbican.send_service_user_token = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] barbican.split_loggers = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] barbican.timeout = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] barbican.tls_ciphers = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] barbican.tls_min_version = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] barbican.verify_ssl = True {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] barbican.verify_ssl_path = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] barbican_service_user.auth_section = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] barbican_service_user.auth_type = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] barbican_service_user.cafile = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] barbican_service_user.certfile = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] barbican_service_user.collect_timing = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] barbican_service_user.insecure = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] barbican_service_user.keyfile = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] barbican_service_user.split_loggers = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] barbican_service_user.timeout = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] barbican_service_user.tls_ciphers = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] barbican_service_user.tls_min_version = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] vault.approle_role_id = **** {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] vault.approle_secret_id = **** {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] vault.auth_method = approle {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] vault.auth_path = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] vault.kv_mountpoint = secret {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] vault.kv_path = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] vault.kv_version = 2 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] vault.namespace = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack sudo[86742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 -c /etc/quobyte/client-cinder.cfg Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] vault.root_token_id = **** {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] vault.ssl_ca_crt_file = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] vault.timeout = 60.0 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] vault.token_file = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] vault.token_role = None {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] vault.use_ssl = False {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:47:46 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] ******************************************************************************** {{(pid=86519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 04 17:47:46 devstack sudo[86742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:47:46 devstack sudo[86742]: pam_unix(sudo:session): session closed for user root Sep 04 17:47:46 devstack cinder-volume[86736]: DEBUG oslo_concurrency.processutils [None req-e57af3f0-88f2-4fbe-811f-a2e088823b29 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.383s {{(pid=86736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:47:46 devstack cinder-volume[86736]: INFO cinder.volume.drivers.quobyte [None req-e57af3f0-88f2-4fbe-811f-a2e088823b29 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a succeeded Sep 04 17:47:47 devstack cinder-volume[86736]: DEBUG cinder.volume.drivers.quobyte [None req-e57af3f0-88f2-4fbe-811f-a2e088823b29 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=86736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:47:47 devstack cinder-volume[86736]: DEBUG oslo_concurrency.lockutils [None req-e57af3f0-88f2-4fbe-811f-a2e088823b29 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.397s {{(pid=86736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:47:47 devstack cinder-volume[86736]: DEBUG oslo_concurrency.processutils [None req-e57af3f0-88f2-4fbe-811f-a2e088823b29 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=86736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:47:47 devstack sudo[86811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:47:47 devstack sudo[86811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:47:47 devstack sudo[86811]: pam_unix(sudo:session): session closed for user root Sep 04 17:47:47 devstack cinder-volume[86736]: DEBUG oslo_concurrency.processutils [None req-e57af3f0-88f2-4fbe-811f-a2e088823b29 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.238s {{(pid=86736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:47:47 devstack cinder-volume[86736]: INFO cinder.volume.driver [None req-e57af3f0-88f2-4fbe-811f-a2e088823b29 None None] Driver hasn't implemented _init_vendor_properties() Sep 04 17:47:47 devstack cinder-volume[86736]: DEBUG cinder.volume.driver [None req-e57af3f0-88f2-4fbe-811f-a2e088823b29 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.743392944336, 'free_capacity_gb': 1773.743392944336, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86736) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 04 17:47:47 devstack cinder-volume[86736]: DEBUG oslo_db.sqlalchemy.engines [None req-e57af3f0-88f2-4fbe-811f-a2e088823b29 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86736) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 17:47:47 devstack cinder-volume[86736]: DEBUG dbcounter [-] [86736] Writer thread running {{(pid=86736) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 04 17:47:47 devstack cinder-volume[86736]: DEBUG cinder.db.api [None req-e57af3f0-88f2-4fbe-811f-a2e088823b29 None None] Building query based on filter {{(pid=86736) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 04 17:47:47 devstack cinder-volume[86736]: DEBUG cinder.image.image_utils [None req-e57af3f0-88f2-4fbe-811f-a2e088823b29 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86736) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 04 17:47:47 devstack cinder-volume[86736]: INFO cinder.keymgr.migration [None req-41bb4115-8f7e-44c7-979f-876e544651de None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 04 17:47:47 devstack cinder-volume[86736]: DEBUG oslo_concurrency.lockutils [None req-e57af3f0-88f2-4fbe-811f-a2e088823b29 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:47:47 devstack cinder-volume[86736]: DEBUG oslo_concurrency.lockutils [None req-e57af3f0-88f2-4fbe-811f-a2e088823b29 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:47:47 devstack cinder-volume[86736]: DEBUG cinder.volume.drivers.quobyte [None req-e57af3f0-88f2-4fbe-811f-a2e088823b29 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=86736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:47:47 devstack cinder-volume[86736]: DEBUG cinder.volume.drivers.quobyte [None req-e57af3f0-88f2-4fbe-811f-a2e088823b29 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=86736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:47:47 devstack cinder-volume[86736]: DEBUG oslo_concurrency.lockutils [None req-e57af3f0-88f2-4fbe-811f-a2e088823b29 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:47:47 devstack cinder-volume[86736]: DEBUG oslo_concurrency.processutils [None req-e57af3f0-88f2-4fbe-811f-a2e088823b29 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=86736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:47:47 devstack sudo[86814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:47:47 devstack sudo[86814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:47:47 devstack sudo[86814]: pam_unix(sudo:session): session closed for user root Sep 04 17:47:47 devstack cinder-volume[86736]: DEBUG oslo_concurrency.processutils [None req-e57af3f0-88f2-4fbe-811f-a2e088823b29 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.220s {{(pid=86736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:47:47 devstack cinder-volume[86736]: DEBUG cinder.manager [None req-e57af3f0-88f2-4fbe-811f-a2e088823b29 None None] Notifying Schedulers of capabilities ... {{(pid=86736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:47:47 devstack cinder-volume[86736]: INFO cinder.volume.manager [None req-e57af3f0-88f2-4fbe-811f-a2e088823b29 None None] Driver initialization completed successfully. Sep 04 17:47:47 devstack cinder-volume[86736]: INFO cinder.manager [None req-e57af3f0-88f2-4fbe-811f-a2e088823b29 None None] Initiating service 3 cleanup Sep 04 17:47:47 devstack cinder-volume[86736]: INFO cinder.manager [None req-e57af3f0-88f2-4fbe-811f-a2e088823b29 None None] Service 3 cleanup completed. Sep 04 17:47:47 devstack cinder-volume[86736]: DEBUG cinder.service [None req-e57af3f0-88f2-4fbe-811f-a2e088823b29 None None] Creating RPC server for service cinder-volume {{(pid=86736) start /opt/stack/cinder/cinder/service.py:231}} Sep 04 17:47:47 devstack cinder-volume[86736]: DEBUG cinder.service [None req-e57af3f0-88f2-4fbe-811f-a2e088823b29 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86736) start /opt/stack/cinder/cinder/service.py:237}} Sep 04 17:47:47 devstack cinder-volume[86736]: INFO cinder.volume.manager [None req-e57af3f0-88f2-4fbe-811f-a2e088823b29 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 04 17:47:47 devstack cinder-volume[86736]: DEBUG oslo_concurrency.lockutils [None req-e57af3f0-88f2-4fbe-811f-a2e088823b29 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:47:47 devstack cinder-volume[86736]: DEBUG oslo_concurrency.lockutils [None req-e57af3f0-88f2-4fbe-811f-a2e088823b29 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:47:47 devstack cinder-volume[86736]: DEBUG cinder.volume.drivers.quobyte [None req-e57af3f0-88f2-4fbe-811f-a2e088823b29 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=86736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:47:47 devstack cinder-volume[86736]: DEBUG cinder.volume.drivers.quobyte [None req-e57af3f0-88f2-4fbe-811f-a2e088823b29 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=86736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:47:47 devstack cinder-volume[86736]: DEBUG oslo_concurrency.lockutils [None req-e57af3f0-88f2-4fbe-811f-a2e088823b29 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:47:47 devstack cinder-volume[86736]: DEBUG oslo_concurrency.processutils [None req-e57af3f0-88f2-4fbe-811f-a2e088823b29 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=86736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:47:47 devstack sudo[86818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:47:47 devstack sudo[86818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:47:48 devstack sudo[86818]: pam_unix(sudo:session): session closed for user root Sep 04 17:47:48 devstack cinder-volume[86736]: DEBUG oslo_concurrency.processutils [None req-e57af3f0-88f2-4fbe-811f-a2e088823b29 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.256s {{(pid=86736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:47:48 devstack cinder-volume[86736]: INFO cinder.volume.manager [None req-e57af3f0-88f2-4fbe-811f-a2e088823b29 None None] Driver post RPC initialization completed successfully. Sep 04 17:47:52 devstack cinder-volume[86736]: DEBUG oslo_concurrency.lockutils [None req-ae03080c-73ef-4860-8b91-e099e89ae536 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:47:52 devstack cinder-volume[86736]: DEBUG oslo_concurrency.lockutils [None req-ae03080c-73ef-4860-8b91-e099e89ae536 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:47:52 devstack cinder-volume[86736]: DEBUG cinder.volume.drivers.quobyte [None req-ae03080c-73ef-4860-8b91-e099e89ae536 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=86736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:47:52 devstack cinder-volume[86736]: DEBUG cinder.volume.drivers.quobyte [None req-ae03080c-73ef-4860-8b91-e099e89ae536 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=86736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:47:52 devstack cinder-volume[86736]: DEBUG oslo_concurrency.lockutils [None req-ae03080c-73ef-4860-8b91-e099e89ae536 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:47:52 devstack cinder-volume[86736]: DEBUG oslo_concurrency.processutils [None req-ae03080c-73ef-4860-8b91-e099e89ae536 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=86736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:47:52 devstack sudo[86943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:47:52 devstack sudo[86943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:47:52 devstack sudo[86943]: pam_unix(sudo:session): session closed for user root Sep 04 17:47:52 devstack cinder-volume[86736]: DEBUG oslo_concurrency.processutils [None req-ae03080c-73ef-4860-8b91-e099e89ae536 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.245s {{(pid=86736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:47:52 devstack cinder-volume[86736]: DEBUG cinder.manager [None req-ae03080c-73ef-4860-8b91-e099e89ae536 None None] Notifying Schedulers of capabilities ... {{(pid=86736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:47:53 devstack cinder-volume[86519]: INFO oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] Caught SIGTERM, stopping children Sep 04 17:47:53 devstack cinder-volume[86519]: DEBUG oslo_concurrency.lockutils [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] Acquiring lock "singleton_lock" {{(pid=86519) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 04 17:47:53 devstack cinder-volume[86519]: DEBUG oslo_concurrency.lockutils [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] Acquired lock "singleton_lock" {{(pid=86519) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 04 17:47:53 devstack cinder-volume[86519]: DEBUG oslo_concurrency.lockutils [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] Releasing lock "singleton_lock" {{(pid=86519) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 04 17:47:53 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] Stop services. {{(pid=86519) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 04 17:47:53 devstack cinder-volume[86519]: DEBUG oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] Killing children. {{(pid=86519) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 04 17:47:53 devstack cinder-volume[86519]: INFO oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] Waiting on 1 children to exit Sep 04 17:47:55 devstack cinder-volume[86736]: DEBUG oslo_concurrency.lockutils [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] Acquiring lock "singleton_lock" {{(pid=86736) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 04 17:47:55 devstack cinder-volume[86736]: DEBUG oslo_concurrency.lockutils [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] Acquired lock "singleton_lock" {{(pid=86736) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 04 17:47:55 devstack cinder-volume[86736]: DEBUG oslo_concurrency.lockutils [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] Releasing lock "singleton_lock" {{(pid=86736) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 04 17:47:56 devstack cinder-volume[86736]: WARNING amqp [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 04 17:47:56 devstack cinder-volume[86736]: WARNING amqp [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 04 17:47:56 devstack cinder-volume[86519]: INFO oslo_service.backend._eventlet.service [None req-19aa7af5-91df-4fd1-88eb-2a9d9f93866e None None] Child 86736 exited with status 0 Sep 04 17:47:56 devstack cinder-volume[87017]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 04 17:47:56 devstack cinder-volume[87017]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 04 17:47:56 devstack cinder-volume[87017]: we strongly recommend against using it for new projects. Sep 04 17:47:56 devstack cinder-volume[87017]: If you are already using Eventlet, we recommend migrating to a different Sep 04 17:47:56 devstack cinder-volume[87017]: framework. For more detail see Sep 04 17:47:56 devstack cinder-volume[87017]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 04 17:47:56 devstack cinder-volume[87017]: import eventlet # noqa Sep 04 17:47:59 devstack cinder-volume[87017]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87017) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 04 17:47:59 devstack cinder-volume[87017]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87017) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 04 17:47:59 devstack cinder-volume[87017]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87017) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 04 17:48:00 devstack cinder-volume[87017]: INFO dbcounter [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] Registered counter for database cinder Sep 04 17:48:00 devstack cinder-volume[87017]: DEBUG oslo_db.sqlalchemy.engines [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87017) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 17:48:00 devstack cinder-volume[87017]: DEBUG dbcounter [-] [87017] Writer thread running {{(pid=87017) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 04 17:48:00 devstack cinder-volume[87017]: INFO cinder.rpc [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 04 17:48:00 devstack cinder-volume[87017]: INFO cinder.rpc [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 04 17:48:00 devstack cinder-volume[87017]: DEBUG oslo_db.sqlalchemy.engines [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87017) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 17:48:00 devstack cinder-volume[87017]: INFO cinder.volume.manager [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] Determined volume DB was empty at startup. Sep 04 17:48:00 devstack cinder-volume[87017]: DEBUG cinder.volume.manager [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87017) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 04 17:48:01 devstack cinder-volume[87017]: WARNING stevedore.named [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 04 17:48:01 devstack cinder-volume[87017]: WARNING castellan.key_manager [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 04 17:48:01 devstack cinder-volume[87017]: WARNING cinder.keymgr.conf_key_mgr [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 04 17:48:01 devstack cinder-volume[87017]: INFO cinder.volume.manager [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_db.sqlalchemy.engines [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87017) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 17:48:01 devstack cinder-volume[87017]: INFO oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] Starting 1 workers Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] Started child 87314 {{(pid=87017) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] Full set of CONF: {{(pid=87017) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] ******************************************************************************** {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] Configuration options gathered from: {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 04 17:48:01 devstack cinder-volume[87314]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] ================================================================================ {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] allow_availability_zone_fallback = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] allow_compression_on_image_upload = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] allowed_direct_url_schemes = [] {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] api_rate_limit = True {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] auth_strategy = keystone {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_availability_zone = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_host = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_name = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_stats_polling_interval = 60 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backup_api_class = cinder.backup.api.API {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backup_name_template = backup-%s {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backup_use_same_host = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backup_use_temp_snapshot = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] chap_password = **** {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] chap_username = {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] cinder_internal_tenant_project_id = 9af037f0c13448799a126c3709678005 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] cinder_internal_tenant_user_id = 836da7acec9c4e8a809d01a60fef7071 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] cluster = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] compression_format = gzip {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] compute_api_class = cinder.compute.nova.API {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] config_dir = [] {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] config_source = [] {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] control_exchange = openstack {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] debug = True {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] default_availability_zone = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] default_group_type = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] default_volume_type = QuobyteHD {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] disk_geometry = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] driver_client_cert = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] driver_client_cert_key = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] driver_data_namespace = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] driver_ssl_cert_path = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] driver_ssl_cert_verify = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] driver_use_ssl = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] enable_new_services = True {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] enable_unsupported_driver = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] enabled_backends = ['QuobyteHD'] {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-25ce75f0-30e6-4c34-bc55-3a27ed3be025 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 04 17:48:01 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-25ce75f0-30e6-4c34-bc55-3a27ed3be025 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87314) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] enforce_multipath_for_image_xfer = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] filter_function = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] glance_api_insecure = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] glance_api_servers = ['http://192.168.122.117/image'] {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] glance_api_ssl_compression = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] glance_ca_certificates_file = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] glance_catalog_info = image:glance:publicURL {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] glance_certfile = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] glance_keyfile = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] glance_num_retries = 3 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] glance_request_timeout = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] goodness_function = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] graceful_shutdown_timeout = 5 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] group_api_class = cinder.group.api.API {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] host = devstack {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] image_compress_on_upload = True {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] image_conversion_address_space_limit = 1 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] image_conversion_cpu_limit = 60 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] image_conversion_disable = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] image_upload_use_cinder_backend = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] image_upload_use_internal_tenant = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] image_volume_cache_enabled = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] image_volume_cache_max_count = 0 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] image_volume_cache_max_size_gb = 0 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] init_host_max_objects_retrieval = 0 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] instance_format = [instance: %(uuid)s] {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] iscsi_target_flags = {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] iscsi_write_cache = on {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] iser_helper = tgtadm {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] iser_ip_address = 192.168.122.117 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] iser_port = 3260 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] log_color = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] log_config_append = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] log_dir = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] log_file = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] log_options = True {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] log_rotate_interval = 1 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] log_rotate_interval_type = days {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] log_rotation_type = none {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] max_age = 0 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] max_logfile_count = 30 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] max_logfile_size_mb = 200 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] max_over_subscription_ratio = 20.0 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] message_reap_interval = 86400 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] message_ttl = 2592000 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] migration_create_volume_timeout_secs = 300 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] monkey_patch = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] monkey_patch_modules = [] {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] my_ip = 192.168.122.117 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] no_snapshot_gb_quota = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] num_iser_scan_tries = 3 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] num_shell_tries = 3 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] num_volume_device_scan_tries = 3 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] nvmeof_conn_info_version = 1 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] nvmet_ns_id = 10 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] nvmet_port_id = 1 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] osapi_max_limit = 1000 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] osapi_volume_ext_list = [] {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] osapi_volume_listen_port = 8776 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] osapi_volume_use_ssl = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] osapi_volume_workers = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] per_volume_size_limit = -1 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] periodic_fuzzy_delay = 60 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] periodic_interval = 60 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] public_endpoint = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] publish_errors = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] quota_backup_gigabytes = 1000 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] quota_backups = 10 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] quota_gigabytes = 1000 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] quota_groups = 10 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] quota_snapshots = 10 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] quota_volumes = 10 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] rate_limit_burst = 0 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] rate_limit_except_level = CRITICAL {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] rate_limit_interval = 0 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] reinit_driver_count = 3 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] replication_device = **** {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] report_discard_supported = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] report_interval = 120 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] reservation_clean_interval = 86400 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] reservation_expire = 86400 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] reserved_image_namespaces = [] {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] reserved_percentage = 0 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] rpc_response_timeout = 120 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] run_external_periodic_tasks = True {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] scst_target_driver = iscsi {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] scst_target_iqn_name = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] service_down_time = 720 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] shell_completion = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] snapshot_name_template = snapshot-%s {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] split_loggers = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] state_path = /opt/stack/data/cinder {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] storage_availability_zone = nova {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] storage_protocol = iSCSI {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] syslog_log_facility = LOG_USER {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] target_helper = lioadm {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] target_ip_address = 192.168.122.117 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] target_port = 3260 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] target_protocol = iscsi {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] target_secondary_ip_addresses = [] {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] trace_flags = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] transport_url = **** {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] until_refresh = 0 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] use_chap_auth = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] use_default_quota_class = True {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] use_journal = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] use_json = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] use_multipath_for_image_xfer = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] use_stderr = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] use_syslog = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] verify_glance_signatures = enabled {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] volume_api_class = cinder.volume.api.API {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] volume_backend_name = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] volume_clear = zero {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] volume_clear_ionice = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] volume_clear_size = 0 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] volume_copy_bps_limit = 0 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] volume_dd_blocksize = 1M {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] volume_name_template = volume-%s {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] volume_service_inithost_offload = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] volume_usage_audit_period = month {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] zoning_mode = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_concurrency.disable_process_locking = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] keystone_authtoken.auth_section = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] keystone_authtoken.auth_type = password {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] keystone_authtoken.auth_version = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] keystone_authtoken.cache = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] keystone_authtoken.certfile = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] keystone_authtoken.include_service_catalog = True {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] keystone_authtoken.insecure = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] keystone_authtoken.interface = public {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-25ce75f0-30e6-4c34-bc55-3a27ed3be025 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87314) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] keystone_authtoken.keyfile = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] keystone_authtoken.memcache_password = **** {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.quobyte [None req-25ce75f0-30e6-4c34-bc55-3a27ed3be025 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.quobyte [None req-25ce75f0-30e6-4c34-bc55-3a27ed3be025 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] keystone_authtoken.memcache_username = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] keystone_authtoken.region_name = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-25ce75f0-30e6-4c34-bc55-3a27ed3be025 None None] Running cmd (subprocess): mount.quobyte {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] keystone_authtoken.service_type = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.117/identity {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] cache.backend = dogpile.cache.null {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] cache.backend_argument = **** {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] cache.backend_expiration_time = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] cache.config_prefix = cache.oslo {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] cache.debug_cache_backend = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] cache.enable_retry_client = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] cache.enable_socket_keepalive = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] cache.enabled = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] cache.expiration_time = 600 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] cache.hashclient_retry_attempts = 2 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] cache.memcache_dead_retry = 300 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] cache.memcache_pool_maxsize = 10 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] cache.memcache_sasl_enabled = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] cache.password = **** {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] cache.proxies = [] {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] cache.redis_db = 0 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] cache.redis_server = localhost:6379 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] cache.retry_attempts = 2 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] cache.retry_delay = 0.0 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] cache.socket_keepalive_count = 1 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] cache.socket_keepalive_idle = 1 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] cache.socket_keepalive_interval = 1 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] cache.socket_timeout = 1.0 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] cache.tls_allowed_ciphers = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] cache.tls_cafile = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] cache.tls_certfile = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] cache.tls_enabled = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] cache.tls_keyfile = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] cache.username = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] coordination.backend_url = **** {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] database.asyncio_connection = **** {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] database.asyncio_slave_connection = **** {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] database.backend = sqlalchemy {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] database.connection = **** {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] database.connection_debug = 0 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] database.connection_parameters = {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] database.connection_recycle_time = 3600 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] database.connection_trace = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] database.db_inc_retry_interval = True {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] database.db_max_retries = 20 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] database.db_max_retry_interval = 10 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] database.db_retry_interval = 1 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] database.max_overflow = 50 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] database.max_pool_size = 5 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] database.max_retries = 10 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] database.mysql_wsrep_sync_wait = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] database.pool_timeout = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] database.retry_interval = 10 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] database.slave_connection = **** {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] database.sqlite_synchronous = True {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] database.synchronous_reader = True {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] database.use_db_reconnect = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_messaging_tracing.insecure = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] profiler.connection_string = messaging:// {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] profiler.enabled = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] profiler.es_doc_type = notification {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] profiler.es_scroll_size = 10000 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] profiler.es_scroll_time = 2m {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] profiler.filter_error_trace = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] profiler.hmac_keys = **** {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] profiler.sentinel_service_name = mymaster {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] profiler.socket_timeout = 0.1 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] profiler.trace_requests = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] profiler.trace_sqlalchemy = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] profiler_jaeger.process_tags = {} {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] profiler_jaeger.service_name_prefix = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] profiler_otlp.service_name_prefix = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_policy.enforce_new_defaults = True {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_policy.policy_default_rule = default {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_policy.policy_file = policy.yaml {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] privsep_osbrick.group = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] privsep_osbrick.helper_command = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] privsep_osbrick.user = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] cinder_sys_admin.group = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] cinder_sys_admin.helper_command = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] cinder_sys_admin.user = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] service_user.auth_section = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] service_user.auth_type = password {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] service_user.cafile = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] service_user.certfile = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] service_user.collect_timing = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] service_user.insecure = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] service_user.keyfile = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] service_user.send_service_user_token = True {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] service_user.split_loggers = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] service_user.timeout = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] service_user.tls_ciphers = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] service_user.tls_min_version = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] glance.auth_section = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] glance.auth_type = password {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] glance.certfile = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] glance.collect_timing = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] glance.insecure = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] glance.keyfile = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] glance.region_name = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] glance.split_loggers = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] glance.timeout = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] glance.tls_ciphers = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] glance.tls_min_version = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.backend_availability_zone = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack quobyte-client[87315]: Reading configuration file: /etc/quobyte/client.cfg Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.chap_password = **** {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.chap_username = {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack quobyte-client[87315]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.disk_geometry = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.driver_client_cert = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.driver_client_cert_key = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.driver_data_namespace = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.driver_use_ssl = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-25ce75f0-30e6-4c34-bc55-3a27ed3be025 None None] CMD "mount.quobyte" returned: 1 in 0.050s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-25ce75f0-30e6-4c34-bc55-3a27ed3be025 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.extra_capabilities = {} {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-25ce75f0-30e6-4c34-bc55-3a27ed3be025 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.filter_function = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-25ce75f0-30e6-4c34-bc55-3a27ed3be025 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.goodness_function = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.iscsi_target_flags = {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.iscsi_write_cache = on {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.iser_helper = tgtadm {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.iser_ip_address = 192.168.122.117 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.iser_port = 3260 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-25ce75f0-30e6-4c34-bc55-3a27ed3be025 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-25ce75f0-30e6-4c34-bc55-3a27ed3be025 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.nas_host = {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-25ce75f0-30e6-4c34-bc55-3a27ed3be025 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.nas_login = admin {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.nas_mount_options = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.nas_password = **** {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.nas_private_key = {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.nas_share_path = {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.num_shell_tries = 3 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.quobyte_volume_url = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.replication_device = **** {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.report_discard_supported = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.reserved_percentage = 0 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.target_helper = tgtadm {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.target_ip_address = 192.168.122.117 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.target_port = 3260 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.target_protocol = iscsi {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.trace_flags = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.unique_fqdn_network = True {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.use_chap_auth = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.volume_backend_name = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.volume_clear = zero {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.volume_clear_ionice = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.volume_clear_size = 0 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_reports.file_event_handler = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_reports.log_dir = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.backend_availability_zone = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.backend_host = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.chap_password = **** {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.chap_username = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.chiscsi_conf = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.disk_geometry = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.driver_client_cert = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.driver_data_namespace = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack sudo[87316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.driver_use_ssl = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.extra_capabilities = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack sudo[87316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.filter_function = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.goodness_function = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.iser_helper = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.iser_ip_address = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.iser_port = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.iser_target_prefix = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.nas_host = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.nas_login = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.nas_mount_options = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.nas_password = **** {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.nas_private_key = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.nas_share_path = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.nas_ssh_port = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.num_shell_tries = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.nvmet_port_id = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.replication_device = **** {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.report_discard_supported = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.reserved_percentage = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.scst_target_driver = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.storage_protocol = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.target_helper = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.target_ip_address = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.target_port = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.target_prefix = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.target_protocol = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.trace_flags = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.use_chap_auth = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.volume_clear = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.volume_clear_size = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] QuobyteHD.volumes_dir = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_messaging_rabbit.ssl = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_messaging_notifications.driver = [] {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_messaging_notifications.retry = -1 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] key_manager.fixed_key = **** {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] barbican.barbican_api_version = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] barbican.barbican_endpoint = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] barbican.barbican_endpoint_type = public {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] barbican.barbican_region_name = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] barbican.cafile = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] barbican.certfile = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] barbican.collect_timing = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] barbican.insecure = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] barbican.keyfile = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] barbican.number_of_retries = 60 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] barbican.retry_delay = 1 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] barbican.send_service_user_token = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] barbican.split_loggers = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] barbican.timeout = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] barbican.tls_ciphers = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] barbican.tls_min_version = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] barbican.verify_ssl = True {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] barbican.verify_ssl_path = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] barbican_service_user.auth_section = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] barbican_service_user.auth_type = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] barbican_service_user.cafile = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] barbican_service_user.certfile = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] barbican_service_user.collect_timing = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] barbican_service_user.insecure = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] barbican_service_user.keyfile = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] barbican_service_user.split_loggers = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] barbican_service_user.timeout = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] barbican_service_user.tls_ciphers = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] barbican_service_user.tls_min_version = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] vault.approle_role_id = **** {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] vault.approle_secret_id = **** {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] vault.auth_method = approle {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] vault.auth_path = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] vault.kv_mountpoint = secret {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] vault.kv_path = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] vault.kv_version = 2 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] vault.namespace = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] vault.root_token_id = **** {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] vault.ssl_ca_crt_file = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] vault.timeout = 60.0 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] vault.token_file = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] vault.token_role = None {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] vault.use_ssl = False {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 17:48:01 devstack cinder-volume[87017]: DEBUG oslo_service.backend._eventlet.service [None req-f6a9db3a-d999-46c7-990a-dbf508dc3195 None None] ******************************************************************************** {{(pid=87017) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 04 17:48:01 devstack sudo[87316]: pam_unix(sudo:session): session closed for user root Sep 04 17:48:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-25ce75f0-30e6-4c34-bc55-3a27ed3be025 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.239s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:48:01 devstack cinder-volume[87314]: INFO cinder.volume.driver [None req-25ce75f0-30e6-4c34-bc55-3a27ed3be025 None None] Driver hasn't implemented _init_vendor_properties() Sep 04 17:48:01 devstack cinder-volume[87314]: DEBUG cinder.volume.driver [None req-25ce75f0-30e6-4c34-bc55-3a27ed3be025 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.743392944336, 'free_capacity_gb': 1773.743392944336, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87314) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 04 17:48:01 devstack cinder-volume[87314]: DEBUG oslo_db.sqlalchemy.engines [None req-25ce75f0-30e6-4c34-bc55-3a27ed3be025 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87314) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 17:48:01 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writer thread running {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 04 17:48:01 devstack cinder-volume[87314]: DEBUG cinder.db.api [None req-25ce75f0-30e6-4c34-bc55-3a27ed3be025 None None] Building query based on filter {{(pid=87314) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 04 17:48:01 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-25ce75f0-30e6-4c34-bc55-3a27ed3be025 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87314) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 04 17:48:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-25ce75f0-30e6-4c34-bc55-3a27ed3be025 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:48:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-25ce75f0-30e6-4c34-bc55-3a27ed3be025 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:48:01 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-25ce75f0-30e6-4c34-bc55-3a27ed3be025 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:48:01 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-25ce75f0-30e6-4c34-bc55-3a27ed3be025 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:48:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-25ce75f0-30e6-4c34-bc55-3a27ed3be025 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:48:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-25ce75f0-30e6-4c34-bc55-3a27ed3be025 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:48:01 devstack cinder-volume[87314]: INFO cinder.keymgr.migration [None req-9bfdd25f-3a31-4075-9a28-dc6a0336bb4a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 04 17:48:01 devstack sudo[87327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:48:01 devstack sudo[87327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:48:01 devstack sudo[87327]: pam_unix(sudo:session): session closed for user root Sep 04 17:48:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-25ce75f0-30e6-4c34-bc55-3a27ed3be025 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.251s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:48:01 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-25ce75f0-30e6-4c34-bc55-3a27ed3be025 None None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:48:01 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-25ce75f0-30e6-4c34-bc55-3a27ed3be025 None None] Driver initialization completed successfully. Sep 04 17:48:01 devstack cinder-volume[87314]: INFO cinder.manager [None req-25ce75f0-30e6-4c34-bc55-3a27ed3be025 None None] Initiating service 3 cleanup Sep 04 17:48:01 devstack cinder-volume[87314]: INFO cinder.manager [None req-25ce75f0-30e6-4c34-bc55-3a27ed3be025 None None] Service 3 cleanup completed. Sep 04 17:48:01 devstack cinder-volume[87314]: DEBUG cinder.service [None req-25ce75f0-30e6-4c34-bc55-3a27ed3be025 None None] Creating RPC server for service cinder-volume {{(pid=87314) start /opt/stack/cinder/cinder/service.py:231}} Sep 04 17:48:01 devstack cinder-volume[87314]: DEBUG cinder.service [None req-25ce75f0-30e6-4c34-bc55-3a27ed3be025 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87314) start /opt/stack/cinder/cinder/service.py:237}} Sep 04 17:48:02 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-25ce75f0-30e6-4c34-bc55-3a27ed3be025 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 04 17:48:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-25ce75f0-30e6-4c34-bc55-3a27ed3be025 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:48:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-25ce75f0-30e6-4c34-bc55-3a27ed3be025 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:48:02 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-25ce75f0-30e6-4c34-bc55-3a27ed3be025 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:48:02 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-25ce75f0-30e6-4c34-bc55-3a27ed3be025 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:48:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-25ce75f0-30e6-4c34-bc55-3a27ed3be025 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:48:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-25ce75f0-30e6-4c34-bc55-3a27ed3be025 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:48:02 devstack sudo[87340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:48:02 devstack sudo[87340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:48:02 devstack sudo[87340]: pam_unix(sudo:session): session closed for user root Sep 04 17:48:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-25ce75f0-30e6-4c34-bc55-3a27ed3be025 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.243s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:48:02 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-25ce75f0-30e6-4c34-bc55-3a27ed3be025 None None] Driver post RPC initialization completed successfully. Sep 04 17:48:11 devstack cinder-volume[87017]: DEBUG dbcounter [-] [87017] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87017) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 17:48:11 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 17:48:12 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=3 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 17:48:21 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running periodic task VolumeManager._thread_info {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 17:48:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] thread count: 6 {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 17:48:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] thread info: [<_MainThread(MainThread, started 139900377723008)>, , , , , ] {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 17:49:01 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-567e1bc8-559f-4683-95e2-c0552b886b73 tempest-TaggedAttachmentsTest-158936181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:49:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-567e1bc8-559f-4683-95e2-c0552b886b73 tempest-TaggedAttachmentsTest-158936181 None] Flow 'volume_create_manager' (51e610d9-0cf4-4129-ad24-0e43335b49ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:49:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-567e1bc8-559f-4683-95e2-c0552b886b73 tempest-TaggedAttachmentsTest-158936181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ef7771a-b18f-4abc-af33-a82d74bc6f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:49:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-567e1bc8-559f-4683-95e2-c0552b886b73 tempest-TaggedAttachmentsTest-158936181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ef7771a-b18f-4abc-af33-a82d74bc6f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:48:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1226137949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4419767a-e970-4db5-af50-882a81500237,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9669c365a3643a8b8e72f26ce480341',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:49:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:49:02Z,use_quota=True,user_id='36beb159c9fa4a0581a26781e66e6877',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:49:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-567e1bc8-559f-4683-95e2-c0552b886b73 tempest-TaggedAttachmentsTest-158936181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41d94a02-c076-4139-b055-3659822c7a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:49:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-567e1bc8-559f-4683-95e2-c0552b886b73 tempest-TaggedAttachmentsTest-158936181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41d94a02-c076-4139-b055-3659822c7a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:49:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-567e1bc8-559f-4683-95e2-c0552b886b73 tempest-TaggedAttachmentsTest-158936181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (774bb36b-cb44-49a1-8a53-251b66a40de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:49:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-567e1bc8-559f-4683-95e2-c0552b886b73 tempest-TaggedAttachmentsTest-158936181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (774bb36b-cb44-49a1-8a53-251b66a40de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4419767a-e970-4db5-af50-882a81500237', 'volume_name': 'volume-4419767a-e970-4db5-af50-882a81500237', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:49:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-567e1bc8-559f-4683-95e2-c0552b886b73 tempest-TaggedAttachmentsTest-158936181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04efe4dd-971b-4cbf-81f7-4cb22e07dee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:49:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-567e1bc8-559f-4683-95e2-c0552b886b73 tempest-TaggedAttachmentsTest-158936181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04efe4dd-971b-4cbf-81f7-4cb22e07dee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:49:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-567e1bc8-559f-4683-95e2-c0552b886b73 tempest-TaggedAttachmentsTest-158936181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf2f5c62-5058-4300-a81e-09dcb1a1ae88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:49:02 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-567e1bc8-559f-4683-95e2-c0552b886b73 tempest-TaggedAttachmentsTest-158936181 None] Volume 4419767a-e970-4db5-af50-882a81500237: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4419767a-e970-4db5-af50-882a81500237', 'volume_size': 1} Sep 04 17:49:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-567e1bc8-559f-4683-95e2-c0552b886b73 tempest-TaggedAttachmentsTest-158936181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:49:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-567e1bc8-559f-4683-95e2-c0552b886b73 tempest-TaggedAttachmentsTest-158936181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:49:02 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-567e1bc8-559f-4683-95e2-c0552b886b73 tempest-TaggedAttachmentsTest-158936181 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:48:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1226137949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4419767a-e970-4db5-af50-882a81500237,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9669c365a3643a8b8e72f26ce480341',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:49:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:49:02Z,use_quota=True,user_id='36beb159c9fa4a0581a26781e66e6877',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:49:02 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-567e1bc8-559f-4683-95e2-c0552b886b73 tempest-TaggedAttachmentsTest-158936181 None] Creating volume 4419767a-e970-4db5-af50-882a81500237 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:49:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-567e1bc8-559f-4683-95e2-c0552b886b73 tempest-TaggedAttachmentsTest-158936181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:49:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-567e1bc8-559f-4683-95e2-c0552b886b73 tempest-TaggedAttachmentsTest-158936181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:49:02 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-567e1bc8-559f-4683-95e2-c0552b886b73 tempest-TaggedAttachmentsTest-158936181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:49:02 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-567e1bc8-559f-4683-95e2-c0552b886b73 tempest-TaggedAttachmentsTest-158936181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:49:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-567e1bc8-559f-4683-95e2-c0552b886b73 tempest-TaggedAttachmentsTest-158936181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:49:02 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-567e1bc8-559f-4683-95e2-c0552b886b73 tempest-TaggedAttachmentsTest-158936181 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:49:02 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-567e1bc8-559f-4683-95e2-c0552b886b73 tempest-TaggedAttachmentsTest-158936181 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:49:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-567e1bc8-559f-4683-95e2-c0552b886b73 tempest-TaggedAttachmentsTest-158936181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4419767a-e970-4db5-af50-882a81500237 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:49:02 devstack sudo[87676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4419767a-e970-4db5-af50-882a81500237 1073741824 Sep 04 17:49:02 devstack sudo[87676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:49:02 devstack sudo[87676]: pam_unix(sudo:session): session closed for user root Sep 04 17:49:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-567e1bc8-559f-4683-95e2-c0552b886b73 tempest-TaggedAttachmentsTest-158936181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4419767a-e970-4db5-af50-882a81500237 1073741824" returned: 0 in 0.610s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:49:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-567e1bc8-559f-4683-95e2-c0552b886b73 tempest-TaggedAttachmentsTest-158936181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4419767a-e970-4db5-af50-882a81500237 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:49:02 devstack sudo[88017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4419767a-e970-4db5-af50-882a81500237 Sep 04 17:49:02 devstack sudo[88017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:49:03 devstack sudo[88017]: pam_unix(sudo:session): session closed for user root Sep 04 17:49:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-567e1bc8-559f-4683-95e2-c0552b886b73 tempest-TaggedAttachmentsTest-158936181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4419767a-e970-4db5-af50-882a81500237" returned: 0 in 0.524s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:49:03 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-567e1bc8-559f-4683-95e2-c0552b886b73 tempest-TaggedAttachmentsTest-158936181 None] <== create_volume: return (1241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:49:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-567e1bc8-559f-4683-95e2-c0552b886b73 tempest-TaggedAttachmentsTest-158936181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.243s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:49:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-567e1bc8-559f-4683-95e2-c0552b886b73 tempest-TaggedAttachmentsTest-158936181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf2f5c62-5058-4300-a81e-09dcb1a1ae88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4419767a-e970-4db5-af50-882a81500237', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:49:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-567e1bc8-559f-4683-95e2-c0552b886b73 tempest-TaggedAttachmentsTest-158936181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec0fab28-9ef9-4698-b8e0-31f1d6dcf0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:49:03 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-567e1bc8-559f-4683-95e2-c0552b886b73 tempest-TaggedAttachmentsTest-158936181 None] Volume volume-4419767a-e970-4db5-af50-882a81500237 (4419767a-e970-4db5-af50-882a81500237): created successfully Sep 04 17:49:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-567e1bc8-559f-4683-95e2-c0552b886b73 tempest-TaggedAttachmentsTest-158936181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec0fab28-9ef9-4698-b8e0-31f1d6dcf0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:49:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-567e1bc8-559f-4683-95e2-c0552b886b73 tempest-TaggedAttachmentsTest-158936181 None] Flow 'volume_create_manager' (51e610d9-0cf4-4129-ad24-0e43335b49ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:49:03 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-567e1bc8-559f-4683-95e2-c0552b886b73 tempest-TaggedAttachmentsTest-158936181 None] Created volume successfully. Sep 04 17:49:13 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=3,cinder:UPDATE=4 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 17:49:13 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:UPDATE=2,cinder:SELECT=1,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 17:49:21 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 17:49:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:49:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:49:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:49:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:49:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:49:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:49:21 devstack sudo[88370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:49:21 devstack sudo[88370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:49:21 devstack sudo[88370]: pam_unix(sudo:session): session closed for user root Sep 04 17:49:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.570s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:49:21 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:49:21 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running periodic task VolumeManager._thread_info {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 17:49:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] thread count: 6 {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 17:49:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] thread info: [<_MainThread(MainThread, started 139900377723008)>, , , , , ] {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 17:49:27 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-6985a862-94e4-49ca-97ee-dfeee92e4cf1 tempest-VolumesAdminNegativeTest-1040486362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:49:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6985a862-94e4-49ca-97ee-dfeee92e4cf1 tempest-VolumesAdminNegativeTest-1040486362 None] Flow 'volume_create_manager' (6ff81fcb-cba2-4e46-9272-0e998b5c6244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:49:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6985a862-94e4-49ca-97ee-dfeee92e4cf1 tempest-VolumesAdminNegativeTest-1040486362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccd45926-d757-4abe-96b2-308b6876ba30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:49:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6985a862-94e4-49ca-97ee-dfeee92e4cf1 tempest-VolumesAdminNegativeTest-1040486362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccd45926-d757-4abe-96b2-308b6876ba30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:49:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-348147203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a1ea402-61d5-4861-8272-6990a3f57fe0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbc7e17f46b743dcb42063392f214992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:49:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:49:27Z,use_quota=True,user_id='376d53360ce4414eabf32ecb33e9b968',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:49:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6985a862-94e4-49ca-97ee-dfeee92e4cf1 tempest-VolumesAdminNegativeTest-1040486362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cbf1fd9-27bf-4cf4-99b2-c4c00d97ae63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:49:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6985a862-94e4-49ca-97ee-dfeee92e4cf1 tempest-VolumesAdminNegativeTest-1040486362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cbf1fd9-27bf-4cf4-99b2-c4c00d97ae63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:49:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6985a862-94e4-49ca-97ee-dfeee92e4cf1 tempest-VolumesAdminNegativeTest-1040486362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00fe471a-5133-4300-9f5c-2ef70de07acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:49:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6985a862-94e4-49ca-97ee-dfeee92e4cf1 tempest-VolumesAdminNegativeTest-1040486362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00fe471a-5133-4300-9f5c-2ef70de07acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a1ea402-61d5-4861-8272-6990a3f57fe0', 'volume_name': 'volume-7a1ea402-61d5-4861-8272-6990a3f57fe0', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:49:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6985a862-94e4-49ca-97ee-dfeee92e4cf1 tempest-VolumesAdminNegativeTest-1040486362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f62756a-5279-4549-9434-23fee049a4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:49:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6985a862-94e4-49ca-97ee-dfeee92e4cf1 tempest-VolumesAdminNegativeTest-1040486362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f62756a-5279-4549-9434-23fee049a4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:49:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6985a862-94e4-49ca-97ee-dfeee92e4cf1 tempest-VolumesAdminNegativeTest-1040486362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5144f27-f33e-46c4-828e-489a5f2ee1d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:49:27 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-6985a862-94e4-49ca-97ee-dfeee92e4cf1 tempest-VolumesAdminNegativeTest-1040486362 None] Volume 7a1ea402-61d5-4861-8272-6990a3f57fe0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a1ea402-61d5-4861-8272-6990a3f57fe0', 'volume_size': 1} Sep 04 17:49:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6985a862-94e4-49ca-97ee-dfeee92e4cf1 tempest-VolumesAdminNegativeTest-1040486362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:49:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6985a862-94e4-49ca-97ee-dfeee92e4cf1 tempest-VolumesAdminNegativeTest-1040486362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:49:27 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-6985a862-94e4-49ca-97ee-dfeee92e4cf1 tempest-VolumesAdminNegativeTest-1040486362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:49:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-348147203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a1ea402-61d5-4861-8272-6990a3f57fe0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbc7e17f46b743dcb42063392f214992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:49:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:49:27Z,use_quota=True,user_id='376d53360ce4414eabf32ecb33e9b968',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:49:27 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-6985a862-94e4-49ca-97ee-dfeee92e4cf1 tempest-VolumesAdminNegativeTest-1040486362 None] Creating volume 7a1ea402-61d5-4861-8272-6990a3f57fe0 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:49:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6985a862-94e4-49ca-97ee-dfeee92e4cf1 tempest-VolumesAdminNegativeTest-1040486362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:49:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6985a862-94e4-49ca-97ee-dfeee92e4cf1 tempest-VolumesAdminNegativeTest-1040486362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:49:27 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-6985a862-94e4-49ca-97ee-dfeee92e4cf1 tempest-VolumesAdminNegativeTest-1040486362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:49:27 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-6985a862-94e4-49ca-97ee-dfeee92e4cf1 tempest-VolumesAdminNegativeTest-1040486362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:49:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6985a862-94e4-49ca-97ee-dfeee92e4cf1 tempest-VolumesAdminNegativeTest-1040486362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:49:27 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-6985a862-94e4-49ca-97ee-dfeee92e4cf1 tempest-VolumesAdminNegativeTest-1040486362 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:49:27 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-6985a862-94e4-49ca-97ee-dfeee92e4cf1 tempest-VolumesAdminNegativeTest-1040486362 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:49:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6985a862-94e4-49ca-97ee-dfeee92e4cf1 tempest-VolumesAdminNegativeTest-1040486362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7a1ea402-61d5-4861-8272-6990a3f57fe0 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:49:27 devstack sudo[88443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7a1ea402-61d5-4861-8272-6990a3f57fe0 1073741824 Sep 04 17:49:27 devstack sudo[88443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:49:28 devstack sudo[88443]: pam_unix(sudo:session): session closed for user root Sep 04 17:49:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6985a862-94e4-49ca-97ee-dfeee92e4cf1 tempest-VolumesAdminNegativeTest-1040486362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7a1ea402-61d5-4861-8272-6990a3f57fe0 1073741824" returned: 0 in 1.063s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:49:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6985a862-94e4-49ca-97ee-dfeee92e4cf1 tempest-VolumesAdminNegativeTest-1040486362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7a1ea402-61d5-4861-8272-6990a3f57fe0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:49:28 devstack sudo[88454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7a1ea402-61d5-4861-8272-6990a3f57fe0 Sep 04 17:49:28 devstack sudo[88454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:49:29 devstack sudo[88454]: pam_unix(sudo:session): session closed for user root Sep 04 17:49:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6985a862-94e4-49ca-97ee-dfeee92e4cf1 tempest-VolumesAdminNegativeTest-1040486362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7a1ea402-61d5-4861-8272-6990a3f57fe0" returned: 0 in 0.514s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:49:29 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-6985a862-94e4-49ca-97ee-dfeee92e4cf1 tempest-VolumesAdminNegativeTest-1040486362 None] <== create_volume: return (1683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:49:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6985a862-94e4-49ca-97ee-dfeee92e4cf1 tempest-VolumesAdminNegativeTest-1040486362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.688s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:49:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6985a862-94e4-49ca-97ee-dfeee92e4cf1 tempest-VolumesAdminNegativeTest-1040486362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5144f27-f33e-46c4-828e-489a5f2ee1d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a1ea402-61d5-4861-8272-6990a3f57fe0', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:49:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6985a862-94e4-49ca-97ee-dfeee92e4cf1 tempest-VolumesAdminNegativeTest-1040486362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d49ec3d0-8d61-4c23-87a3-c4a9b0449329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:49:29 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-6985a862-94e4-49ca-97ee-dfeee92e4cf1 tempest-VolumesAdminNegativeTest-1040486362 None] Volume volume-7a1ea402-61d5-4861-8272-6990a3f57fe0 (7a1ea402-61d5-4861-8272-6990a3f57fe0): created successfully Sep 04 17:49:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6985a862-94e4-49ca-97ee-dfeee92e4cf1 tempest-VolumesAdminNegativeTest-1040486362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d49ec3d0-8d61-4c23-87a3-c4a9b0449329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:49:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6985a862-94e4-49ca-97ee-dfeee92e4cf1 tempest-VolumesAdminNegativeTest-1040486362 None] Flow 'volume_create_manager' (6ff81fcb-cba2-4e46-9272-0e998b5c6244) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:49:29 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-6985a862-94e4-49ca-97ee-dfeee92e4cf1 tempest-VolumesAdminNegativeTest-1040486362 None] Created volume successfully. Sep 04 17:49:30 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e4fef27a-2740-440f-bb10-3874fc9211c3 tempest-VolumesAdminNegativeTest-1040486362 None] Acquiring lock "cinder-7a1ea402-61d5-4861-8272-6990a3f57fe0-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:49:30 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e4fef27a-2740-440f-bb10-3874fc9211c3 tempest-VolumesAdminNegativeTest-1040486362 None] Lock "cinder-7a1ea402-61d5-4861-8272-6990a3f57fe0-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:49:30 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e4fef27a-2740-440f-bb10-3874fc9211c3 tempest-VolumesAdminNegativeTest-1040486362 None] Acquiring lock "cinder-quobyte-7a1ea402-61d5-4861-8272-6990a3f57fe0" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:49:30 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e4fef27a-2740-440f-bb10-3874fc9211c3 tempest-VolumesAdminNegativeTest-1040486362 None] Lock "cinder-quobyte-7a1ea402-61d5-4861-8272-6990a3f57fe0" acquired by "delete_volume" :: waited 0.039s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:49:30 devstack cinder-volume[87314]: INFO oslo.privsep.daemon [None req-e4fef27a-2740-440f-bb10-3874fc9211c3 tempest-VolumesAdminNegativeTest-1040486362 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp3phnp1_b/privsep.sock'] Sep 04 17:49:30 devstack sudo[88495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp3phnp1_b/privsep.sock Sep 04 17:49:30 devstack sudo[88495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:49:32 devstack cinder-volume[87314]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 04 17:49:32 devstack cinder-volume[87314]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 04 17:49:32 devstack cinder-volume[87314]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 04 17:49:32 devstack cinder-volume[87314]: WARNING oslo.privsep.daemon [-] privsep log: Sep 04 17:49:32 devstack cinder-volume[87314]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 04 17:49:32 devstack cinder-volume[87314]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 04 17:49:32 devstack cinder-volume[87314]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 04 17:49:32 devstack cinder-volume[87314]: WARNING oslo.privsep.daemon [-] privsep log: Sep 04 17:49:32 devstack cinder-volume[87314]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 04 17:49:33 devstack sudo[88495]: pam_unix(sudo:session): session closed for user root Sep 04 17:49:33 devstack cinder-volume[87314]: INFO oslo.privsep.daemon [None req-e4fef27a-2740-440f-bb10-3874fc9211c3 tempest-VolumesAdminNegativeTest-1040486362 None] Spawned new privsep daemon via rootwrap Sep 04 17:49:33 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [None req-e4fef27a-2740-440f-bb10-3874fc9211c3 tempest-VolumesAdminNegativeTest-1040486362 None] Accepted privsep connection to /tmp/tmp3phnp1_b/privsep.sock {{(pid=87314) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 04 17:49:33 devstack cinder-volume[87314]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 04 17:49:33 devstack cinder-volume[87314]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 04 17:49:33 devstack cinder-volume[87314]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 04 17:49:33 devstack cinder-volume[87314]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88537 Sep 04 17:49:33 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d97d213-3da8-4d85-b786-bc751d4ef2ba]: (2,) {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:49:33 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[1973cde4-5b21-4818-a06a-5e74ecddaaa4]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:49:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e4fef27a-2740-440f-bb10-3874fc9211c3 tempest-VolumesAdminNegativeTest-1040486362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7a1ea402-61d5-4861-8272-6990a3f57fe0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:49:33 devstack sudo[88539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7a1ea402-61d5-4861-8272-6990a3f57fe0 Sep 04 17:49:33 devstack sudo[88539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:49:33 devstack sudo[88539]: pam_unix(sudo:session): session closed for user root Sep 04 17:49:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e4fef27a-2740-440f-bb10-3874fc9211c3 tempest-VolumesAdminNegativeTest-1040486362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7a1ea402-61d5-4861-8272-6990a3f57fe0" returned: 0 in 0.473s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:49:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e4fef27a-2740-440f-bb10-3874fc9211c3 tempest-VolumesAdminNegativeTest-1040486362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7a1ea402-61d5-4861-8272-6990a3f57fe0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:49:33 devstack sudo[88544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7a1ea402-61d5-4861-8272-6990a3f57fe0 Sep 04 17:49:33 devstack sudo[88544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:49:33 devstack sudo[88544]: pam_unix(sudo:session): session closed for user root Sep 04 17:49:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e4fef27a-2740-440f-bb10-3874fc9211c3 tempest-VolumesAdminNegativeTest-1040486362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7a1ea402-61d5-4861-8272-6990a3f57fe0" returned: 0 in 0.388s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:49:33 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e4fef27a-2740-440f-bb10-3874fc9211c3 tempest-VolumesAdminNegativeTest-1040486362 None] Lock "cinder-quobyte-7a1ea402-61d5-4861-8272-6990a3f57fe0" released by "delete_volume" :: held 3.186s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:49:34 devstack cinder-volume[87314]: WARNING cinder.quota [None req-e4fef27a-2740-440f-bb10-3874fc9211c3 tempest-VolumesAdminNegativeTest-1040486362 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 04 17:49:34 devstack cinder-volume[87314]: WARNING cinder.quota [None req-e4fef27a-2740-440f-bb10-3874fc9211c3 tempest-VolumesAdminNegativeTest-1040486362 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 04 17:49:34 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-e4fef27a-2740-440f-bb10-3874fc9211c3 tempest-VolumesAdminNegativeTest-1040486362 None] Created reservations ['efbb935f-9b5f-4573-82cd-63401bfdf470', 'da1247c5-5d67-49c3-a43f-1331591a91fb', '6d38915d-b7df-4e73-be78-ccc8b46886ca', 'a83a79f5-79bf-455f-898c-e5e2aad8ba39'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:49:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e4fef27a-2740-440f-bb10-3874fc9211c3 tempest-VolumesAdminNegativeTest-1040486362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:49:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e4fef27a-2740-440f-bb10-3874fc9211c3 tempest-VolumesAdminNegativeTest-1040486362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:49:34 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e4fef27a-2740-440f-bb10-3874fc9211c3 tempest-VolumesAdminNegativeTest-1040486362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:49:34 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e4fef27a-2740-440f-bb10-3874fc9211c3 tempest-VolumesAdminNegativeTest-1040486362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:49:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e4fef27a-2740-440f-bb10-3874fc9211c3 tempest-VolumesAdminNegativeTest-1040486362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:49:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e4fef27a-2740-440f-bb10-3874fc9211c3 tempest-VolumesAdminNegativeTest-1040486362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:49:34 devstack sudo[88547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:49:34 devstack sudo[88547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:49:34 devstack sudo[88547]: pam_unix(sudo:session): session closed for user root Sep 04 17:49:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e4fef27a-2740-440f-bb10-3874fc9211c3 tempest-VolumesAdminNegativeTest-1040486362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.318s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:49:34 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-e4fef27a-2740-440f-bb10-3874fc9211c3 tempest-VolumesAdminNegativeTest-1040486362 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:49:34 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-e4fef27a-2740-440f-bb10-3874fc9211c3 tempest-VolumesAdminNegativeTest-1040486362 None] Deleted volume successfully. Sep 04 17:49:34 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e4fef27a-2740-440f-bb10-3874fc9211c3 tempest-VolumesAdminNegativeTest-1040486362 None] Lock "cinder-7a1ea402-61d5-4861-8272-6990a3f57fe0-delete_volume" released by "delete_volume" :: held 3.939s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:49:42 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2b89af6-5d94-40aa-b0d4-d5741135cd1f tempest-AttachVolumeTestJSON-183267417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:49:42 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a2b89af6-5d94-40aa-b0d4-d5741135cd1f tempest-AttachVolumeTestJSON-183267417 None] Flow 'volume_create_manager' (00900029-0527-49a5-82dd-00093033facc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:49:42 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a2b89af6-5d94-40aa-b0d4-d5741135cd1f tempest-AttachVolumeTestJSON-183267417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21e3b6c0-6faf-468b-9667-bc964e50787f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:49:42 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a2b89af6-5d94-40aa-b0d4-d5741135cd1f tempest-AttachVolumeTestJSON-183267417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21e3b6c0-6faf-468b-9667-bc964e50787f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:49:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-969648584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0df7a3e-2952-43a2-899d-6fb5e153948a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fdd366b1d374ba395bb930ab91f2fb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:49:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:49:43Z,use_quota=True,user_id='6e07b49cd1774bfe8ae5cfd1e08ea7e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:49:42 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a2b89af6-5d94-40aa-b0d4-d5741135cd1f tempest-AttachVolumeTestJSON-183267417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95fd800c-6d5e-4db5-8349-436ebdf15f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:49:42 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a2b89af6-5d94-40aa-b0d4-d5741135cd1f tempest-AttachVolumeTestJSON-183267417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95fd800c-6d5e-4db5-8349-436ebdf15f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:49:42 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a2b89af6-5d94-40aa-b0d4-d5741135cd1f tempest-AttachVolumeTestJSON-183267417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3097944b-22b1-4e2a-bf26-783e05bc7ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:49:42 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a2b89af6-5d94-40aa-b0d4-d5741135cd1f tempest-AttachVolumeTestJSON-183267417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3097944b-22b1-4e2a-bf26-783e05bc7ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0df7a3e-2952-43a2-899d-6fb5e153948a', 'volume_name': 'volume-c0df7a3e-2952-43a2-899d-6fb5e153948a', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:49:42 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a2b89af6-5d94-40aa-b0d4-d5741135cd1f tempest-AttachVolumeTestJSON-183267417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea5dc8b5-4eb8-47fa-b686-2711d8c71e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:49:42 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a2b89af6-5d94-40aa-b0d4-d5741135cd1f tempest-AttachVolumeTestJSON-183267417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea5dc8b5-4eb8-47fa-b686-2711d8c71e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:49:42 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a2b89af6-5d94-40aa-b0d4-d5741135cd1f tempest-AttachVolumeTestJSON-183267417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c43b312b-0014-46ef-98f6-3ab455c3d0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:49:42 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-a2b89af6-5d94-40aa-b0d4-d5741135cd1f tempest-AttachVolumeTestJSON-183267417 None] Volume c0df7a3e-2952-43a2-899d-6fb5e153948a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0df7a3e-2952-43a2-899d-6fb5e153948a', 'volume_size': 1} Sep 04 17:49:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a2b89af6-5d94-40aa-b0d4-d5741135cd1f tempest-AttachVolumeTestJSON-183267417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:49:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a2b89af6-5d94-40aa-b0d4-d5741135cd1f tempest-AttachVolumeTestJSON-183267417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:49:42 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a2b89af6-5d94-40aa-b0d4-d5741135cd1f tempest-AttachVolumeTestJSON-183267417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:49:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-969648584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0df7a3e-2952-43a2-899d-6fb5e153948a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fdd366b1d374ba395bb930ab91f2fb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:49:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:49:43Z,use_quota=True,user_id='6e07b49cd1774bfe8ae5cfd1e08ea7e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:49:42 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-a2b89af6-5d94-40aa-b0d4-d5741135cd1f tempest-AttachVolumeTestJSON-183267417 None] Creating volume c0df7a3e-2952-43a2-899d-6fb5e153948a {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:49:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a2b89af6-5d94-40aa-b0d4-d5741135cd1f tempest-AttachVolumeTestJSON-183267417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:49:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a2b89af6-5d94-40aa-b0d4-d5741135cd1f tempest-AttachVolumeTestJSON-183267417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:49:42 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a2b89af6-5d94-40aa-b0d4-d5741135cd1f tempest-AttachVolumeTestJSON-183267417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:49:42 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a2b89af6-5d94-40aa-b0d4-d5741135cd1f tempest-AttachVolumeTestJSON-183267417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:49:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a2b89af6-5d94-40aa-b0d4-d5741135cd1f tempest-AttachVolumeTestJSON-183267417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:49:42 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a2b89af6-5d94-40aa-b0d4-d5741135cd1f tempest-AttachVolumeTestJSON-183267417 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:49:42 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-a2b89af6-5d94-40aa-b0d4-d5741135cd1f tempest-AttachVolumeTestJSON-183267417 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:49:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a2b89af6-5d94-40aa-b0d4-d5741135cd1f tempest-AttachVolumeTestJSON-183267417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c0df7a3e-2952-43a2-899d-6fb5e153948a 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:49:42 devstack sudo[88588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c0df7a3e-2952-43a2-899d-6fb5e153948a 1073741824 Sep 04 17:49:42 devstack sudo[88588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:49:43 devstack sudo[88588]: pam_unix(sudo:session): session closed for user root Sep 04 17:49:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a2b89af6-5d94-40aa-b0d4-d5741135cd1f tempest-AttachVolumeTestJSON-183267417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c0df7a3e-2952-43a2-899d-6fb5e153948a 1073741824" returned: 0 in 0.547s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:49:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a2b89af6-5d94-40aa-b0d4-d5741135cd1f tempest-AttachVolumeTestJSON-183267417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c0df7a3e-2952-43a2-899d-6fb5e153948a {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:49:43 devstack sudo[88616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c0df7a3e-2952-43a2-899d-6fb5e153948a Sep 04 17:49:43 devstack sudo[88616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:49:43 devstack sudo[88616]: pam_unix(sudo:session): session closed for user root Sep 04 17:49:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a2b89af6-5d94-40aa-b0d4-d5741135cd1f tempest-AttachVolumeTestJSON-183267417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c0df7a3e-2952-43a2-899d-6fb5e153948a" returned: 0 in 0.395s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:49:43 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a2b89af6-5d94-40aa-b0d4-d5741135cd1f tempest-AttachVolumeTestJSON-183267417 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:49:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a2b89af6-5d94-40aa-b0d4-d5741135cd1f tempest-AttachVolumeTestJSON-183267417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:49:43 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a2b89af6-5d94-40aa-b0d4-d5741135cd1f tempest-AttachVolumeTestJSON-183267417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c43b312b-0014-46ef-98f6-3ab455c3d0ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0df7a3e-2952-43a2-899d-6fb5e153948a', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:49:43 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a2b89af6-5d94-40aa-b0d4-d5741135cd1f tempest-AttachVolumeTestJSON-183267417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bda0006-4d9a-4f6a-8881-1bf198a30e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:49:43 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-a2b89af6-5d94-40aa-b0d4-d5741135cd1f tempest-AttachVolumeTestJSON-183267417 None] Volume volume-c0df7a3e-2952-43a2-899d-6fb5e153948a (c0df7a3e-2952-43a2-899d-6fb5e153948a): created successfully Sep 04 17:49:43 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a2b89af6-5d94-40aa-b0d4-d5741135cd1f tempest-AttachVolumeTestJSON-183267417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bda0006-4d9a-4f6a-8881-1bf198a30e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:49:43 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a2b89af6-5d94-40aa-b0d4-d5741135cd1f tempest-AttachVolumeTestJSON-183267417 None] Flow 'volume_create_manager' (00900029-0527-49a5-82dd-00093033facc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:49:43 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-a2b89af6-5d94-40aa-b0d4-d5741135cd1f tempest-AttachVolumeTestJSON-183267417 None] Created volume successfully. Sep 04 17:49:47 devstack cinder-volume[87314]: WARNING py.warnings [req-e90935f8-e8fe-4e3b-85ee-a465b954548e req-2fd41854-70a3-4b75-840d-902544906d06 tempest-AttachVolumeTestJSON-183267417 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Sep 04 17:49:47 devstack cinder-volume[87314]: .first() Sep 04 17:49:47 devstack cinder-volume[87314]: Sep 04 17:49:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-e90935f8-e8fe-4e3b-85ee-a465b954548e req-2fd41854-70a3-4b75-840d-902544906d06 tempest-AttachVolumeTestJSON-183267417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:49:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-e90935f8-e8fe-4e3b-85ee-a465b954548e req-2fd41854-70a3-4b75-840d-902544906d06 tempest-AttachVolumeTestJSON-183267417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:49:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-e90935f8-e8fe-4e3b-85ee-a465b954548e req-2fd41854-70a3-4b75-840d-902544906d06 tempest-AttachVolumeTestJSON-183267417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:49:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-e90935f8-e8fe-4e3b-85ee-a465b954548e req-2fd41854-70a3-4b75-840d-902544906d06 tempest-AttachVolumeTestJSON-183267417 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a', 'name': 'volume-c0df7a3e-2952-43a2-899d-6fb5e153948a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3ed69c78-8408-451d-a770-229aac1896e5', 'enforce_multipath': True} {{(pid=87314) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 17:49:47 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-e90935f8-e8fe-4e3b-85ee-a465b954548e req-2fd41854-70a3-4b75-840d-902544906d06 tempest-AttachVolumeTestJSON-183267417 None] attachment_update completed successfully. Sep 04 17:49:57 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:UPDATE=10,cinder:SELECT=11,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 17:49:57 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=20,cinder:INSERT=4,cinder:UPDATE=21,cinder:DELETE=2 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 17:50:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-11eaad9a-4f1d-47d1-a870-23432d02147f req-87a2299b-712f-49fe-bc82-01f1dd42fcf4 tempest-TaggedAttachmentsTest-158936181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:50:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-11eaad9a-4f1d-47d1-a870-23432d02147f req-87a2299b-712f-49fe-bc82-01f1dd42fcf4 tempest-TaggedAttachmentsTest-158936181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:50:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-11eaad9a-4f1d-47d1-a870-23432d02147f req-87a2299b-712f-49fe-bc82-01f1dd42fcf4 tempest-TaggedAttachmentsTest-158936181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:50:10 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-11eaad9a-4f1d-47d1-a870-23432d02147f req-87a2299b-712f-49fe-bc82-01f1dd42fcf4 tempest-TaggedAttachmentsTest-158936181 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a', 'name': 'volume-4419767a-e970-4db5-af50-882a81500237', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd8561d47-afa5-4738-a718-42736a32a8db', 'enforce_multipath': True} {{(pid=87314) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 17:50:10 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-11eaad9a-4f1d-47d1-a870-23432d02147f req-87a2299b-712f-49fe-bc82-01f1dd42fcf4 tempest-TaggedAttachmentsTest-158936181 None] attachment_update completed successfully. Sep 04 17:50:14 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-f7e84577-75cb-430a-b034-0d6550369e26 req-7605d5b5-2720-47c6-82bb-78fe8a0e6bf2 tempest-TaggedAttachmentsTest-158936181 None] Terminate volume connection completed successfully. Sep 04 17:50:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-f7e84577-75cb-430a-b034-0d6550369e26 req-7605d5b5-2720-47c6-82bb-78fe8a0e6bf2 tempest-TaggedAttachmentsTest-158936181 None] Deleting attachment d8561d47-afa5-4738-a718-42736a32a8db. {{(pid=87314) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 17:50:20 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-e393afad-f54a-4121-a8f6-f47359161023 tempest-ServerRescueNegativeTestJSON-903371480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:50:20 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e393afad-f54a-4121-a8f6-f47359161023 tempest-ServerRescueNegativeTestJSON-903371480 None] Flow 'volume_create_manager' (93088997-b14a-4998-81e1-34ebced503c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:50:20 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e393afad-f54a-4121-a8f6-f47359161023 tempest-ServerRescueNegativeTestJSON-903371480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86056a2e-8021-4882-9016-fa4d813d3348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:50:20 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e393afad-f54a-4121-a8f6-f47359161023 tempest-ServerRescueNegativeTestJSON-903371480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86056a2e-8021-4882-9016-fa4d813d3348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:50:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1820747823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f4ae888-4813-4499-b826-ed0e0bf5a6a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16038d8f7fcb4acb811967b8cecb3f03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:50:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:50:21Z,use_quota=True,user_id='f6494583f13b465e994d42b5b5d80f4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:50:20 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e393afad-f54a-4121-a8f6-f47359161023 tempest-ServerRescueNegativeTestJSON-903371480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b8e0020-83cb-4482-bff0-ff70ee461561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:50:20 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e393afad-f54a-4121-a8f6-f47359161023 tempest-ServerRescueNegativeTestJSON-903371480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b8e0020-83cb-4482-bff0-ff70ee461561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:50:20 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e393afad-f54a-4121-a8f6-f47359161023 tempest-ServerRescueNegativeTestJSON-903371480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aafb9a93-c9c8-4621-80c7-c774a3462520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:50:20 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e393afad-f54a-4121-a8f6-f47359161023 tempest-ServerRescueNegativeTestJSON-903371480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aafb9a93-c9c8-4621-80c7-c774a3462520) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f4ae888-4813-4499-b826-ed0e0bf5a6a5', 'volume_name': 'volume-6f4ae888-4813-4499-b826-ed0e0bf5a6a5', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:50:20 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e393afad-f54a-4121-a8f6-f47359161023 tempest-ServerRescueNegativeTestJSON-903371480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (125672a9-2222-4006-99f6-307386e3edb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:50:20 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e393afad-f54a-4121-a8f6-f47359161023 tempest-ServerRescueNegativeTestJSON-903371480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (125672a9-2222-4006-99f6-307386e3edb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:50:20 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e393afad-f54a-4121-a8f6-f47359161023 tempest-ServerRescueNegativeTestJSON-903371480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab71365e-4fb6-4be9-ada8-a0a541a39825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:50:20 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-e393afad-f54a-4121-a8f6-f47359161023 tempest-ServerRescueNegativeTestJSON-903371480 None] Volume 6f4ae888-4813-4499-b826-ed0e0bf5a6a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f4ae888-4813-4499-b826-ed0e0bf5a6a5', 'volume_size': 1} Sep 04 17:50:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e393afad-f54a-4121-a8f6-f47359161023 tempest-ServerRescueNegativeTestJSON-903371480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:50:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e393afad-f54a-4121-a8f6-f47359161023 tempest-ServerRescueNegativeTestJSON-903371480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:50:20 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e393afad-f54a-4121-a8f6-f47359161023 tempest-ServerRescueNegativeTestJSON-903371480 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:50:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1820747823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f4ae888-4813-4499-b826-ed0e0bf5a6a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16038d8f7fcb4acb811967b8cecb3f03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:50:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:50:21Z,use_quota=True,user_id='f6494583f13b465e994d42b5b5d80f4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:50:20 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-e393afad-f54a-4121-a8f6-f47359161023 tempest-ServerRescueNegativeTestJSON-903371480 None] Creating volume 6f4ae888-4813-4499-b826-ed0e0bf5a6a5 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:50:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e393afad-f54a-4121-a8f6-f47359161023 tempest-ServerRescueNegativeTestJSON-903371480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:50:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e393afad-f54a-4121-a8f6-f47359161023 tempest-ServerRescueNegativeTestJSON-903371480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:50:20 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e393afad-f54a-4121-a8f6-f47359161023 tempest-ServerRescueNegativeTestJSON-903371480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:50:20 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e393afad-f54a-4121-a8f6-f47359161023 tempest-ServerRescueNegativeTestJSON-903371480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:50:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e393afad-f54a-4121-a8f6-f47359161023 tempest-ServerRescueNegativeTestJSON-903371480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:50:20 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e393afad-f54a-4121-a8f6-f47359161023 tempest-ServerRescueNegativeTestJSON-903371480 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:50:20 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-e393afad-f54a-4121-a8f6-f47359161023 tempest-ServerRescueNegativeTestJSON-903371480 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:50:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e393afad-f54a-4121-a8f6-f47359161023 tempest-ServerRescueNegativeTestJSON-903371480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6f4ae888-4813-4499-b826-ed0e0bf5a6a5 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:50:20 devstack sudo[89909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6f4ae888-4813-4499-b826-ed0e0bf5a6a5 1073741824 Sep 04 17:50:20 devstack sudo[89909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:50:21 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 17:50:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:50:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:50:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:50:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:50:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:50:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:50:21 devstack sudo[89913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:50:21 devstack sudo[89913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:50:22 devstack sudo[89909]: pam_unix(sudo:session): session closed for user root Sep 04 17:50:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e393afad-f54a-4121-a8f6-f47359161023 tempest-ServerRescueNegativeTestJSON-903371480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6f4ae888-4813-4499-b826-ed0e0bf5a6a5 1073741824" returned: 0 in 1.267s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:50:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e393afad-f54a-4121-a8f6-f47359161023 tempest-ServerRescueNegativeTestJSON-903371480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6f4ae888-4813-4499-b826-ed0e0bf5a6a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:50:22 devstack sudo[89913]: pam_unix(sudo:session): session closed for user root Sep 04 17:50:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.975s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:50:22 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:50:22 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running periodic task VolumeManager._thread_info {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 17:50:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] thread count: 8 {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 17:50:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] thread info: [<_MainThread(MainThread, started 139900377723008)>, , , , , , , ] {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 17:50:22 devstack sudo[89948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6f4ae888-4813-4499-b826-ed0e0bf5a6a5 Sep 04 17:50:22 devstack sudo[89948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:50:22 devstack sudo[89948]: pam_unix(sudo:session): session closed for user root Sep 04 17:50:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e393afad-f54a-4121-a8f6-f47359161023 tempest-ServerRescueNegativeTestJSON-903371480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6f4ae888-4813-4499-b826-ed0e0bf5a6a5" returned: 0 in 0.518s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:50:22 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e393afad-f54a-4121-a8f6-f47359161023 tempest-ServerRescueNegativeTestJSON-903371480 None] <== create_volume: return (1921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:50:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e393afad-f54a-4121-a8f6-f47359161023 tempest-ServerRescueNegativeTestJSON-903371480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.929s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:50:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e393afad-f54a-4121-a8f6-f47359161023 tempest-ServerRescueNegativeTestJSON-903371480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab71365e-4fb6-4be9-ada8-a0a541a39825) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f4ae888-4813-4499-b826-ed0e0bf5a6a5', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:50:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e393afad-f54a-4121-a8f6-f47359161023 tempest-ServerRescueNegativeTestJSON-903371480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0c0fc6d-0ea0-4271-b762-92d56f9e23c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:50:22 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-e393afad-f54a-4121-a8f6-f47359161023 tempest-ServerRescueNegativeTestJSON-903371480 None] Volume volume-6f4ae888-4813-4499-b826-ed0e0bf5a6a5 (6f4ae888-4813-4499-b826-ed0e0bf5a6a5): created successfully Sep 04 17:50:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e393afad-f54a-4121-a8f6-f47359161023 tempest-ServerRescueNegativeTestJSON-903371480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0c0fc6d-0ea0-4271-b762-92d56f9e23c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:50:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e393afad-f54a-4121-a8f6-f47359161023 tempest-ServerRescueNegativeTestJSON-903371480 None] Flow 'volume_create_manager' (93088997-b14a-4998-81e1-34ebced503c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:50:22 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-e393afad-f54a-4121-a8f6-f47359161023 tempest-ServerRescueNegativeTestJSON-903371480 None] Created volume successfully. Sep 04 17:50:26 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-87bf79c9-2248-4444-9050-202db1b78e9d req-f12f6a80-3eb3-4c03-bc09-3530c7b1a812 tempest-AttachVolumeTestJSON-183267417 None] Terminate volume connection completed successfully. Sep 04 17:50:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-87bf79c9-2248-4444-9050-202db1b78e9d req-f12f6a80-3eb3-4c03-bc09-3530c7b1a812 tempest-AttachVolumeTestJSON-183267417 None] Deleting attachment 3ed69c78-8408-451d-a770-229aac1896e5. {{(pid=87314) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 17:50:28 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-1abbb0e5-c972-4a69-bf8c-f6ece9bd6717 tempest-TaggedAttachmentsTest-158936181 None] Acquiring lock "cinder-4419767a-e970-4db5-af50-882a81500237-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:50:28 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-1abbb0e5-c972-4a69-bf8c-f6ece9bd6717 tempest-TaggedAttachmentsTest-158936181 None] Lock "cinder-4419767a-e970-4db5-af50-882a81500237-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:50:28 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-1abbb0e5-c972-4a69-bf8c-f6ece9bd6717 tempest-TaggedAttachmentsTest-158936181 None] Acquiring lock "cinder-quobyte-4419767a-e970-4db5-af50-882a81500237" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:50:28 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-1abbb0e5-c972-4a69-bf8c-f6ece9bd6717 tempest-TaggedAttachmentsTest-158936181 None] Lock "cinder-quobyte-4419767a-e970-4db5-af50-882a81500237" acquired by "delete_volume" :: waited 0.036s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:50:28 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90aa063-e7da-4423-a64b-e1c293adb66f]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:50:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1abbb0e5-c972-4a69-bf8c-f6ece9bd6717 tempest-TaggedAttachmentsTest-158936181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4419767a-e970-4db5-af50-882a81500237 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:50:28 devstack sudo[89981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4419767a-e970-4db5-af50-882a81500237 Sep 04 17:50:28 devstack sudo[89981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:50:29 devstack sudo[89981]: pam_unix(sudo:session): session closed for user root Sep 04 17:50:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1abbb0e5-c972-4a69-bf8c-f6ece9bd6717 tempest-TaggedAttachmentsTest-158936181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4419767a-e970-4db5-af50-882a81500237" returned: 0 in 0.488s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:50:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1abbb0e5-c972-4a69-bf8c-f6ece9bd6717 tempest-TaggedAttachmentsTest-158936181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4419767a-e970-4db5-af50-882a81500237 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:50:29 devstack sudo[90007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4419767a-e970-4db5-af50-882a81500237 Sep 04 17:50:29 devstack sudo[90007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:50:29 devstack sudo[90007]: pam_unix(sudo:session): session closed for user root Sep 04 17:50:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1abbb0e5-c972-4a69-bf8c-f6ece9bd6717 tempest-TaggedAttachmentsTest-158936181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4419767a-e970-4db5-af50-882a81500237" returned: 0 in 0.343s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:50:29 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-1abbb0e5-c972-4a69-bf8c-f6ece9bd6717 tempest-TaggedAttachmentsTest-158936181 None] Lock "cinder-quobyte-4419767a-e970-4db5-af50-882a81500237" released by "delete_volume" :: held 0.901s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:50:29 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-1abbb0e5-c972-4a69-bf8c-f6ece9bd6717 tempest-TaggedAttachmentsTest-158936181 None] Created reservations ['22593d4d-517a-4e83-8696-69875773329f', 'f1f7271a-943e-4acf-a027-c803163dae8b', 'c1458b3c-7423-4b57-8e89-a5e579bf6414', '11f9117a-992b-42f8-b85f-ac371b24d098'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:50:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1abbb0e5-c972-4a69-bf8c-f6ece9bd6717 tempest-TaggedAttachmentsTest-158936181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:50:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1abbb0e5-c972-4a69-bf8c-f6ece9bd6717 tempest-TaggedAttachmentsTest-158936181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:50:29 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-1abbb0e5-c972-4a69-bf8c-f6ece9bd6717 tempest-TaggedAttachmentsTest-158936181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:50:29 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-1abbb0e5-c972-4a69-bf8c-f6ece9bd6717 tempest-TaggedAttachmentsTest-158936181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:50:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1abbb0e5-c972-4a69-bf8c-f6ece9bd6717 tempest-TaggedAttachmentsTest-158936181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:50:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1abbb0e5-c972-4a69-bf8c-f6ece9bd6717 tempest-TaggedAttachmentsTest-158936181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:50:29 devstack sudo[90028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:50:29 devstack sudo[90028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:50:30 devstack sudo[90028]: pam_unix(sudo:session): session closed for user root Sep 04 17:50:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1abbb0e5-c972-4a69-bf8c-f6ece9bd6717 tempest-TaggedAttachmentsTest-158936181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.323s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:50:30 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-1abbb0e5-c972-4a69-bf8c-f6ece9bd6717 tempest-TaggedAttachmentsTest-158936181 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:50:30 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-1abbb0e5-c972-4a69-bf8c-f6ece9bd6717 tempest-TaggedAttachmentsTest-158936181 None] Deleted volume successfully. Sep 04 17:50:30 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-1abbb0e5-c972-4a69-bf8c-f6ece9bd6717 tempest-TaggedAttachmentsTest-158936181 None] Lock "cinder-4419767a-e970-4db5-af50-882a81500237-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:50:39 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=15,cinder:UPDATE=8,cinder:INSERT=3 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 17:50:40 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=17,cinder:UPDATE=18,cinder:DELETE=2,cinder:INSERT=2 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 17:50:44 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-46a61bc9-d668-4da2-a0a6-579c051c38b4 tempest-ServerRescueNegativeTestJSON-903371480 None] Acquiring lock "cinder-6f4ae888-4813-4499-b826-ed0e0bf5a6a5-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:50:44 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-46a61bc9-d668-4da2-a0a6-579c051c38b4 tempest-ServerRescueNegativeTestJSON-903371480 None] Lock "cinder-6f4ae888-4813-4499-b826-ed0e0bf5a6a5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:50:45 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-46a61bc9-d668-4da2-a0a6-579c051c38b4 tempest-ServerRescueNegativeTestJSON-903371480 None] Acquiring lock "cinder-quobyte-6f4ae888-4813-4499-b826-ed0e0bf5a6a5" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:50:45 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-46a61bc9-d668-4da2-a0a6-579c051c38b4 tempest-ServerRescueNegativeTestJSON-903371480 None] Lock "cinder-quobyte-6f4ae888-4813-4499-b826-ed0e0bf5a6a5" acquired by "delete_volume" :: waited 0.046s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:50:45 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4cd5958-b724-4ca6-90ab-619adac35389]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:50:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-46a61bc9-d668-4da2-a0a6-579c051c38b4 tempest-ServerRescueNegativeTestJSON-903371480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6f4ae888-4813-4499-b826-ed0e0bf5a6a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:50:45 devstack sudo[90306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6f4ae888-4813-4499-b826-ed0e0bf5a6a5 Sep 04 17:50:45 devstack sudo[90306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:50:45 devstack sudo[90306]: pam_unix(sudo:session): session closed for user root Sep 04 17:50:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-46a61bc9-d668-4da2-a0a6-579c051c38b4 tempest-ServerRescueNegativeTestJSON-903371480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6f4ae888-4813-4499-b826-ed0e0bf5a6a5" returned: 0 in 0.757s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:50:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-46a61bc9-d668-4da2-a0a6-579c051c38b4 tempest-ServerRescueNegativeTestJSON-903371480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6f4ae888-4813-4499-b826-ed0e0bf5a6a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:50:45 devstack sudo[90314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6f4ae888-4813-4499-b826-ed0e0bf5a6a5 Sep 04 17:50:45 devstack sudo[90314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:50:46 devstack sudo[90314]: pam_unix(sudo:session): session closed for user root Sep 04 17:50:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-46a61bc9-d668-4da2-a0a6-579c051c38b4 tempest-ServerRescueNegativeTestJSON-903371480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6f4ae888-4813-4499-b826-ed0e0bf5a6a5" returned: 0 in 0.529s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:50:46 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-46a61bc9-d668-4da2-a0a6-579c051c38b4 tempest-ServerRescueNegativeTestJSON-903371480 None] Lock "cinder-quobyte-6f4ae888-4813-4499-b826-ed0e0bf5a6a5" released by "delete_volume" :: held 1.404s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:50:46 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-46a61bc9-d668-4da2-a0a6-579c051c38b4 tempest-ServerRescueNegativeTestJSON-903371480 None] Created reservations ['dfaf6e57-d071-43ed-a0b7-8f4f1250c583', '262a5a1e-adda-4ba0-937a-8212d58f8da2', '3fd75fd5-2346-44be-b84e-d71178126d7f', '669eb7b7-32f2-4967-bfe1-b5ebe233983f'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:50:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-46a61bc9-d668-4da2-a0a6-579c051c38b4 tempest-ServerRescueNegativeTestJSON-903371480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:50:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-46a61bc9-d668-4da2-a0a6-579c051c38b4 tempest-ServerRescueNegativeTestJSON-903371480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:50:46 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-46a61bc9-d668-4da2-a0a6-579c051c38b4 tempest-ServerRescueNegativeTestJSON-903371480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:50:46 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-46a61bc9-d668-4da2-a0a6-579c051c38b4 tempest-ServerRescueNegativeTestJSON-903371480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:50:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-46a61bc9-d668-4da2-a0a6-579c051c38b4 tempest-ServerRescueNegativeTestJSON-903371480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:50:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-46a61bc9-d668-4da2-a0a6-579c051c38b4 tempest-ServerRescueNegativeTestJSON-903371480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:50:46 devstack sudo[90319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:50:46 devstack sudo[90319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:50:47 devstack sudo[90319]: pam_unix(sudo:session): session closed for user root Sep 04 17:50:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-46a61bc9-d668-4da2-a0a6-579c051c38b4 tempest-ServerRescueNegativeTestJSON-903371480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.641s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:50:47 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-46a61bc9-d668-4da2-a0a6-579c051c38b4 tempest-ServerRescueNegativeTestJSON-903371480 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:50:47 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-46a61bc9-d668-4da2-a0a6-579c051c38b4 tempest-ServerRescueNegativeTestJSON-903371480 None] Deleted volume successfully. Sep 04 17:50:47 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-46a61bc9-d668-4da2-a0a6-579c051c38b4 tempest-ServerRescueNegativeTestJSON-903371480 None] Lock "cinder-6f4ae888-4813-4499-b826-ed0e0bf5a6a5-delete_volume" released by "delete_volume" :: held 2.602s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:50:50 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa662101-a1d4-4422-ad7e-0a772a3495d3 tempest-DeleteServersTestJSON-63272656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:50:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aa662101-a1d4-4422-ad7e-0a772a3495d3 tempest-DeleteServersTestJSON-63272656 None] Flow 'volume_create_manager' (81bf23c9-b6b7-4783-ba4d-94a7fa588d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:50:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aa662101-a1d4-4422-ad7e-0a772a3495d3 tempest-DeleteServersTestJSON-63272656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46e7346a-9d09-456f-8c93-efcd7c98c0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:50:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aa662101-a1d4-4422-ad7e-0a772a3495d3 tempest-DeleteServersTestJSON-63272656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46e7346a-9d09-456f-8c93-efcd7c98c0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:50:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1847591664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc6d7905-9eeb-4712-b9a5-e6f55d41c470,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be075116e5c44a1498ee23da7147cf06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:50:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:50:50Z,use_quota=True,user_id='bcaa835de0c446ad91a336d921815e54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:50:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aa662101-a1d4-4422-ad7e-0a772a3495d3 tempest-DeleteServersTestJSON-63272656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53d741ee-91df-4d34-bd53-dbd1af8ccf1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:50:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aa662101-a1d4-4422-ad7e-0a772a3495d3 tempest-DeleteServersTestJSON-63272656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53d741ee-91df-4d34-bd53-dbd1af8ccf1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:50:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aa662101-a1d4-4422-ad7e-0a772a3495d3 tempest-DeleteServersTestJSON-63272656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d7ba249-0a59-49ac-93bf-c1027bb65322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:50:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aa662101-a1d4-4422-ad7e-0a772a3495d3 tempest-DeleteServersTestJSON-63272656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d7ba249-0a59-49ac-93bf-c1027bb65322) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc6d7905-9eeb-4712-b9a5-e6f55d41c470', 'volume_name': 'volume-cc6d7905-9eeb-4712-b9a5-e6f55d41c470', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:50:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aa662101-a1d4-4422-ad7e-0a772a3495d3 tempest-DeleteServersTestJSON-63272656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b92565ac-38df-4d5b-b09b-983c5aac3d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:50:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aa662101-a1d4-4422-ad7e-0a772a3495d3 tempest-DeleteServersTestJSON-63272656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b92565ac-38df-4d5b-b09b-983c5aac3d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:50:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aa662101-a1d4-4422-ad7e-0a772a3495d3 tempest-DeleteServersTestJSON-63272656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b93ac6c-7423-4d2d-8eb4-b2ef44b03c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:50:50 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-aa662101-a1d4-4422-ad7e-0a772a3495d3 tempest-DeleteServersTestJSON-63272656 None] Volume cc6d7905-9eeb-4712-b9a5-e6f55d41c470: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc6d7905-9eeb-4712-b9a5-e6f55d41c470', 'volume_size': 1} Sep 04 17:50:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-aa662101-a1d4-4422-ad7e-0a772a3495d3 tempest-DeleteServersTestJSON-63272656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:50:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-aa662101-a1d4-4422-ad7e-0a772a3495d3 tempest-DeleteServersTestJSON-63272656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:50:50 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-aa662101-a1d4-4422-ad7e-0a772a3495d3 tempest-DeleteServersTestJSON-63272656 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:50:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1847591664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc6d7905-9eeb-4712-b9a5-e6f55d41c470,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be075116e5c44a1498ee23da7147cf06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:50:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:50:50Z,use_quota=True,user_id='bcaa835de0c446ad91a336d921815e54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:50:50 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-aa662101-a1d4-4422-ad7e-0a772a3495d3 tempest-DeleteServersTestJSON-63272656 None] Creating volume cc6d7905-9eeb-4712-b9a5-e6f55d41c470 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:50:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-aa662101-a1d4-4422-ad7e-0a772a3495d3 tempest-DeleteServersTestJSON-63272656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:50:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-aa662101-a1d4-4422-ad7e-0a772a3495d3 tempest-DeleteServersTestJSON-63272656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:50:50 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-aa662101-a1d4-4422-ad7e-0a772a3495d3 tempest-DeleteServersTestJSON-63272656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:50:50 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-aa662101-a1d4-4422-ad7e-0a772a3495d3 tempest-DeleteServersTestJSON-63272656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:50:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-aa662101-a1d4-4422-ad7e-0a772a3495d3 tempest-DeleteServersTestJSON-63272656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:50:50 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-aa662101-a1d4-4422-ad7e-0a772a3495d3 tempest-DeleteServersTestJSON-63272656 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:50:50 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-aa662101-a1d4-4422-ad7e-0a772a3495d3 tempest-DeleteServersTestJSON-63272656 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:50:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-aa662101-a1d4-4422-ad7e-0a772a3495d3 tempest-DeleteServersTestJSON-63272656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cc6d7905-9eeb-4712-b9a5-e6f55d41c470 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:50:50 devstack sudo[90352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cc6d7905-9eeb-4712-b9a5-e6f55d41c470 1073741824 Sep 04 17:50:50 devstack sudo[90352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:50:51 devstack sudo[90352]: pam_unix(sudo:session): session closed for user root Sep 04 17:50:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-aa662101-a1d4-4422-ad7e-0a772a3495d3 tempest-DeleteServersTestJSON-63272656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cc6d7905-9eeb-4712-b9a5-e6f55d41c470 1073741824" returned: 0 in 1.090s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:50:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-aa662101-a1d4-4422-ad7e-0a772a3495d3 tempest-DeleteServersTestJSON-63272656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cc6d7905-9eeb-4712-b9a5-e6f55d41c470 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:50:51 devstack sudo[90361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cc6d7905-9eeb-4712-b9a5-e6f55d41c470 Sep 04 17:50:51 devstack sudo[90361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:50:52 devstack sudo[90361]: pam_unix(sudo:session): session closed for user root Sep 04 17:50:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-aa662101-a1d4-4422-ad7e-0a772a3495d3 tempest-DeleteServersTestJSON-63272656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cc6d7905-9eeb-4712-b9a5-e6f55d41c470" returned: 0 in 0.776s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:50:52 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-aa662101-a1d4-4422-ad7e-0a772a3495d3 tempest-DeleteServersTestJSON-63272656 None] <== create_volume: return (1965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:50:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-aa662101-a1d4-4422-ad7e-0a772a3495d3 tempest-DeleteServersTestJSON-63272656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.968s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:50:52 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aa662101-a1d4-4422-ad7e-0a772a3495d3 tempest-DeleteServersTestJSON-63272656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b93ac6c-7423-4d2d-8eb4-b2ef44b03c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc6d7905-9eeb-4712-b9a5-e6f55d41c470', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:50:52 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aa662101-a1d4-4422-ad7e-0a772a3495d3 tempest-DeleteServersTestJSON-63272656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a0dde57-8de7-4393-8bb0-28791a558792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:50:52 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-aa662101-a1d4-4422-ad7e-0a772a3495d3 tempest-DeleteServersTestJSON-63272656 None] Volume volume-cc6d7905-9eeb-4712-b9a5-e6f55d41c470 (cc6d7905-9eeb-4712-b9a5-e6f55d41c470): created successfully Sep 04 17:50:52 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aa662101-a1d4-4422-ad7e-0a772a3495d3 tempest-DeleteServersTestJSON-63272656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a0dde57-8de7-4393-8bb0-28791a558792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:50:52 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aa662101-a1d4-4422-ad7e-0a772a3495d3 tempest-DeleteServersTestJSON-63272656 None] Flow 'volume_create_manager' (81bf23c9-b6b7-4783-ba4d-94a7fa588d8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:50:52 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-aa662101-a1d4-4422-ad7e-0a772a3495d3 tempest-DeleteServersTestJSON-63272656 None] Created volume successfully. Sep 04 17:50:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-936786bc-d6c6-4841-8603-4540808f958d req-f32a5ee6-225e-49fc-8e8a-618452e985cd tempest-DeleteServersTestJSON-63272656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:50:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-936786bc-d6c6-4841-8603-4540808f958d req-f32a5ee6-225e-49fc-8e8a-618452e985cd tempest-DeleteServersTestJSON-63272656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:50:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-936786bc-d6c6-4841-8603-4540808f958d req-f32a5ee6-225e-49fc-8e8a-618452e985cd tempest-DeleteServersTestJSON-63272656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:50:55 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-936786bc-d6c6-4841-8603-4540808f958d req-f32a5ee6-225e-49fc-8e8a-618452e985cd tempest-DeleteServersTestJSON-63272656 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a', 'name': 'volume-cc6d7905-9eeb-4712-b9a5-e6f55d41c470', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '43a8d96a-32da-4eb1-bd40-93f2f7d28edf', 'enforce_multipath': True} {{(pid=87314) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 17:50:55 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-936786bc-d6c6-4841-8603-4540808f958d req-f32a5ee6-225e-49fc-8e8a-618452e985cd tempest-DeleteServersTestJSON-63272656 None] attachment_update completed successfully. Sep 04 17:50:59 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-22e7008c-c24e-4208-9e19-f47773529320 req-0a4c9201-de63-4fc5-84c1-0193a1138c69 tempest-DeleteServersTestJSON-63272656 None] Terminate volume connection completed successfully. Sep 04 17:50:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-22e7008c-c24e-4208-9e19-f47773529320 req-0a4c9201-de63-4fc5-84c1-0193a1138c69 tempest-DeleteServersTestJSON-63272656 None] Deleting attachment 43a8d96a-32da-4eb1-bd40-93f2f7d28edf. {{(pid=87314) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 17:51:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f17e684c-99b7-434c-a9d8-1126db9a495e tempest-DeleteServersTestJSON-63272656 None] Acquiring lock "cinder-cc6d7905-9eeb-4712-b9a5-e6f55d41c470-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:51:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f17e684c-99b7-434c-a9d8-1126db9a495e tempest-DeleteServersTestJSON-63272656 None] Lock "cinder-cc6d7905-9eeb-4712-b9a5-e6f55d41c470-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:51:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f17e684c-99b7-434c-a9d8-1126db9a495e tempest-DeleteServersTestJSON-63272656 None] Acquiring lock "cinder-quobyte-cc6d7905-9eeb-4712-b9a5-e6f55d41c470" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:51:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f17e684c-99b7-434c-a9d8-1126db9a495e tempest-DeleteServersTestJSON-63272656 None] Lock "cinder-quobyte-cc6d7905-9eeb-4712-b9a5-e6f55d41c470" acquired by "delete_volume" :: waited 0.017s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:51:01 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[8004e258-e96f-4914-9207-1b527ff8b1aa]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:51:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f17e684c-99b7-434c-a9d8-1126db9a495e tempest-DeleteServersTestJSON-63272656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cc6d7905-9eeb-4712-b9a5-e6f55d41c470 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:51:01 devstack sudo[90856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cc6d7905-9eeb-4712-b9a5-e6f55d41c470 Sep 04 17:51:01 devstack sudo[90856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:51:01 devstack sudo[90856]: pam_unix(sudo:session): session closed for user root Sep 04 17:51:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f17e684c-99b7-434c-a9d8-1126db9a495e tempest-DeleteServersTestJSON-63272656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cc6d7905-9eeb-4712-b9a5-e6f55d41c470" returned: 0 in 0.443s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:51:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f17e684c-99b7-434c-a9d8-1126db9a495e tempest-DeleteServersTestJSON-63272656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cc6d7905-9eeb-4712-b9a5-e6f55d41c470 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:51:01 devstack sudo[90861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cc6d7905-9eeb-4712-b9a5-e6f55d41c470 Sep 04 17:51:01 devstack sudo[90861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:51:02 devstack sudo[90861]: pam_unix(sudo:session): session closed for user root Sep 04 17:51:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f17e684c-99b7-434c-a9d8-1126db9a495e tempest-DeleteServersTestJSON-63272656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cc6d7905-9eeb-4712-b9a5-e6f55d41c470" returned: 0 in 0.441s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:51:02 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f17e684c-99b7-434c-a9d8-1126db9a495e tempest-DeleteServersTestJSON-63272656 None] Lock "cinder-quobyte-cc6d7905-9eeb-4712-b9a5-e6f55d41c470" released by "delete_volume" :: held 0.927s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:51:02 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-f17e684c-99b7-434c-a9d8-1126db9a495e tempest-DeleteServersTestJSON-63272656 None] Created reservations ['5eae81cc-4d40-46f9-baf7-c4588cbe1716', '1bcdec10-a8bb-4400-92cb-8ecad61f8b16', 'd7ad617b-7874-4f11-8e50-0f4db08ccf12', '5e26d97c-aea7-4ffc-8aa5-5a8811e43ccc'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:51:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f17e684c-99b7-434c-a9d8-1126db9a495e tempest-DeleteServersTestJSON-63272656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:51:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f17e684c-99b7-434c-a9d8-1126db9a495e tempest-DeleteServersTestJSON-63272656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:51:02 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f17e684c-99b7-434c-a9d8-1126db9a495e tempest-DeleteServersTestJSON-63272656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:51:02 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f17e684c-99b7-434c-a9d8-1126db9a495e tempest-DeleteServersTestJSON-63272656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:51:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f17e684c-99b7-434c-a9d8-1126db9a495e tempest-DeleteServersTestJSON-63272656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:51:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f17e684c-99b7-434c-a9d8-1126db9a495e tempest-DeleteServersTestJSON-63272656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:51:02 devstack sudo[90864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:51:02 devstack sudo[90864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:51:02 devstack sudo[90864]: pam_unix(sudo:session): session closed for user root Sep 04 17:51:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f17e684c-99b7-434c-a9d8-1126db9a495e tempest-DeleteServersTestJSON-63272656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.282s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:51:02 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-f17e684c-99b7-434c-a9d8-1126db9a495e tempest-DeleteServersTestJSON-63272656 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:51:02 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-f17e684c-99b7-434c-a9d8-1126db9a495e tempest-DeleteServersTestJSON-63272656 None] Deleted volume successfully. Sep 04 17:51:02 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f17e684c-99b7-434c-a9d8-1126db9a495e tempest-DeleteServersTestJSON-63272656 None] Lock "cinder-cc6d7905-9eeb-4712-b9a5-e6f55d41c470-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:51:10 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-7ffc19b8-1808-4d54-a763-2bfcf3f3b7e1 tempest-GroupsV320Test-1268227315 None] Group tempest-GroupsV320Test-Group-1250303071: creating Sep 04 17:51:10 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-7ffc19b8-1808-4d54-a763-2bfcf3f3b7e1 tempest-GroupsV320Test-1268227315 None] Group tempest-GroupsV320Test-Group-1250303071: created successfully Sep 04 17:51:10 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-7ffc19b8-1808-4d54-a763-2bfcf3f3b7e1 tempest-GroupsV320Test-1268227315 None] Create group completed successfully. Sep 04 17:51:12 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-3bbcc07c-34eb-4961-82be-8783352067eb tempest-GroupsV320Test-1268227315 None] Created reservations ['02799af0-b1f2-43b3-835b-1f532a23a4ac'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:51:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3bbcc07c-34eb-4961-82be-8783352067eb tempest-GroupsV320Test-1268227315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:51:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3bbcc07c-34eb-4961-82be-8783352067eb tempest-GroupsV320Test-1268227315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:51:12 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-3bbcc07c-34eb-4961-82be-8783352067eb tempest-GroupsV320Test-1268227315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:51:12 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-3bbcc07c-34eb-4961-82be-8783352067eb tempest-GroupsV320Test-1268227315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:51:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3bbcc07c-34eb-4961-82be-8783352067eb tempest-GroupsV320Test-1268227315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:51:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3bbcc07c-34eb-4961-82be-8783352067eb tempest-GroupsV320Test-1268227315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:51:12 devstack sudo[90875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:51:12 devstack sudo[90875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:51:13 devstack sudo[90875]: pam_unix(sudo:session): session closed for user root Sep 04 17:51:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3bbcc07c-34eb-4961-82be-8783352067eb tempest-GroupsV320Test-1268227315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.296s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:51:13 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-3bbcc07c-34eb-4961-82be-8783352067eb tempest-GroupsV320Test-1268227315 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:51:13 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-3bbcc07c-34eb-4961-82be-8783352067eb tempest-GroupsV320Test-1268227315 None] Delete group completed successfully. Sep 04 17:51:21 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 17:51:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:51:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:51:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:51:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:51:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:51:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:51:21 devstack sudo[90905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:51:21 devstack sudo[90905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:51:21 devstack sudo[90905]: pam_unix(sudo:session): session closed for user root Sep 04 17:51:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.272s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:51:21 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:51:21 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running periodic task VolumeManager._thread_info {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 17:51:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] thread count: 8 {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 17:51:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] thread info: [<_MainThread(MainThread, started 139900377723008)>, , , , , , , ] {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 17:51:22 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=26,cinder:INSERT=8,cinder:UPDATE=21,cinder:DELETE=1 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 17:51:22 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=26,cinder:UPDATE=27,cinder:DELETE=2,cinder:INSERT=2 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 17:52:00 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-263b09ed-b0a3-44c6-b9a6-0b1a8e4f5c3f tempest-ServersNegativeTestJSON-1785865627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:52:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-263b09ed-b0a3-44c6-b9a6-0b1a8e4f5c3f tempest-ServersNegativeTestJSON-1785865627 None] Flow 'volume_create_manager' (9aa65a46-846a-4484-81af-33ad3a8a3cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:52:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-263b09ed-b0a3-44c6-b9a6-0b1a8e4f5c3f tempest-ServersNegativeTestJSON-1785865627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9953bdf0-6416-4313-ab80-56201e92627a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:52:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-263b09ed-b0a3-44c6-b9a6-0b1a8e4f5c3f tempest-ServersNegativeTestJSON-1785865627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9953bdf0-6416-4313-ab80-56201e92627a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:52:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-203658250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b77c78e3-a50d-4b8d-b249-84a183ac37c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='942e3d9b0bcc49a0a6058e6ee6a93f1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:52:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:52:00Z,use_quota=True,user_id='66860208382f4751af31c3374211b88a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:52:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-263b09ed-b0a3-44c6-b9a6-0b1a8e4f5c3f tempest-ServersNegativeTestJSON-1785865627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2130b233-713f-45ba-824c-1e68a29a9c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:52:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-263b09ed-b0a3-44c6-b9a6-0b1a8e4f5c3f tempest-ServersNegativeTestJSON-1785865627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2130b233-713f-45ba-824c-1e68a29a9c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:52:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-263b09ed-b0a3-44c6-b9a6-0b1a8e4f5c3f tempest-ServersNegativeTestJSON-1785865627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ece308b-e080-4a93-9c54-7051fb333937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:52:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-263b09ed-b0a3-44c6-b9a6-0b1a8e4f5c3f tempest-ServersNegativeTestJSON-1785865627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ece308b-e080-4a93-9c54-7051fb333937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b77c78e3-a50d-4b8d-b249-84a183ac37c1', 'volume_name': 'volume-b77c78e3-a50d-4b8d-b249-84a183ac37c1', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:52:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-263b09ed-b0a3-44c6-b9a6-0b1a8e4f5c3f tempest-ServersNegativeTestJSON-1785865627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a517f0d-5508-4dc2-bec2-92021816a3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:52:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-263b09ed-b0a3-44c6-b9a6-0b1a8e4f5c3f tempest-ServersNegativeTestJSON-1785865627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a517f0d-5508-4dc2-bec2-92021816a3b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:52:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-263b09ed-b0a3-44c6-b9a6-0b1a8e4f5c3f tempest-ServersNegativeTestJSON-1785865627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13f44f16-ea06-40a3-b284-3934860d3c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:52:00 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-263b09ed-b0a3-44c6-b9a6-0b1a8e4f5c3f tempest-ServersNegativeTestJSON-1785865627 None] Volume b77c78e3-a50d-4b8d-b249-84a183ac37c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b77c78e3-a50d-4b8d-b249-84a183ac37c1', 'volume_size': 1} Sep 04 17:52:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-263b09ed-b0a3-44c6-b9a6-0b1a8e4f5c3f tempest-ServersNegativeTestJSON-1785865627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:52:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-263b09ed-b0a3-44c6-b9a6-0b1a8e4f5c3f tempest-ServersNegativeTestJSON-1785865627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:52:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-263b09ed-b0a3-44c6-b9a6-0b1a8e4f5c3f tempest-ServersNegativeTestJSON-1785865627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:52:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-203658250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b77c78e3-a50d-4b8d-b249-84a183ac37c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='942e3d9b0bcc49a0a6058e6ee6a93f1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:52:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:52:00Z,use_quota=True,user_id='66860208382f4751af31c3374211b88a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:52:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-263b09ed-b0a3-44c6-b9a6-0b1a8e4f5c3f tempest-ServersNegativeTestJSON-1785865627 None] Creating volume b77c78e3-a50d-4b8d-b249-84a183ac37c1 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:52:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-263b09ed-b0a3-44c6-b9a6-0b1a8e4f5c3f tempest-ServersNegativeTestJSON-1785865627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:52:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-263b09ed-b0a3-44c6-b9a6-0b1a8e4f5c3f tempest-ServersNegativeTestJSON-1785865627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:52:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-263b09ed-b0a3-44c6-b9a6-0b1a8e4f5c3f tempest-ServersNegativeTestJSON-1785865627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:52:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-263b09ed-b0a3-44c6-b9a6-0b1a8e4f5c3f tempest-ServersNegativeTestJSON-1785865627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:52:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-263b09ed-b0a3-44c6-b9a6-0b1a8e4f5c3f tempest-ServersNegativeTestJSON-1785865627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:52:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-263b09ed-b0a3-44c6-b9a6-0b1a8e4f5c3f tempest-ServersNegativeTestJSON-1785865627 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:52:00 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-263b09ed-b0a3-44c6-b9a6-0b1a8e4f5c3f tempest-ServersNegativeTestJSON-1785865627 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:52:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-263b09ed-b0a3-44c6-b9a6-0b1a8e4f5c3f tempest-ServersNegativeTestJSON-1785865627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b77c78e3-a50d-4b8d-b249-84a183ac37c1 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:00 devstack sudo[91385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b77c78e3-a50d-4b8d-b249-84a183ac37c1 1073741824 Sep 04 17:52:00 devstack sudo[91385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:01 devstack sudo[91385]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-263b09ed-b0a3-44c6-b9a6-0b1a8e4f5c3f tempest-ServersNegativeTestJSON-1785865627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b77c78e3-a50d-4b8d-b249-84a183ac37c1 1073741824" returned: 0 in 0.712s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:52:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-263b09ed-b0a3-44c6-b9a6-0b1a8e4f5c3f tempest-ServersNegativeTestJSON-1785865627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b77c78e3-a50d-4b8d-b249-84a183ac37c1 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:01 devstack sudo[91399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b77c78e3-a50d-4b8d-b249-84a183ac37c1 Sep 04 17:52:01 devstack sudo[91399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:01 devstack sudo[91399]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-263b09ed-b0a3-44c6-b9a6-0b1a8e4f5c3f tempest-ServersNegativeTestJSON-1785865627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b77c78e3-a50d-4b8d-b249-84a183ac37c1" returned: 0 in 0.288s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:52:01 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-263b09ed-b0a3-44c6-b9a6-0b1a8e4f5c3f tempest-ServersNegativeTestJSON-1785865627 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:52:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-263b09ed-b0a3-44c6-b9a6-0b1a8e4f5c3f tempest-ServersNegativeTestJSON-1785865627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:52:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-263b09ed-b0a3-44c6-b9a6-0b1a8e4f5c3f tempest-ServersNegativeTestJSON-1785865627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13f44f16-ea06-40a3-b284-3934860d3c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b77c78e3-a50d-4b8d-b249-84a183ac37c1', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:52:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-263b09ed-b0a3-44c6-b9a6-0b1a8e4f5c3f tempest-ServersNegativeTestJSON-1785865627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48a0316d-2a14-4ab0-9318-681c7568a41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:52:01 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-263b09ed-b0a3-44c6-b9a6-0b1a8e4f5c3f tempest-ServersNegativeTestJSON-1785865627 None] Volume volume-b77c78e3-a50d-4b8d-b249-84a183ac37c1 (b77c78e3-a50d-4b8d-b249-84a183ac37c1): created successfully Sep 04 17:52:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-263b09ed-b0a3-44c6-b9a6-0b1a8e4f5c3f tempest-ServersNegativeTestJSON-1785865627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48a0316d-2a14-4ab0-9318-681c7568a41a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:52:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-263b09ed-b0a3-44c6-b9a6-0b1a8e4f5c3f tempest-ServersNegativeTestJSON-1785865627 None] Flow 'volume_create_manager' (9aa65a46-846a-4484-81af-33ad3a8a3cc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:52:01 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-263b09ed-b0a3-44c6-b9a6-0b1a8e4f5c3f tempest-ServersNegativeTestJSON-1785865627 None] Created volume successfully. Sep 04 17:52:03 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-68e26684-fcf8-4f3b-ad86-d8bd076e2b05 tempest-ServersNegativeTestJSON-1785865627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:52:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-68e26684-fcf8-4f3b-ad86-d8bd076e2b05 tempest-ServersNegativeTestJSON-1785865627 None] Flow 'volume_create_manager' (ed6504e1-e9dc-4b99-bcbc-6f8719284307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:52:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-68e26684-fcf8-4f3b-ad86-d8bd076e2b05 tempest-ServersNegativeTestJSON-1785865627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d3347e0-0bac-4e6c-a9e0-7634fb519d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:52:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-68e26684-fcf8-4f3b-ad86-d8bd076e2b05 tempest-ServersNegativeTestJSON-1785865627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d3347e0-0bac-4e6c-a9e0-7634fb519d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:52:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1473181192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=158c2156-0a5f-407c-9ded-48a3c49d4eb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='942e3d9b0bcc49a0a6058e6ee6a93f1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:52:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:52:04Z,use_quota=True,user_id='66860208382f4751af31c3374211b88a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:52:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-68e26684-fcf8-4f3b-ad86-d8bd076e2b05 tempest-ServersNegativeTestJSON-1785865627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5429590-4de1-46d7-a037-e9cca9a2dbf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:52:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-68e26684-fcf8-4f3b-ad86-d8bd076e2b05 tempest-ServersNegativeTestJSON-1785865627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5429590-4de1-46d7-a037-e9cca9a2dbf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:52:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-68e26684-fcf8-4f3b-ad86-d8bd076e2b05 tempest-ServersNegativeTestJSON-1785865627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (105adf59-8955-4bcd-819a-c31234fe1aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:52:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-68e26684-fcf8-4f3b-ad86-d8bd076e2b05 tempest-ServersNegativeTestJSON-1785865627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (105adf59-8955-4bcd-819a-c31234fe1aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '158c2156-0a5f-407c-9ded-48a3c49d4eb2', 'volume_name': 'volume-158c2156-0a5f-407c-9ded-48a3c49d4eb2', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:52:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-68e26684-fcf8-4f3b-ad86-d8bd076e2b05 tempest-ServersNegativeTestJSON-1785865627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f40e530-1e4f-4b91-828e-e304ec065668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:52:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-68e26684-fcf8-4f3b-ad86-d8bd076e2b05 tempest-ServersNegativeTestJSON-1785865627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f40e530-1e4f-4b91-828e-e304ec065668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:52:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-68e26684-fcf8-4f3b-ad86-d8bd076e2b05 tempest-ServersNegativeTestJSON-1785865627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (618ff567-1491-42e8-9870-6f173047fcab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:52:04 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-68e26684-fcf8-4f3b-ad86-d8bd076e2b05 tempest-ServersNegativeTestJSON-1785865627 None] Volume 158c2156-0a5f-407c-9ded-48a3c49d4eb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-158c2156-0a5f-407c-9ded-48a3c49d4eb2', 'volume_size': 1} Sep 04 17:52:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-68e26684-fcf8-4f3b-ad86-d8bd076e2b05 tempest-ServersNegativeTestJSON-1785865627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:52:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-68e26684-fcf8-4f3b-ad86-d8bd076e2b05 tempest-ServersNegativeTestJSON-1785865627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:52:04 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-68e26684-fcf8-4f3b-ad86-d8bd076e2b05 tempest-ServersNegativeTestJSON-1785865627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:52:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1473181192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=158c2156-0a5f-407c-9ded-48a3c49d4eb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='942e3d9b0bcc49a0a6058e6ee6a93f1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:52:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:52:04Z,use_quota=True,user_id='66860208382f4751af31c3374211b88a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:52:04 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-68e26684-fcf8-4f3b-ad86-d8bd076e2b05 tempest-ServersNegativeTestJSON-1785865627 None] Creating volume 158c2156-0a5f-407c-9ded-48a3c49d4eb2 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:52:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-68e26684-fcf8-4f3b-ad86-d8bd076e2b05 tempest-ServersNegativeTestJSON-1785865627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:52:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-68e26684-fcf8-4f3b-ad86-d8bd076e2b05 tempest-ServersNegativeTestJSON-1785865627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:52:04 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-68e26684-fcf8-4f3b-ad86-d8bd076e2b05 tempest-ServersNegativeTestJSON-1785865627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:52:04 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-68e26684-fcf8-4f3b-ad86-d8bd076e2b05 tempest-ServersNegativeTestJSON-1785865627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:52:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-68e26684-fcf8-4f3b-ad86-d8bd076e2b05 tempest-ServersNegativeTestJSON-1785865627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:52:04 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-68e26684-fcf8-4f3b-ad86-d8bd076e2b05 tempest-ServersNegativeTestJSON-1785865627 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:52:04 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-68e26684-fcf8-4f3b-ad86-d8bd076e2b05 tempest-ServersNegativeTestJSON-1785865627 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:52:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-68e26684-fcf8-4f3b-ad86-d8bd076e2b05 tempest-ServersNegativeTestJSON-1785865627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-158c2156-0a5f-407c-9ded-48a3c49d4eb2 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:04 devstack sudo[91406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-158c2156-0a5f-407c-9ded-48a3c49d4eb2 1073741824 Sep 04 17:52:04 devstack sudo[91406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:04 devstack sudo[91406]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-68e26684-fcf8-4f3b-ad86-d8bd076e2b05 tempest-ServersNegativeTestJSON-1785865627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-158c2156-0a5f-407c-9ded-48a3c49d4eb2 1073741824" returned: 0 in 0.540s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:52:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-68e26684-fcf8-4f3b-ad86-d8bd076e2b05 tempest-ServersNegativeTestJSON-1785865627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-158c2156-0a5f-407c-9ded-48a3c49d4eb2 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:04 devstack sudo[91436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-158c2156-0a5f-407c-9ded-48a3c49d4eb2 Sep 04 17:52:04 devstack sudo[91436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:04 devstack sudo[91436]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-68e26684-fcf8-4f3b-ad86-d8bd076e2b05 tempest-ServersNegativeTestJSON-1785865627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-158c2156-0a5f-407c-9ded-48a3c49d4eb2" returned: 0 in 0.260s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:52:04 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-68e26684-fcf8-4f3b-ad86-d8bd076e2b05 tempest-ServersNegativeTestJSON-1785865627 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:52:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-68e26684-fcf8-4f3b-ad86-d8bd076e2b05 tempest-ServersNegativeTestJSON-1785865627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:52:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-68e26684-fcf8-4f3b-ad86-d8bd076e2b05 tempest-ServersNegativeTestJSON-1785865627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (618ff567-1491-42e8-9870-6f173047fcab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-158c2156-0a5f-407c-9ded-48a3c49d4eb2', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:52:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-68e26684-fcf8-4f3b-ad86-d8bd076e2b05 tempest-ServersNegativeTestJSON-1785865627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1b49aac-4f68-4a2b-9def-316103ac3007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:52:04 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-68e26684-fcf8-4f3b-ad86-d8bd076e2b05 tempest-ServersNegativeTestJSON-1785865627 None] Volume volume-158c2156-0a5f-407c-9ded-48a3c49d4eb2 (158c2156-0a5f-407c-9ded-48a3c49d4eb2): created successfully Sep 04 17:52:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-68e26684-fcf8-4f3b-ad86-d8bd076e2b05 tempest-ServersNegativeTestJSON-1785865627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1b49aac-4f68-4a2b-9def-316103ac3007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:52:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-68e26684-fcf8-4f3b-ad86-d8bd076e2b05 tempest-ServersNegativeTestJSON-1785865627 None] Flow 'volume_create_manager' (ed6504e1-e9dc-4b99-bcbc-6f8719284307) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:52:04 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-68e26684-fcf8-4f3b-ad86-d8bd076e2b05 tempest-ServersNegativeTestJSON-1785865627 None] Created volume successfully. Sep 04 17:52:06 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7eb19fc2-8863-4760-afcd-1a303c866c9a tempest-ServersNegativeTestJSON-1785865627 None] Acquiring lock "cinder-158c2156-0a5f-407c-9ded-48a3c49d4eb2-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:52:06 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7eb19fc2-8863-4760-afcd-1a303c866c9a tempest-ServersNegativeTestJSON-1785865627 None] Lock "cinder-158c2156-0a5f-407c-9ded-48a3c49d4eb2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:52:06 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7eb19fc2-8863-4760-afcd-1a303c866c9a tempest-ServersNegativeTestJSON-1785865627 None] Acquiring lock "cinder-quobyte-158c2156-0a5f-407c-9ded-48a3c49d4eb2" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:52:06 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7eb19fc2-8863-4760-afcd-1a303c866c9a tempest-ServersNegativeTestJSON-1785865627 None] Lock "cinder-quobyte-158c2156-0a5f-407c-9ded-48a3c49d4eb2" acquired by "delete_volume" :: waited 0.020s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:52:06 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f8d35a-1b7c-408a-9d65-8455788f336e]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:52:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7eb19fc2-8863-4760-afcd-1a303c866c9a tempest-ServersNegativeTestJSON-1785865627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-158c2156-0a5f-407c-9ded-48a3c49d4eb2 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:06 devstack sudo[91439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-158c2156-0a5f-407c-9ded-48a3c49d4eb2 Sep 04 17:52:06 devstack sudo[91439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:06 devstack sudo[91439]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7eb19fc2-8863-4760-afcd-1a303c866c9a tempest-ServersNegativeTestJSON-1785865627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-158c2156-0a5f-407c-9ded-48a3c49d4eb2" returned: 0 in 0.395s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:52:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7eb19fc2-8863-4760-afcd-1a303c866c9a tempest-ServersNegativeTestJSON-1785865627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-158c2156-0a5f-407c-9ded-48a3c49d4eb2 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:07 devstack sudo[91444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-158c2156-0a5f-407c-9ded-48a3c49d4eb2 Sep 04 17:52:07 devstack sudo[91444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:07 devstack sudo[91444]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7eb19fc2-8863-4760-afcd-1a303c866c9a tempest-ServersNegativeTestJSON-1785865627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-158c2156-0a5f-407c-9ded-48a3c49d4eb2" returned: 0 in 0.238s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:52:07 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7eb19fc2-8863-4760-afcd-1a303c866c9a tempest-ServersNegativeTestJSON-1785865627 None] Lock "cinder-quobyte-158c2156-0a5f-407c-9ded-48a3c49d4eb2" released by "delete_volume" :: held 0.676s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:52:07 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-7eb19fc2-8863-4760-afcd-1a303c866c9a tempest-ServersNegativeTestJSON-1785865627 None] Created reservations ['9a914822-4305-40ac-aa77-5224ec64aa48', '8bf34257-2ea9-4444-af76-1224417e1906', '621c16be-a109-459f-aef8-9cbb9ef04ccb', '32b0a863-5fcc-4f67-a683-2b595459d8d4'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:52:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7eb19fc2-8863-4760-afcd-1a303c866c9a tempest-ServersNegativeTestJSON-1785865627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:52:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7eb19fc2-8863-4760-afcd-1a303c866c9a tempest-ServersNegativeTestJSON-1785865627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:52:07 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7eb19fc2-8863-4760-afcd-1a303c866c9a tempest-ServersNegativeTestJSON-1785865627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:52:07 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7eb19fc2-8863-4760-afcd-1a303c866c9a tempest-ServersNegativeTestJSON-1785865627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:52:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7eb19fc2-8863-4760-afcd-1a303c866c9a tempest-ServersNegativeTestJSON-1785865627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:52:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7eb19fc2-8863-4760-afcd-1a303c866c9a tempest-ServersNegativeTestJSON-1785865627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:07 devstack sudo[91447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:52:07 devstack sudo[91447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:07 devstack sudo[91447]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7eb19fc2-8863-4760-afcd-1a303c866c9a tempest-ServersNegativeTestJSON-1785865627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.242s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:52:07 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-7eb19fc2-8863-4760-afcd-1a303c866c9a tempest-ServersNegativeTestJSON-1785865627 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:52:07 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-7eb19fc2-8863-4760-afcd-1a303c866c9a tempest-ServersNegativeTestJSON-1785865627 None] Deleted volume successfully. Sep 04 17:52:07 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7eb19fc2-8863-4760-afcd-1a303c866c9a tempest-ServersNegativeTestJSON-1785865627 None] Lock "cinder-158c2156-0a5f-407c-9ded-48a3c49d4eb2-delete_volume" released by "delete_volume" :: held 1.119s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:52:07 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f38e43b2-11a0-483e-819d-54041003fb03 tempest-ServersNegativeTestJSON-1785865627 None] Acquiring lock "cinder-b77c78e3-a50d-4b8d-b249-84a183ac37c1-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:52:07 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f38e43b2-11a0-483e-819d-54041003fb03 tempest-ServersNegativeTestJSON-1785865627 None] Lock "cinder-b77c78e3-a50d-4b8d-b249-84a183ac37c1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:52:07 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f38e43b2-11a0-483e-819d-54041003fb03 tempest-ServersNegativeTestJSON-1785865627 None] Acquiring lock "cinder-quobyte-b77c78e3-a50d-4b8d-b249-84a183ac37c1" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:52:07 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f38e43b2-11a0-483e-819d-54041003fb03 tempest-ServersNegativeTestJSON-1785865627 None] Lock "cinder-quobyte-b77c78e3-a50d-4b8d-b249-84a183ac37c1" acquired by "delete_volume" :: waited 0.018s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:52:07 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5e2d89-1f2e-467c-acae-5f0991e20f02]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:52:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f38e43b2-11a0-483e-819d-54041003fb03 tempest-ServersNegativeTestJSON-1785865627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b77c78e3-a50d-4b8d-b249-84a183ac37c1 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:07 devstack sudo[91450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b77c78e3-a50d-4b8d-b249-84a183ac37c1 Sep 04 17:52:07 devstack sudo[91450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:08 devstack sudo[91450]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f38e43b2-11a0-483e-819d-54041003fb03 tempest-ServersNegativeTestJSON-1785865627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b77c78e3-a50d-4b8d-b249-84a183ac37c1" returned: 0 in 0.399s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:52:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f38e43b2-11a0-483e-819d-54041003fb03 tempest-ServersNegativeTestJSON-1785865627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b77c78e3-a50d-4b8d-b249-84a183ac37c1 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:08 devstack sudo[91455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b77c78e3-a50d-4b8d-b249-84a183ac37c1 Sep 04 17:52:08 devstack sudo[91455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:08 devstack sudo[91455]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f38e43b2-11a0-483e-819d-54041003fb03 tempest-ServersNegativeTestJSON-1785865627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b77c78e3-a50d-4b8d-b249-84a183ac37c1" returned: 0 in 0.285s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:52:08 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f38e43b2-11a0-483e-819d-54041003fb03 tempest-ServersNegativeTestJSON-1785865627 None] Lock "cinder-quobyte-b77c78e3-a50d-4b8d-b249-84a183ac37c1" released by "delete_volume" :: held 0.737s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:52:08 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-f38e43b2-11a0-483e-819d-54041003fb03 tempest-ServersNegativeTestJSON-1785865627 None] Created reservations ['9ea56c89-a62c-4057-ab0a-a1f03f5ad915', '77fb8ce5-2138-4b4a-8f10-238994f5182c', '41556847-14be-4a7b-97fd-e6b84dd307b1', '64657976-410e-45af-85f7-bb0fb81f3873'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:52:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f38e43b2-11a0-483e-819d-54041003fb03 tempest-ServersNegativeTestJSON-1785865627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:52:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f38e43b2-11a0-483e-819d-54041003fb03 tempest-ServersNegativeTestJSON-1785865627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:52:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f38e43b2-11a0-483e-819d-54041003fb03 tempest-ServersNegativeTestJSON-1785865627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:52:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f38e43b2-11a0-483e-819d-54041003fb03 tempest-ServersNegativeTestJSON-1785865627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:52:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f38e43b2-11a0-483e-819d-54041003fb03 tempest-ServersNegativeTestJSON-1785865627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:52:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f38e43b2-11a0-483e-819d-54041003fb03 tempest-ServersNegativeTestJSON-1785865627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:08 devstack sudo[91458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:52:08 devstack sudo[91458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:08 devstack sudo[91458]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f38e43b2-11a0-483e-819d-54041003fb03 tempest-ServersNegativeTestJSON-1785865627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.341s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:52:08 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-f38e43b2-11a0-483e-819d-54041003fb03 tempest-ServersNegativeTestJSON-1785865627 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:52:09 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-f38e43b2-11a0-483e-819d-54041003fb03 tempest-ServersNegativeTestJSON-1785865627 None] Deleted volume successfully. Sep 04 17:52:09 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f38e43b2-11a0-483e-819d-54041003fb03 tempest-ServersNegativeTestJSON-1785865627 None] Lock "cinder-b77c78e3-a50d-4b8d-b249-84a183ac37c1-delete_volume" released by "delete_volume" :: held 1.340s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:52:09 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f5d83e8-fe2c-46b1-8cea-43c3ffb7828b tempest-VolumesImageMetadata-912629914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:52:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0f5d83e8-fe2c-46b1-8cea-43c3ffb7828b tempest-VolumesImageMetadata-912629914 None] Flow 'volume_create_manager' (b12cc7de-266b-4231-b870-1378d8af5f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:52:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0f5d83e8-fe2c-46b1-8cea-43c3ffb7828b tempest-VolumesImageMetadata-912629914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0039989-e04b-42d6-b9f9-86d634560b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:52:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0f5d83e8-fe2c-46b1-8cea-43c3ffb7828b tempest-VolumesImageMetadata-912629914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0039989-e04b-42d6-b9f9-86d634560b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:52:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1589296880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09b56a25-78eb-4fa1-909f-b61d39d1511b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce5cb742cf6247778d4d11d6297df926',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:52:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:52:09Z,use_quota=True,user_id='c5e29994a2654745a04c9d32bcb664f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:52:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0f5d83e8-fe2c-46b1-8cea-43c3ffb7828b tempest-VolumesImageMetadata-912629914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11f83bc7-1148-4832-83d1-44e44c5d2f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:52:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0f5d83e8-fe2c-46b1-8cea-43c3ffb7828b tempest-VolumesImageMetadata-912629914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11f83bc7-1148-4832-83d1-44e44c5d2f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:52:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0f5d83e8-fe2c-46b1-8cea-43c3ffb7828b tempest-VolumesImageMetadata-912629914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30972184-983a-4b9e-b7c0-3f397b901677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:52:09 devstack cinder-volume[87314]: DEBUG cinder.image.glance [None req-0f5d83e8-fe2c-46b1-8cea-43c3ffb7828b tempest-VolumesImageMetadata-912629914 None] Creating Keystone auth plugin from conf {{(pid=87314) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 04 17:52:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0f5d83e8-fe2c-46b1-8cea-43c3ffb7828b tempest-VolumesImageMetadata-912629914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30972184-983a-4b9e-b7c0-3f397b901677) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '09b56a25-78eb-4fa1-909f-b61d39d1511b', 'volume_name': 'volume-09b56a25-78eb-4fa1-909f-b61d39d1511b', 'volume_size': 1, 'image_id': 'eeb1e1b9-f612-4acd-9439-6285840a52d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eeb1e1b9-f612-4acd-9439-6285840a52d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'be7dacacfc0f482c9fff51cfcb1c78e5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eeb1e1b9-f612-4acd-9439-6285840a52d1', 'created_at': datetime.datetime(2026, 9, 4, 15, 43, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 15, 43, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eeb1e1b9-f612-4acd-9439-6285840a52d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:52:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0f5d83e8-fe2c-46b1-8cea-43c3ffb7828b tempest-VolumesImageMetadata-912629914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b81b9ff-225a-4a0b-9296-0d6774d15ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:52:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0f5d83e8-fe2c-46b1-8cea-43c3ffb7828b tempest-VolumesImageMetadata-912629914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b81b9ff-225a-4a0b-9296-0d6774d15ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:52:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0f5d83e8-fe2c-46b1-8cea-43c3ffb7828b tempest-VolumesImageMetadata-912629914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f08ffe1f-9c67-4eb3-a6c3-ec826c183741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:52:09 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-0f5d83e8-fe2c-46b1-8cea-43c3ffb7828b tempest-VolumesImageMetadata-912629914 None] Volume 09b56a25-78eb-4fa1-909f-b61d39d1511b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-09b56a25-78eb-4fa1-909f-b61d39d1511b', 'volume_size': 1, 'image_id': 'eeb1e1b9-f612-4acd-9439-6285840a52d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eeb1e1b9-f612-4acd-9439-6285840a52d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'be7dacacfc0f482c9fff51cfcb1c78e5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eeb1e1b9-f612-4acd-9439-6285840a52d1', 'created_at': datetime.datetime(2026, 9, 4, 15, 43, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 15, 43, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eeb1e1b9-f612-4acd-9439-6285840a52d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 04 17:52:09 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f5d83e8-fe2c-46b1-8cea-43c3ffb7828b tempest-VolumesImageMetadata-912629914 None] Trying to clone 09b56a25-78eb-4fa1-909f-b61d39d1511b from image eeb1e1b9-f612-4acd-9439-6285840a52d1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/eeb1e1b9-f612-4acd-9439-6285840a52d1', 'metadata': {}}]). {{(pid=87314) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 04 17:52:10 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-0f5d83e8-fe2c-46b1-8cea-43c3ffb7828b tempest-VolumesImageMetadata-912629914 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1__m2b0m74devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87314) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 04 17:52:10 devstack cinder-volume[87314]: INFO cinder.image.image_utils [None req-0f5d83e8-fe2c-46b1-8cea-43c3ffb7828b tempest-VolumesImageMetadata-912629914 None] Image download 20.69 MB at 20.69 MB/s Sep 04 17:52:10 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[2550cbb1-76ce-44e3-88d0-5d6577bdace6]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:52:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0f5d83e8-fe2c-46b1-8cea-43c3ffb7828b tempest-VolumesImageMetadata-912629914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1__m2b0m74devstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:10 devstack sudo[91505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1__m2b0m74devstack@QuobyteHD Sep 04 17:52:10 devstack sudo[91505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:10 devstack sudo[91505]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0f5d83e8-fe2c-46b1-8cea-43c3ffb7828b tempest-VolumesImageMetadata-912629914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1__m2b0m74devstack@QuobyteHD" returned: 0 in 0.349s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:52:10 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-0f5d83e8-fe2c-46b1-8cea-43c3ffb7828b tempest-VolumesImageMetadata-912629914 None] Temporary image eeb1e1b9-f612-4acd-9439-6285840a52d1 is fetched for user c5e29994a2654745a04c9d32bcb664f4. {{(pid=87314) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 04 17:52:10 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a169ad7-2dfd-479b-840f-18e3f02cb8f0]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:52:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0f5d83e8-fe2c-46b1-8cea-43c3ffb7828b tempest-VolumesImageMetadata-912629914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1__m2b0m74devstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:10 devstack sudo[91514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1__m2b0m74devstack@QuobyteHD Sep 04 17:52:10 devstack sudo[91514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:11 devstack sudo[91514]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0f5d83e8-fe2c-46b1-8cea-43c3ffb7828b tempest-VolumesImageMetadata-912629914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1__m2b0m74devstack@QuobyteHD" returned: 0 in 0.388s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:52:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0f5d83e8-fe2c-46b1-8cea-43c3ffb7828b tempest-VolumesImageMetadata-912629914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:52:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0f5d83e8-fe2c-46b1-8cea-43c3ffb7828b tempest-VolumesImageMetadata-912629914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:52:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0f5d83e8-fe2c-46b1-8cea-43c3ffb7828b tempest-VolumesImageMetadata-912629914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:52:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1589296880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09b56a25-78eb-4fa1-909f-b61d39d1511b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce5cb742cf6247778d4d11d6297df926',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:52:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:52:09Z,use_quota=True,user_id='c5e29994a2654745a04c9d32bcb664f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:52:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-0f5d83e8-fe2c-46b1-8cea-43c3ffb7828b tempest-VolumesImageMetadata-912629914 None] Creating volume 09b56a25-78eb-4fa1-909f-b61d39d1511b {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:52:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0f5d83e8-fe2c-46b1-8cea-43c3ffb7828b tempest-VolumesImageMetadata-912629914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:52:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0f5d83e8-fe2c-46b1-8cea-43c3ffb7828b tempest-VolumesImageMetadata-912629914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:52:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0f5d83e8-fe2c-46b1-8cea-43c3ffb7828b tempest-VolumesImageMetadata-912629914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:52:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0f5d83e8-fe2c-46b1-8cea-43c3ffb7828b tempest-VolumesImageMetadata-912629914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:52:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0f5d83e8-fe2c-46b1-8cea-43c3ffb7828b tempest-VolumesImageMetadata-912629914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:52:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0f5d83e8-fe2c-46b1-8cea-43c3ffb7828b tempest-VolumesImageMetadata-912629914 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:52:11 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-0f5d83e8-fe2c-46b1-8cea-43c3ffb7828b tempest-VolumesImageMetadata-912629914 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:52:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0f5d83e8-fe2c-46b1-8cea-43c3ffb7828b tempest-VolumesImageMetadata-912629914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-09b56a25-78eb-4fa1-909f-b61d39d1511b 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:11 devstack sudo[91520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-09b56a25-78eb-4fa1-909f-b61d39d1511b 1073741824 Sep 04 17:52:11 devstack sudo[91520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:11 devstack sudo[91520]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0f5d83e8-fe2c-46b1-8cea-43c3ffb7828b tempest-VolumesImageMetadata-912629914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-09b56a25-78eb-4fa1-909f-b61d39d1511b 1073741824" returned: 0 in 0.535s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:52:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0f5d83e8-fe2c-46b1-8cea-43c3ffb7828b tempest-VolumesImageMetadata-912629914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-09b56a25-78eb-4fa1-909f-b61d39d1511b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:11 devstack sudo[91526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-09b56a25-78eb-4fa1-909f-b61d39d1511b Sep 04 17:52:11 devstack sudo[91526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:11 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-739306e1-3480-40e3-bf97-7a4a7a83a280 tempest-ServerActionsTestOtherA-1015930920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:52:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-739306e1-3480-40e3-bf97-7a4a7a83a280 tempest-ServerActionsTestOtherA-1015930920 None] Flow 'volume_create_manager' (67a5e6c6-2ede-430f-aa12-b1010606d20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:52:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-739306e1-3480-40e3-bf97-7a4a7a83a280 tempest-ServerActionsTestOtherA-1015930920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4d39cee-dd41-4287-abad-51f03e8d7bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:52:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-739306e1-3480-40e3-bf97-7a4a7a83a280 tempest-ServerActionsTestOtherA-1015930920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4d39cee-dd41-4287-abad-51f03e8d7bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:52:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-689973054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4140bdd-ea08-49d5-90d4-3f5ee64f5ea4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0498a9fd04d426080085417f1d1ee5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:52:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:52:12Z,use_quota=True,user_id='93b6e3f4bd6b4ee7b9720be68f95a058',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:52:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-739306e1-3480-40e3-bf97-7a4a7a83a280 tempest-ServerActionsTestOtherA-1015930920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a294add0-0638-4b4a-8209-d9cc1ef41d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:52:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-739306e1-3480-40e3-bf97-7a4a7a83a280 tempest-ServerActionsTestOtherA-1015930920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a294add0-0638-4b4a-8209-d9cc1ef41d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:52:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-739306e1-3480-40e3-bf97-7a4a7a83a280 tempest-ServerActionsTestOtherA-1015930920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af1fe8ee-56d5-49e6-a51b-c40a0fcf819e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:52:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-739306e1-3480-40e3-bf97-7a4a7a83a280 tempest-ServerActionsTestOtherA-1015930920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af1fe8ee-56d5-49e6-a51b-c40a0fcf819e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4140bdd-ea08-49d5-90d4-3f5ee64f5ea4', 'volume_name': 'volume-c4140bdd-ea08-49d5-90d4-3f5ee64f5ea4', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:52:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-739306e1-3480-40e3-bf97-7a4a7a83a280 tempest-ServerActionsTestOtherA-1015930920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4dec6db-05ad-440b-a056-a54ad315e61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:52:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-739306e1-3480-40e3-bf97-7a4a7a83a280 tempest-ServerActionsTestOtherA-1015930920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4dec6db-05ad-440b-a056-a54ad315e61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:52:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-739306e1-3480-40e3-bf97-7a4a7a83a280 tempest-ServerActionsTestOtherA-1015930920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60773d99-8226-44fe-b802-c17d9ca04a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:52:12 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-739306e1-3480-40e3-bf97-7a4a7a83a280 tempest-ServerActionsTestOtherA-1015930920 None] Volume c4140bdd-ea08-49d5-90d4-3f5ee64f5ea4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4140bdd-ea08-49d5-90d4-3f5ee64f5ea4', 'volume_size': 1} Sep 04 17:52:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-739306e1-3480-40e3-bf97-7a4a7a83a280 tempest-ServerActionsTestOtherA-1015930920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:52:12 devstack sudo[91526]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0f5d83e8-fe2c-46b1-8cea-43c3ffb7828b tempest-VolumesImageMetadata-912629914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-09b56a25-78eb-4fa1-909f-b61d39d1511b" returned: 0 in 0.410s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:52:12 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0f5d83e8-fe2c-46b1-8cea-43c3ffb7828b tempest-VolumesImageMetadata-912629914 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:52:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0f5d83e8-fe2c-46b1-8cea-43c3ffb7828b tempest-VolumesImageMetadata-912629914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:52:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-739306e1-3480-40e3-bf97-7a4a7a83a280 tempest-ServerActionsTestOtherA-1015930920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.027s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:52:12 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-739306e1-3480-40e3-bf97-7a4a7a83a280 tempest-ServerActionsTestOtherA-1015930920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:52:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-689973054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4140bdd-ea08-49d5-90d4-3f5ee64f5ea4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0498a9fd04d426080085417f1d1ee5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:52:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:52:12Z,use_quota=True,user_id='93b6e3f4bd6b4ee7b9720be68f95a058',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:52:12 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-739306e1-3480-40e3-bf97-7a4a7a83a280 tempest-ServerActionsTestOtherA-1015930920 None] Creating volume c4140bdd-ea08-49d5-90d4-3f5ee64f5ea4 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:52:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-739306e1-3480-40e3-bf97-7a4a7a83a280 tempest-ServerActionsTestOtherA-1015930920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:52:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-739306e1-3480-40e3-bf97-7a4a7a83a280 tempest-ServerActionsTestOtherA-1015930920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:52:12 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-739306e1-3480-40e3-bf97-7a4a7a83a280 tempest-ServerActionsTestOtherA-1015930920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:52:12 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-739306e1-3480-40e3-bf97-7a4a7a83a280 tempest-ServerActionsTestOtherA-1015930920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:52:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-739306e1-3480-40e3-bf97-7a4a7a83a280 tempest-ServerActionsTestOtherA-1015930920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:52:12 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-739306e1-3480-40e3-bf97-7a4a7a83a280 tempest-ServerActionsTestOtherA-1015930920 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:52:12 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-739306e1-3480-40e3-bf97-7a4a7a83a280 tempest-ServerActionsTestOtherA-1015930920 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:52:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-739306e1-3480-40e3-bf97-7a4a7a83a280 tempest-ServerActionsTestOtherA-1015930920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c4140bdd-ea08-49d5-90d4-3f5ee64f5ea4 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:12 devstack sudo[91530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c4140bdd-ea08-49d5-90d4-3f5ee64f5ea4 1073741824 Sep 04 17:52:12 devstack sudo[91530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:12 devstack cinder-volume[87314]: DEBUG cinder.volume.volume_utils [None req-0f5d83e8-fe2c-46b1-8cea-43c3ffb7828b tempest-VolumesImageMetadata-912629914 None] Attempting download of eeb1e1b9-f612-4acd-9439-6285840a52d1 ((None, [{'url': 'file:///opt/stack/data/glance/images/eeb1e1b9-f612-4acd-9439-6285840a52d1', 'metadata': {}}])) to volume 09b56a25-78eb-4fa1-909f-b61d39d1511b. {{(pid=87314) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 04 17:52:12 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf784aaa-fe6d-4933-bbdb-5b381b6d8ffa]: (4, 'raw') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:52:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0f5d83e8-fe2c-46b1-8cea-43c3ffb7828b tempest-VolumesImageMetadata-912629914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eeb1e1b9-f612-4acd-9439-6285840a52d1_p5v3i1g1 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:12 devstack sudo[91533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eeb1e1b9-f612-4acd-9439-6285840a52d1_p5v3i1g1 Sep 04 17:52:12 devstack sudo[91533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:12 devstack sudo[91533]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0f5d83e8-fe2c-46b1-8cea-43c3ffb7828b tempest-VolumesImageMetadata-912629914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eeb1e1b9-f612-4acd-9439-6285840a52d1_p5v3i1g1" returned: 0 in 0.444s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:52:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0f5d83e8-fe2c-46b1-8cea-43c3ffb7828b tempest-VolumesImageMetadata-912629914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eeb1e1b9-f612-4acd-9439-6285840a52d1_p5v3i1g1 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:12 devstack sudo[91530]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-739306e1-3480-40e3-bf97-7a4a7a83a280 tempest-ServerActionsTestOtherA-1015930920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c4140bdd-ea08-49d5-90d4-3f5ee64f5ea4 1073741824" returned: 0 in 0.875s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:52:13 devstack sudo[91543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eeb1e1b9-f612-4acd-9439-6285840a52d1_p5v3i1g1 Sep 04 17:52:13 devstack sudo[91543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-739306e1-3480-40e3-bf97-7a4a7a83a280 tempest-ServerActionsTestOtherA-1015930920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c4140bdd-ea08-49d5-90d4-3f5ee64f5ea4 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:13 devstack sudo[91546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c4140bdd-ea08-49d5-90d4-3f5ee64f5ea4 Sep 04 17:52:13 devstack sudo[91546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:13 devstack sudo[91543]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0f5d83e8-fe2c-46b1-8cea-43c3ffb7828b tempest-VolumesImageMetadata-912629914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eeb1e1b9-f612-4acd-9439-6285840a52d1_p5v3i1g1" returned: 1 in 0.695s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:52:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0f5d83e8-fe2c-46b1-8cea-43c3ffb7828b tempest-VolumesImageMetadata-912629914 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eeb1e1b9-f612-4acd-9439-6285840a52d1_p5v3i1g1' failed. Not Retrying. {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 17:52:13 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c3f7f2-11ad-4218-bb0f-a538a6237d4a]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:52:13 devstack sudo[91546]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0f5d83e8-fe2c-46b1-8cea-43c3ffb7828b tempest-VolumesImageMetadata-912629914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1__m2b0m74devstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-739306e1-3480-40e3-bf97-7a4a7a83a280 tempest-ServerActionsTestOtherA-1015930920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c4140bdd-ea08-49d5-90d4-3f5ee64f5ea4" returned: 0 in 0.459s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:52:13 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-739306e1-3480-40e3-bf97-7a4a7a83a280 tempest-ServerActionsTestOtherA-1015930920 None] <== create_volume: return (1430ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:52:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-739306e1-3480-40e3-bf97-7a4a7a83a280 tempest-ServerActionsTestOtherA-1015930920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.433s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:52:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-739306e1-3480-40e3-bf97-7a4a7a83a280 tempest-ServerActionsTestOtherA-1015930920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60773d99-8226-44fe-b802-c17d9ca04a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4140bdd-ea08-49d5-90d4-3f5ee64f5ea4', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:52:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-739306e1-3480-40e3-bf97-7a4a7a83a280 tempest-ServerActionsTestOtherA-1015930920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf038b19-06a6-442e-89c2-c50676e572dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:52:13 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-739306e1-3480-40e3-bf97-7a4a7a83a280 tempest-ServerActionsTestOtherA-1015930920 None] Volume volume-c4140bdd-ea08-49d5-90d4-3f5ee64f5ea4 (c4140bdd-ea08-49d5-90d4-3f5ee64f5ea4): created successfully Sep 04 17:52:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-739306e1-3480-40e3-bf97-7a4a7a83a280 tempest-ServerActionsTestOtherA-1015930920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf038b19-06a6-442e-89c2-c50676e572dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:52:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-739306e1-3480-40e3-bf97-7a4a7a83a280 tempest-ServerActionsTestOtherA-1015930920 None] Flow 'volume_create_manager' (67a5e6c6-2ede-430f-aa12-b1010606d20c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:52:13 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-739306e1-3480-40e3-bf97-7a4a7a83a280 tempest-ServerActionsTestOtherA-1015930920 None] Created volume successfully. Sep 04 17:52:13 devstack sudo[91551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1__m2b0m74devstack@QuobyteHD Sep 04 17:52:13 devstack sudo[91551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:13 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc86a5fe-ee08-40fb-99d0-d15e95d9effe tempest-AttachVolumeTestJSON-183267417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:52:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-cc86a5fe-ee08-40fb-99d0-d15e95d9effe tempest-AttachVolumeTestJSON-183267417 None] Flow 'volume_create_manager' (8a22fc29-806c-4845-b18a-63e4d92e8693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:52:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-cc86a5fe-ee08-40fb-99d0-d15e95d9effe tempest-AttachVolumeTestJSON-183267417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9eb3185-e116-4ce2-96aa-39b1ce41f879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:52:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-cc86a5fe-ee08-40fb-99d0-d15e95d9effe tempest-AttachVolumeTestJSON-183267417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9eb3185-e116-4ce2-96aa-39b1ce41f879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:52:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1254822644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03b001c3-5cb5-44d6-a0ab-4628ef7ea3d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fdd366b1d374ba395bb930ab91f2fb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:52:14Z,use_quota=True,user_id='6e07b49cd1774bfe8ae5cfd1e08ea7e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:52:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-cc86a5fe-ee08-40fb-99d0-d15e95d9effe tempest-AttachVolumeTestJSON-183267417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9288f01-d2ee-48d2-aa62-942ee8821f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:52:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-cc86a5fe-ee08-40fb-99d0-d15e95d9effe tempest-AttachVolumeTestJSON-183267417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9288f01-d2ee-48d2-aa62-942ee8821f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:52:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-cc86a5fe-ee08-40fb-99d0-d15e95d9effe tempest-AttachVolumeTestJSON-183267417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c3979a8-a70b-421e-a6b7-297ae165541a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:52:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-cc86a5fe-ee08-40fb-99d0-d15e95d9effe tempest-AttachVolumeTestJSON-183267417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c3979a8-a70b-421e-a6b7-297ae165541a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03b001c3-5cb5-44d6-a0ab-4628ef7ea3d9', 'volume_name': 'volume-03b001c3-5cb5-44d6-a0ab-4628ef7ea3d9', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:52:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-cc86a5fe-ee08-40fb-99d0-d15e95d9effe tempest-AttachVolumeTestJSON-183267417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfb15ccb-93b1-4caf-a962-f9e4a5b893cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:52:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-cc86a5fe-ee08-40fb-99d0-d15e95d9effe tempest-AttachVolumeTestJSON-183267417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfb15ccb-93b1-4caf-a962-f9e4a5b893cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:52:13 devstack sudo[91551]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-cc86a5fe-ee08-40fb-99d0-d15e95d9effe tempest-AttachVolumeTestJSON-183267417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d34da3e-51d7-4558-b601-2e431fc3a004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:52:13 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-cc86a5fe-ee08-40fb-99d0-d15e95d9effe tempest-AttachVolumeTestJSON-183267417 None] Volume 03b001c3-5cb5-44d6-a0ab-4628ef7ea3d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03b001c3-5cb5-44d6-a0ab-4628ef7ea3d9', 'volume_size': 1} Sep 04 17:52:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-cc86a5fe-ee08-40fb-99d0-d15e95d9effe tempest-AttachVolumeTestJSON-183267417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:52:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-cc86a5fe-ee08-40fb-99d0-d15e95d9effe tempest-AttachVolumeTestJSON-183267417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:52:13 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-cc86a5fe-ee08-40fb-99d0-d15e95d9effe tempest-AttachVolumeTestJSON-183267417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:52:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1254822644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03b001c3-5cb5-44d6-a0ab-4628ef7ea3d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fdd366b1d374ba395bb930ab91f2fb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:52:14Z,use_quota=True,user_id='6e07b49cd1774bfe8ae5cfd1e08ea7e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:52:13 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-cc86a5fe-ee08-40fb-99d0-d15e95d9effe tempest-AttachVolumeTestJSON-183267417 None] Creating volume 03b001c3-5cb5-44d6-a0ab-4628ef7ea3d9 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:52:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-cc86a5fe-ee08-40fb-99d0-d15e95d9effe tempest-AttachVolumeTestJSON-183267417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:52:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-cc86a5fe-ee08-40fb-99d0-d15e95d9effe tempest-AttachVolumeTestJSON-183267417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:52:13 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-cc86a5fe-ee08-40fb-99d0-d15e95d9effe tempest-AttachVolumeTestJSON-183267417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:52:13 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-cc86a5fe-ee08-40fb-99d0-d15e95d9effe tempest-AttachVolumeTestJSON-183267417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:52:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-cc86a5fe-ee08-40fb-99d0-d15e95d9effe tempest-AttachVolumeTestJSON-183267417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:52:13 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-cc86a5fe-ee08-40fb-99d0-d15e95d9effe tempest-AttachVolumeTestJSON-183267417 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:52:13 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-cc86a5fe-ee08-40fb-99d0-d15e95d9effe tempest-AttachVolumeTestJSON-183267417 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:52:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cc86a5fe-ee08-40fb-99d0-d15e95d9effe tempest-AttachVolumeTestJSON-183267417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-03b001c3-5cb5-44d6-a0ab-4628ef7ea3d9 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0f5d83e8-fe2c-46b1-8cea-43c3ffb7828b tempest-VolumesImageMetadata-912629914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1__m2b0m74devstack@QuobyteHD" returned: 0 in 0.438s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:52:13 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-0f5d83e8-fe2c-46b1-8cea-43c3ffb7828b tempest-VolumesImageMetadata-912629914 None] eeb1e1b9-f612-4acd-9439-6285840a52d1 was qcow2, converting to qcow2 {{(pid=87314) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 04 17:52:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0f5d83e8-fe2c-46b1-8cea-43c3ffb7828b tempest-VolumesImageMetadata-912629914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1__m2b0m74devstack@QuobyteHD /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-09b56a25-78eb-4fa1-909f-b61d39d1511b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:13 devstack sudo[91556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-03b001c3-5cb5-44d6-a0ab-4628ef7ea3d9 1073741824 Sep 04 17:52:13 devstack sudo[91556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:13 devstack sudo[91557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1__m2b0m74devstack@QuobyteHD /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-09b56a25-78eb-4fa1-909f-b61d39d1511b Sep 04 17:52:13 devstack sudo[91557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:14 devstack sudo[91556]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cc86a5fe-ee08-40fb-99d0-d15e95d9effe tempest-AttachVolumeTestJSON-183267417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-03b001c3-5cb5-44d6-a0ab-4628ef7ea3d9 1073741824" returned: 0 in 0.564s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:52:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cc86a5fe-ee08-40fb-99d0-d15e95d9effe tempest-AttachVolumeTestJSON-183267417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-03b001c3-5cb5-44d6-a0ab-4628ef7ea3d9 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:14 devstack sudo[91571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-03b001c3-5cb5-44d6-a0ab-4628ef7ea3d9 Sep 04 17:52:14 devstack sudo[91571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:14 devstack sudo[91571]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cc86a5fe-ee08-40fb-99d0-d15e95d9effe tempest-AttachVolumeTestJSON-183267417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-03b001c3-5cb5-44d6-a0ab-4628ef7ea3d9" returned: 0 in 0.409s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:52:14 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-cc86a5fe-ee08-40fb-99d0-d15e95d9effe tempest-AttachVolumeTestJSON-183267417 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:52:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-cc86a5fe-ee08-40fb-99d0-d15e95d9effe tempest-AttachVolumeTestJSON-183267417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:52:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-cc86a5fe-ee08-40fb-99d0-d15e95d9effe tempest-AttachVolumeTestJSON-183267417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d34da3e-51d7-4558-b601-2e431fc3a004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03b001c3-5cb5-44d6-a0ab-4628ef7ea3d9', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:52:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-cc86a5fe-ee08-40fb-99d0-d15e95d9effe tempest-AttachVolumeTestJSON-183267417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a17d9c57-64fe-4161-9af5-38a87e2ebfb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:52:15 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-cc86a5fe-ee08-40fb-99d0-d15e95d9effe tempest-AttachVolumeTestJSON-183267417 None] Volume volume-03b001c3-5cb5-44d6-a0ab-4628ef7ea3d9 (03b001c3-5cb5-44d6-a0ab-4628ef7ea3d9): created successfully Sep 04 17:52:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-cc86a5fe-ee08-40fb-99d0-d15e95d9effe tempest-AttachVolumeTestJSON-183267417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a17d9c57-64fe-4161-9af5-38a87e2ebfb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:52:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-cc86a5fe-ee08-40fb-99d0-d15e95d9effe tempest-AttachVolumeTestJSON-183267417 None] Flow 'volume_create_manager' (8a22fc29-806c-4845-b18a-63e4d92e8693) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:52:15 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-cc86a5fe-ee08-40fb-99d0-d15e95d9effe tempest-AttachVolumeTestJSON-183267417 None] Created volume successfully. Sep 04 17:52:16 devstack sudo[91557]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0f5d83e8-fe2c-46b1-8cea-43c3ffb7828b tempest-VolumesImageMetadata-912629914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1__m2b0m74devstack@QuobyteHD /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-09b56a25-78eb-4fa1-909f-b61d39d1511b" returned: 0 in 2.055s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:52:16 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-0f5d83e8-fe2c-46b1-8cea-43c3ffb7828b tempest-VolumesImageMetadata-912629914 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1__m2b0m74devstack@QuobyteHD, size 112.00 MB, duration 2.06 sec, destination /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-09b56a25-78eb-4fa1-909f-b61d39d1511b {{(pid=87314) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 17:52:16 devstack cinder-volume[87314]: INFO cinder.image.image_utils [None req-0f5d83e8-fe2c-46b1-8cea-43c3ffb7828b tempest-VolumesImageMetadata-912629914 None] Converted 112.00 MB image at 54.48 MB/s Sep 04 17:52:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0f5d83e8-fe2c-46b1-8cea-43c3ffb7828b tempest-VolumesImageMetadata-912629914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-09b56a25-78eb-4fa1-909f-b61d39d1511b 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:16 devstack sudo[91582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-09b56a25-78eb-4fa1-909f-b61d39d1511b 1G Sep 04 17:52:16 devstack sudo[91582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:16 devstack sudo[91582]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0f5d83e8-fe2c-46b1-8cea-43c3ffb7828b tempest-VolumesImageMetadata-912629914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-09b56a25-78eb-4fa1-909f-b61d39d1511b 1G" returned: 0 in 0.449s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:52:16 devstack cinder-volume[87314]: DEBUG cinder.volume.volume_utils [None req-0f5d83e8-fe2c-46b1-8cea-43c3ffb7828b tempest-VolumesImageMetadata-912629914 None] Downloaded image eeb1e1b9-f612-4acd-9439-6285840a52d1 ((None, [{'url': 'file:///opt/stack/data/glance/images/eeb1e1b9-f612-4acd-9439-6285840a52d1', 'metadata': {}}])) to volume 09b56a25-78eb-4fa1-909f-b61d39d1511b successfully. {{(pid=87314) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 04 17:52:16 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-0f5d83e8-fe2c-46b1-8cea-43c3ffb7828b tempest-VolumesImageMetadata-912629914 None] Temporary image eeb1e1b9-f612-4acd-9439-6285840a52d1 for user c5e29994a2654745a04c9d32bcb664f4 is deleted. {{(pid=87314) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 04 17:52:16 devstack cinder-volume[87314]: DEBUG cinder.volume.volume_utils [None req-0f5d83e8-fe2c-46b1-8cea-43c3ffb7828b tempest-VolumesImageMetadata-912629914 None] Marking volume 09b56a25-78eb-4fa1-909f-b61d39d1511b as bootable. {{(pid=87314) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 04 17:52:16 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f5d83e8-fe2c-46b1-8cea-43c3ffb7828b tempest-VolumesImageMetadata-912629914 None] Copying metadata from image eeb1e1b9-f612-4acd-9439-6285840a52d1 to 09b56a25-78eb-4fa1-909f-b61d39d1511b. {{(pid=87314) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 04 17:52:16 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f5d83e8-fe2c-46b1-8cea-43c3ffb7828b tempest-VolumesImageMetadata-912629914 None] Creating volume glance metadata for volume 09b56a25-78eb-4fa1-909f-b61d39d1511b backed by image eeb1e1b9-f612-4acd-9439-6285840a52d1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'eeb1e1b9-f612-4acd-9439-6285840a52d1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87314) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 04 17:52:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0f5d83e8-fe2c-46b1-8cea-43c3ffb7828b tempest-VolumesImageMetadata-912629914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f08ffe1f-9c67-4eb3-a6c3-ec826c183741) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09b56a25-78eb-4fa1-909f-b61d39d1511b', 'volume_size': 1, 'image_id': 'eeb1e1b9-f612-4acd-9439-6285840a52d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eeb1e1b9-f612-4acd-9439-6285840a52d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'be7dacacfc0f482c9fff51cfcb1c78e5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eeb1e1b9-f612-4acd-9439-6285840a52d1', 'created_at': datetime.datetime(2026, 9, 4, 15, 43, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 15, 43, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eeb1e1b9-f612-4acd-9439-6285840a52d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:52:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0f5d83e8-fe2c-46b1-8cea-43c3ffb7828b tempest-VolumesImageMetadata-912629914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18e44585-50f0-400b-84d2-13d3ab8b6204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:52:16 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-0f5d83e8-fe2c-46b1-8cea-43c3ffb7828b tempest-VolumesImageMetadata-912629914 None] Volume volume-09b56a25-78eb-4fa1-909f-b61d39d1511b (09b56a25-78eb-4fa1-909f-b61d39d1511b): created successfully Sep 04 17:52:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0f5d83e8-fe2c-46b1-8cea-43c3ffb7828b tempest-VolumesImageMetadata-912629914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18e44585-50f0-400b-84d2-13d3ab8b6204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:52:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0f5d83e8-fe2c-46b1-8cea-43c3ffb7828b tempest-VolumesImageMetadata-912629914 None] Flow 'volume_create_manager' (b12cc7de-266b-4231-b870-1378d8af5f9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:52:16 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-0f5d83e8-fe2c-46b1-8cea-43c3ffb7828b tempest-VolumesImageMetadata-912629914 None] Created volume successfully. Sep 04 17:52:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-bd0e2225-9f0c-4853-8950-dd856b78805b req-77c9572c-755b-4d5c-921f-a3f29ba65d33 tempest-AttachVolumeTestJSON-183267417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:52:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-bd0e2225-9f0c-4853-8950-dd856b78805b req-77c9572c-755b-4d5c-921f-a3f29ba65d33 tempest-AttachVolumeTestJSON-183267417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:52:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-bd0e2225-9f0c-4853-8950-dd856b78805b req-77c9572c-755b-4d5c-921f-a3f29ba65d33 tempest-AttachVolumeTestJSON-183267417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:52:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-bd0e2225-9f0c-4853-8950-dd856b78805b req-77c9572c-755b-4d5c-921f-a3f29ba65d33 tempest-AttachVolumeTestJSON-183267417 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a', 'name': 'volume-03b001c3-5cb5-44d6-a0ab-4628ef7ea3d9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'db8997ef-a5dc-446f-8749-9ee288d1aa03', 'enforce_multipath': True} {{(pid=87314) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 17:52:17 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-bd0e2225-9f0c-4853-8950-dd856b78805b req-77c9572c-755b-4d5c-921f-a3f29ba65d33 tempest-AttachVolumeTestJSON-183267417 None] attachment_update completed successfully. Sep 04 17:52:18 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fb21e5d6-40e1-4c65-a7b2-d0a64847bbb9 tempest-VolumesImageMetadata-912629914 None] Acquiring lock "cinder-09b56a25-78eb-4fa1-909f-b61d39d1511b-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:52:18 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fb21e5d6-40e1-4c65-a7b2-d0a64847bbb9 tempest-VolumesImageMetadata-912629914 None] Lock "cinder-09b56a25-78eb-4fa1-909f-b61d39d1511b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:52:18 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fb21e5d6-40e1-4c65-a7b2-d0a64847bbb9 tempest-VolumesImageMetadata-912629914 None] Acquiring lock "cinder-quobyte-09b56a25-78eb-4fa1-909f-b61d39d1511b" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:52:18 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fb21e5d6-40e1-4c65-a7b2-d0a64847bbb9 tempest-VolumesImageMetadata-912629914 None] Lock "cinder-quobyte-09b56a25-78eb-4fa1-909f-b61d39d1511b" acquired by "delete_volume" :: waited 0.027s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:52:18 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[7428febb-f4a0-462a-b243-a5f6954773d5]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:52:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fb21e5d6-40e1-4c65-a7b2-d0a64847bbb9 tempest-VolumesImageMetadata-912629914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-09b56a25-78eb-4fa1-909f-b61d39d1511b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:18 devstack sudo[91997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-09b56a25-78eb-4fa1-909f-b61d39d1511b Sep 04 17:52:18 devstack sudo[91997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:19 devstack sudo[91997]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fb21e5d6-40e1-4c65-a7b2-d0a64847bbb9 tempest-VolumesImageMetadata-912629914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-09b56a25-78eb-4fa1-909f-b61d39d1511b" returned: 0 in 0.451s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:52:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fb21e5d6-40e1-4c65-a7b2-d0a64847bbb9 tempest-VolumesImageMetadata-912629914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-09b56a25-78eb-4fa1-909f-b61d39d1511b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:19 devstack sudo[92003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-09b56a25-78eb-4fa1-909f-b61d39d1511b Sep 04 17:52:19 devstack sudo[92003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:19 devstack sudo[92003]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fb21e5d6-40e1-4c65-a7b2-d0a64847bbb9 tempest-VolumesImageMetadata-912629914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-09b56a25-78eb-4fa1-909f-b61d39d1511b" returned: 0 in 0.349s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:52:19 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fb21e5d6-40e1-4c65-a7b2-d0a64847bbb9 tempest-VolumesImageMetadata-912629914 None] Lock "cinder-quobyte-09b56a25-78eb-4fa1-909f-b61d39d1511b" released by "delete_volume" :: held 0.872s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:52:19 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-df5eb8da-fb24-4e2a-a219-b786d07095b4 tempest-AttachVolumeTestJSON-183267417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:52:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-df5eb8da-fb24-4e2a-a219-b786d07095b4 tempest-AttachVolumeTestJSON-183267417 None] Flow 'volume_create_manager' (e794d7c4-d489-47ef-bdb0-e87d8ffb6beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:52:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-df5eb8da-fb24-4e2a-a219-b786d07095b4 tempest-AttachVolumeTestJSON-183267417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1265c10-1fb2-453c-b8ad-944b7402ca3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:52:19 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-fb21e5d6-40e1-4c65-a7b2-d0a64847bbb9 tempest-VolumesImageMetadata-912629914 None] Created reservations ['ac5342d7-8d33-41f1-bbc8-0f4ee15c4f21', '850a7ddd-dcd8-4f0b-a407-dc60fa486b51', '78893b76-caee-4c5c-9dd0-45a6d132d94d', '688507fa-ebbb-4457-a732-0cd84631f122'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:52:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-df5eb8da-fb24-4e2a-a219-b786d07095b4 tempest-AttachVolumeTestJSON-183267417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1265c10-1fb2-453c-b8ad-944b7402ca3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:52:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-445867166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54d6e962-aa53-482c-a8f0-194545ebf008,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fdd366b1d374ba395bb930ab91f2fb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:52:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:52:20Z,use_quota=True,user_id='6e07b49cd1774bfe8ae5cfd1e08ea7e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:52:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-df5eb8da-fb24-4e2a-a219-b786d07095b4 tempest-AttachVolumeTestJSON-183267417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d58f2af1-7aa5-4df4-a18b-cb3429016c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:52:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-df5eb8da-fb24-4e2a-a219-b786d07095b4 tempest-AttachVolumeTestJSON-183267417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d58f2af1-7aa5-4df4-a18b-cb3429016c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:52:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-df5eb8da-fb24-4e2a-a219-b786d07095b4 tempest-AttachVolumeTestJSON-183267417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed6ad4a5-5f45-49f8-b899-46049d343899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:52:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-df5eb8da-fb24-4e2a-a219-b786d07095b4 tempest-AttachVolumeTestJSON-183267417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed6ad4a5-5f45-49f8-b899-46049d343899) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54d6e962-aa53-482c-a8f0-194545ebf008', 'volume_name': 'volume-54d6e962-aa53-482c-a8f0-194545ebf008', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:52:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-df5eb8da-fb24-4e2a-a219-b786d07095b4 tempest-AttachVolumeTestJSON-183267417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef1daa35-5e9a-4516-97e2-274d178c700b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:52:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-df5eb8da-fb24-4e2a-a219-b786d07095b4 tempest-AttachVolumeTestJSON-183267417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef1daa35-5e9a-4516-97e2-274d178c700b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:52:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-df5eb8da-fb24-4e2a-a219-b786d07095b4 tempest-AttachVolumeTestJSON-183267417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc202448-d3c1-477a-ad7f-64d2304b8755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:52:19 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-df5eb8da-fb24-4e2a-a219-b786d07095b4 tempest-AttachVolumeTestJSON-183267417 None] Volume 54d6e962-aa53-482c-a8f0-194545ebf008: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54d6e962-aa53-482c-a8f0-194545ebf008', 'volume_size': 1} Sep 04 17:52:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-df5eb8da-fb24-4e2a-a219-b786d07095b4 tempest-AttachVolumeTestJSON-183267417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:52:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-df5eb8da-fb24-4e2a-a219-b786d07095b4 tempest-AttachVolumeTestJSON-183267417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:52:19 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-df5eb8da-fb24-4e2a-a219-b786d07095b4 tempest-AttachVolumeTestJSON-183267417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:52:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-445867166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54d6e962-aa53-482c-a8f0-194545ebf008,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fdd366b1d374ba395bb930ab91f2fb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:52:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:52:20Z,use_quota=True,user_id='6e07b49cd1774bfe8ae5cfd1e08ea7e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:52:19 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-df5eb8da-fb24-4e2a-a219-b786d07095b4 tempest-AttachVolumeTestJSON-183267417 None] Creating volume 54d6e962-aa53-482c-a8f0-194545ebf008 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:52:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-df5eb8da-fb24-4e2a-a219-b786d07095b4 tempest-AttachVolumeTestJSON-183267417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:52:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-df5eb8da-fb24-4e2a-a219-b786d07095b4 tempest-AttachVolumeTestJSON-183267417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:52:19 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-df5eb8da-fb24-4e2a-a219-b786d07095b4 tempest-AttachVolumeTestJSON-183267417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:52:19 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-df5eb8da-fb24-4e2a-a219-b786d07095b4 tempest-AttachVolumeTestJSON-183267417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:52:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-df5eb8da-fb24-4e2a-a219-b786d07095b4 tempest-AttachVolumeTestJSON-183267417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:52:19 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-df5eb8da-fb24-4e2a-a219-b786d07095b4 tempest-AttachVolumeTestJSON-183267417 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:52:19 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-df5eb8da-fb24-4e2a-a219-b786d07095b4 tempest-AttachVolumeTestJSON-183267417 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:52:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-df5eb8da-fb24-4e2a-a219-b786d07095b4 tempest-AttachVolumeTestJSON-183267417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-54d6e962-aa53-482c-a8f0-194545ebf008 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:19 devstack sudo[92007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-54d6e962-aa53-482c-a8f0-194545ebf008 1073741824 Sep 04 17:52:19 devstack sudo[92007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fb21e5d6-40e1-4c65-a7b2-d0a64847bbb9 tempest-VolumesImageMetadata-912629914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:52:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fb21e5d6-40e1-4c65-a7b2-d0a64847bbb9 tempest-VolumesImageMetadata-912629914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:52:19 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-fb21e5d6-40e1-4c65-a7b2-d0a64847bbb9 tempest-VolumesImageMetadata-912629914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:52:19 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-fb21e5d6-40e1-4c65-a7b2-d0a64847bbb9 tempest-VolumesImageMetadata-912629914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:52:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fb21e5d6-40e1-4c65-a7b2-d0a64847bbb9 tempest-VolumesImageMetadata-912629914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:52:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fb21e5d6-40e1-4c65-a7b2-d0a64847bbb9 tempest-VolumesImageMetadata-912629914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:20 devstack sudo[92010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:52:20 devstack sudo[92010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:20 devstack sudo[92010]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fb21e5d6-40e1-4c65-a7b2-d0a64847bbb9 tempest-VolumesImageMetadata-912629914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.343s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:52:20 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-fb21e5d6-40e1-4c65-a7b2-d0a64847bbb9 tempest-VolumesImageMetadata-912629914 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:52:20 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-fb21e5d6-40e1-4c65-a7b2-d0a64847bbb9 tempest-VolumesImageMetadata-912629914 None] Deleted volume successfully. Sep 04 17:52:20 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fb21e5d6-40e1-4c65-a7b2-d0a64847bbb9 tempest-VolumesImageMetadata-912629914 None] Lock "cinder-09b56a25-78eb-4fa1-909f-b61d39d1511b-delete_volume" released by "delete_volume" :: held 1.740s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:52:20 devstack sudo[92007]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-df5eb8da-fb24-4e2a-a219-b786d07095b4 tempest-AttachVolumeTestJSON-183267417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-54d6e962-aa53-482c-a8f0-194545ebf008 1073741824" returned: 0 in 0.612s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:52:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-df5eb8da-fb24-4e2a-a219-b786d07095b4 tempest-AttachVolumeTestJSON-183267417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-54d6e962-aa53-482c-a8f0-194545ebf008 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:20 devstack sudo[92018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-54d6e962-aa53-482c-a8f0-194545ebf008 Sep 04 17:52:20 devstack sudo[92018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:20 devstack sudo[92018]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-df5eb8da-fb24-4e2a-a219-b786d07095b4 tempest-AttachVolumeTestJSON-183267417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-54d6e962-aa53-482c-a8f0-194545ebf008" returned: 0 in 0.487s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:52:20 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-df5eb8da-fb24-4e2a-a219-b786d07095b4 tempest-AttachVolumeTestJSON-183267417 None] <== create_volume: return (1157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:52:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-df5eb8da-fb24-4e2a-a219-b786d07095b4 tempest-AttachVolumeTestJSON-183267417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.161s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:52:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-df5eb8da-fb24-4e2a-a219-b786d07095b4 tempest-AttachVolumeTestJSON-183267417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc202448-d3c1-477a-ad7f-64d2304b8755) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54d6e962-aa53-482c-a8f0-194545ebf008', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:52:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-df5eb8da-fb24-4e2a-a219-b786d07095b4 tempest-AttachVolumeTestJSON-183267417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cd2058d-e597-4940-ad89-ee2feaef16a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:52:21 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-df5eb8da-fb24-4e2a-a219-b786d07095b4 tempest-AttachVolumeTestJSON-183267417 None] Volume volume-54d6e962-aa53-482c-a8f0-194545ebf008 (54d6e962-aa53-482c-a8f0-194545ebf008): created successfully Sep 04 17:52:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-df5eb8da-fb24-4e2a-a219-b786d07095b4 tempest-AttachVolumeTestJSON-183267417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cd2058d-e597-4940-ad89-ee2feaef16a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:52:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-df5eb8da-fb24-4e2a-a219-b786d07095b4 tempest-AttachVolumeTestJSON-183267417 None] Flow 'volume_create_manager' (e794d7c4-d489-47ef-bdb0-e87d8ffb6beb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:52:21 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-df5eb8da-fb24-4e2a-a219-b786d07095b4 tempest-AttachVolumeTestJSON-183267417 None] Created volume successfully. Sep 04 17:52:21 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 17:52:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:52:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:52:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:52:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:52:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:52:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:21 devstack sudo[92060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:52:21 devstack sudo[92060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:21 devstack sudo[92060]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.357s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:52:21 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:52:21 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running periodic task VolumeManager._thread_info {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 17:52:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] thread count: 28 {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 17:52:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] thread info: [<_MainThread(MainThread, started 139900377723008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 17:52:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-c4ca5ba9-506e-4c88-b5f5-7f1e8215d87f req-e7f1b672-abea-4cec-b113-61dc2ef78955 tempest-AttachVolumeTestJSON-183267417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:52:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-c4ca5ba9-506e-4c88-b5f5-7f1e8215d87f req-e7f1b672-abea-4cec-b113-61dc2ef78955 tempest-AttachVolumeTestJSON-183267417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:52:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-c4ca5ba9-506e-4c88-b5f5-7f1e8215d87f req-e7f1b672-abea-4cec-b113-61dc2ef78955 tempest-AttachVolumeTestJSON-183267417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:52:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-c4ca5ba9-506e-4c88-b5f5-7f1e8215d87f req-e7f1b672-abea-4cec-b113-61dc2ef78955 tempest-AttachVolumeTestJSON-183267417 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a', 'name': 'volume-54d6e962-aa53-482c-a8f0-194545ebf008', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '005b4c91-f518-4b4c-bd85-b2208b147029', 'enforce_multipath': True} {{(pid=87314) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 17:52:23 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-c4ca5ba9-506e-4c88-b5f5-7f1e8215d87f req-e7f1b672-abea-4cec-b113-61dc2ef78955 tempest-AttachVolumeTestJSON-183267417 None] attachment_update completed successfully. Sep 04 17:52:26 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-620bec94-4cea-46c5-bdae-75a55717ef03 tempest-VolumesMetadataTest-301081935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:52:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-620bec94-4cea-46c5-bdae-75a55717ef03 tempest-VolumesMetadataTest-301081935 None] Flow 'volume_create_manager' (f75d1d29-9c66-463d-998a-cea8321bf113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:52:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-620bec94-4cea-46c5-bdae-75a55717ef03 tempest-VolumesMetadataTest-301081935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0e77d7b-df53-427d-9ce1-6b4ea1eed6a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:52:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-620bec94-4cea-46c5-bdae-75a55717ef03 tempest-VolumesMetadataTest-301081935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0e77d7b-df53-427d-9ce1-6b4ea1eed6a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:52:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-331687541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8294542f-7c8e-4061-8b73-705ed8cf3ec0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57f76250138046fdae0c30574f197fec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:52:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:52:26Z,use_quota=True,user_id='b2fe761640974ef2b350991cefd01e0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:52:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-620bec94-4cea-46c5-bdae-75a55717ef03 tempest-VolumesMetadataTest-301081935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f75bfb6-d29d-449d-8f4a-019eceff1fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:52:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-620bec94-4cea-46c5-bdae-75a55717ef03 tempest-VolumesMetadataTest-301081935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f75bfb6-d29d-449d-8f4a-019eceff1fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:52:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-620bec94-4cea-46c5-bdae-75a55717ef03 tempest-VolumesMetadataTest-301081935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dfd3d0f-8657-41ea-987d-9f193ce9cd40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:52:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-620bec94-4cea-46c5-bdae-75a55717ef03 tempest-VolumesMetadataTest-301081935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dfd3d0f-8657-41ea-987d-9f193ce9cd40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8294542f-7c8e-4061-8b73-705ed8cf3ec0', 'volume_name': 'volume-8294542f-7c8e-4061-8b73-705ed8cf3ec0', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:52:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-620bec94-4cea-46c5-bdae-75a55717ef03 tempest-VolumesMetadataTest-301081935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d492c243-57a1-4de6-9f0c-5b36fb5aab00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:52:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-620bec94-4cea-46c5-bdae-75a55717ef03 tempest-VolumesMetadataTest-301081935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d492c243-57a1-4de6-9f0c-5b36fb5aab00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:52:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-620bec94-4cea-46c5-bdae-75a55717ef03 tempest-VolumesMetadataTest-301081935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e89c707c-f4ce-4151-b39f-d593fb70ad3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:52:26 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-620bec94-4cea-46c5-bdae-75a55717ef03 tempest-VolumesMetadataTest-301081935 None] Volume 8294542f-7c8e-4061-8b73-705ed8cf3ec0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8294542f-7c8e-4061-8b73-705ed8cf3ec0', 'volume_size': 1} Sep 04 17:52:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-620bec94-4cea-46c5-bdae-75a55717ef03 tempest-VolumesMetadataTest-301081935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:52:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-620bec94-4cea-46c5-bdae-75a55717ef03 tempest-VolumesMetadataTest-301081935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:52:26 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-620bec94-4cea-46c5-bdae-75a55717ef03 tempest-VolumesMetadataTest-301081935 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:52:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-331687541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8294542f-7c8e-4061-8b73-705ed8cf3ec0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57f76250138046fdae0c30574f197fec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:52:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:52:26Z,use_quota=True,user_id='b2fe761640974ef2b350991cefd01e0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:52:26 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-620bec94-4cea-46c5-bdae-75a55717ef03 tempest-VolumesMetadataTest-301081935 None] Creating volume 8294542f-7c8e-4061-8b73-705ed8cf3ec0 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:52:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-620bec94-4cea-46c5-bdae-75a55717ef03 tempest-VolumesMetadataTest-301081935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:52:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-620bec94-4cea-46c5-bdae-75a55717ef03 tempest-VolumesMetadataTest-301081935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:52:26 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-620bec94-4cea-46c5-bdae-75a55717ef03 tempest-VolumesMetadataTest-301081935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:52:26 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-620bec94-4cea-46c5-bdae-75a55717ef03 tempest-VolumesMetadataTest-301081935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:52:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-620bec94-4cea-46c5-bdae-75a55717ef03 tempest-VolumesMetadataTest-301081935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:52:26 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-620bec94-4cea-46c5-bdae-75a55717ef03 tempest-VolumesMetadataTest-301081935 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:52:26 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-620bec94-4cea-46c5-bdae-75a55717ef03 tempest-VolumesMetadataTest-301081935 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:52:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-620bec94-4cea-46c5-bdae-75a55717ef03 tempest-VolumesMetadataTest-301081935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8294542f-7c8e-4061-8b73-705ed8cf3ec0 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:26 devstack sudo[92092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8294542f-7c8e-4061-8b73-705ed8cf3ec0 1073741824 Sep 04 17:52:26 devstack sudo[92092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:26 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-3ad63280-4ac5-47d5-84cd-b494bd1f0444 req-84d3dd80-2925-473b-8bc2-1c81b1301611 tempest-AttachVolumeTestJSON-183267417 None] Terminate volume connection completed successfully. Sep 04 17:52:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-3ad63280-4ac5-47d5-84cd-b494bd1f0444 req-84d3dd80-2925-473b-8bc2-1c81b1301611 tempest-AttachVolumeTestJSON-183267417 None] Deleting attachment db8997ef-a5dc-446f-8749-9ee288d1aa03. {{(pid=87314) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 17:52:27 devstack sudo[92092]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-620bec94-4cea-46c5-bdae-75a55717ef03 tempest-VolumesMetadataTest-301081935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8294542f-7c8e-4061-8b73-705ed8cf3ec0 1073741824" returned: 0 in 0.665s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:52:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-620bec94-4cea-46c5-bdae-75a55717ef03 tempest-VolumesMetadataTest-301081935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8294542f-7c8e-4061-8b73-705ed8cf3ec0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:27 devstack sudo[92098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8294542f-7c8e-4061-8b73-705ed8cf3ec0 Sep 04 17:52:27 devstack sudo[92098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:28 devstack sudo[92098]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-620bec94-4cea-46c5-bdae-75a55717ef03 tempest-VolumesMetadataTest-301081935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8294542f-7c8e-4061-8b73-705ed8cf3ec0" returned: 0 in 0.599s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:52:28 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-620bec94-4cea-46c5-bdae-75a55717ef03 tempest-VolumesMetadataTest-301081935 None] <== create_volume: return (1408ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:52:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-620bec94-4cea-46c5-bdae-75a55717ef03 tempest-VolumesMetadataTest-301081935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.416s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:52:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-620bec94-4cea-46c5-bdae-75a55717ef03 tempest-VolumesMetadataTest-301081935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e89c707c-f4ce-4151-b39f-d593fb70ad3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8294542f-7c8e-4061-8b73-705ed8cf3ec0', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:52:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-620bec94-4cea-46c5-bdae-75a55717ef03 tempest-VolumesMetadataTest-301081935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c2e47fe-c203-4182-9220-d43fd7d08495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:52:28 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-620bec94-4cea-46c5-bdae-75a55717ef03 tempest-VolumesMetadataTest-301081935 None] Volume volume-8294542f-7c8e-4061-8b73-705ed8cf3ec0 (8294542f-7c8e-4061-8b73-705ed8cf3ec0): created successfully Sep 04 17:52:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-620bec94-4cea-46c5-bdae-75a55717ef03 tempest-VolumesMetadataTest-301081935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c2e47fe-c203-4182-9220-d43fd7d08495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:52:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-620bec94-4cea-46c5-bdae-75a55717ef03 tempest-VolumesMetadataTest-301081935 None] Flow 'volume_create_manager' (f75d1d29-9c66-463d-998a-cea8321bf113) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:52:28 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-620bec94-4cea-46c5-bdae-75a55717ef03 tempest-VolumesMetadataTest-301081935 None] Created volume successfully. Sep 04 17:52:28 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-7837d6c7-648b-466a-b881-8d2c58b21148 req-c0d884bf-1f2c-47c5-ad71-a87423b47227 tempest-AttachVolumeTestJSON-183267417 None] Terminate volume connection completed successfully. Sep 04 17:52:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-7837d6c7-648b-466a-b881-8d2c58b21148 req-c0d884bf-1f2c-47c5-ad71-a87423b47227 tempest-AttachVolumeTestJSON-183267417 None] Deleting attachment 005b4c91-f518-4b4c-bd85-b2208b147029. {{(pid=87314) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 17:52:30 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ea078d14-13d7-4b2e-a676-d3b9937afc71 tempest-VolumesMetadataTest-301081935 None] Acquiring lock "cinder-8294542f-7c8e-4061-8b73-705ed8cf3ec0-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:52:30 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ea078d14-13d7-4b2e-a676-d3b9937afc71 tempest-VolumesMetadataTest-301081935 None] Lock "cinder-8294542f-7c8e-4061-8b73-705ed8cf3ec0-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:52:30 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ea078d14-13d7-4b2e-a676-d3b9937afc71 tempest-VolumesMetadataTest-301081935 None] Acquiring lock "cinder-quobyte-8294542f-7c8e-4061-8b73-705ed8cf3ec0" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:52:30 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ea078d14-13d7-4b2e-a676-d3b9937afc71 tempest-VolumesMetadataTest-301081935 None] Lock "cinder-quobyte-8294542f-7c8e-4061-8b73-705ed8cf3ec0" acquired by "delete_volume" :: waited 0.044s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:52:30 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[361f6c8d-c3ea-4159-98f7-71547625df7f]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:52:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ea078d14-13d7-4b2e-a676-d3b9937afc71 tempest-VolumesMetadataTest-301081935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8294542f-7c8e-4061-8b73-705ed8cf3ec0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:30 devstack sudo[92133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8294542f-7c8e-4061-8b73-705ed8cf3ec0 Sep 04 17:52:30 devstack sudo[92133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:31 devstack sudo[92133]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ea078d14-13d7-4b2e-a676-d3b9937afc71 tempest-VolumesMetadataTest-301081935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8294542f-7c8e-4061-8b73-705ed8cf3ec0" returned: 0 in 0.715s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:52:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ea078d14-13d7-4b2e-a676-d3b9937afc71 tempest-VolumesMetadataTest-301081935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8294542f-7c8e-4061-8b73-705ed8cf3ec0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:31 devstack sudo[92156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8294542f-7c8e-4061-8b73-705ed8cf3ec0 Sep 04 17:52:31 devstack sudo[92156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:31 devstack sudo[92156]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ea078d14-13d7-4b2e-a676-d3b9937afc71 tempest-VolumesMetadataTest-301081935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8294542f-7c8e-4061-8b73-705ed8cf3ec0" returned: 0 in 0.419s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:52:31 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ea078d14-13d7-4b2e-a676-d3b9937afc71 tempest-VolumesMetadataTest-301081935 None] Lock "cinder-quobyte-8294542f-7c8e-4061-8b73-705ed8cf3ec0" released by "delete_volume" :: held 1.242s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:52:31 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-ea078d14-13d7-4b2e-a676-d3b9937afc71 tempest-VolumesMetadataTest-301081935 None] Created reservations ['91c48f64-171d-4fae-88c8-db6566815031', '4a3cb17b-ce13-4caf-86e1-6253d3af31b9', 'ed1c8fed-b708-47fb-a64f-08391220767b', '37d022d1-3965-4b07-a6ee-52c0dded35df'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:52:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ea078d14-13d7-4b2e-a676-d3b9937afc71 tempest-VolumesMetadataTest-301081935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:52:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ea078d14-13d7-4b2e-a676-d3b9937afc71 tempest-VolumesMetadataTest-301081935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:52:31 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ea078d14-13d7-4b2e-a676-d3b9937afc71 tempest-VolumesMetadataTest-301081935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:52:31 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ea078d14-13d7-4b2e-a676-d3b9937afc71 tempest-VolumesMetadataTest-301081935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:52:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ea078d14-13d7-4b2e-a676-d3b9937afc71 tempest-VolumesMetadataTest-301081935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:52:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ea078d14-13d7-4b2e-a676-d3b9937afc71 tempest-VolumesMetadataTest-301081935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:32 devstack sudo[92160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:52:32 devstack sudo[92160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:32 devstack sudo[92160]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ea078d14-13d7-4b2e-a676-d3b9937afc71 tempest-VolumesMetadataTest-301081935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.393s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:52:32 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-ea078d14-13d7-4b2e-a676-d3b9937afc71 tempest-VolumesMetadataTest-301081935 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:52:32 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-ea078d14-13d7-4b2e-a676-d3b9937afc71 tempest-VolumesMetadataTest-301081935 None] Deleted volume successfully. Sep 04 17:52:32 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ea078d14-13d7-4b2e-a676-d3b9937afc71 tempest-VolumesMetadataTest-301081935 None] Lock "cinder-8294542f-7c8e-4061-8b73-705ed8cf3ec0-delete_volume" released by "delete_volume" :: held 2.092s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:52:35 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ae5de60b-7176-4bd8-bc3b-20760690cd03 tempest-AttachVolumeTestJSON-183267417 None] Acquiring lock "cinder-54d6e962-aa53-482c-a8f0-194545ebf008-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:52:35 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ae5de60b-7176-4bd8-bc3b-20760690cd03 tempest-AttachVolumeTestJSON-183267417 None] Lock "cinder-54d6e962-aa53-482c-a8f0-194545ebf008-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:52:35 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ae5de60b-7176-4bd8-bc3b-20760690cd03 tempest-AttachVolumeTestJSON-183267417 None] Acquiring lock "cinder-quobyte-54d6e962-aa53-482c-a8f0-194545ebf008" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:52:35 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ae5de60b-7176-4bd8-bc3b-20760690cd03 tempest-AttachVolumeTestJSON-183267417 None] Lock "cinder-quobyte-54d6e962-aa53-482c-a8f0-194545ebf008" acquired by "delete_volume" :: waited 0.024s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:52:36 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d2250d-0792-4c26-bbf9-1aaabd595d52]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:52:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ae5de60b-7176-4bd8-bc3b-20760690cd03 tempest-AttachVolumeTestJSON-183267417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-54d6e962-aa53-482c-a8f0-194545ebf008 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:36 devstack sudo[92225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-54d6e962-aa53-482c-a8f0-194545ebf008 Sep 04 17:52:36 devstack sudo[92225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:36 devstack sudo[92225]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ae5de60b-7176-4bd8-bc3b-20760690cd03 tempest-AttachVolumeTestJSON-183267417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-54d6e962-aa53-482c-a8f0-194545ebf008" returned: 0 in 0.413s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:52:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ae5de60b-7176-4bd8-bc3b-20760690cd03 tempest-AttachVolumeTestJSON-183267417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-54d6e962-aa53-482c-a8f0-194545ebf008 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:36 devstack sudo[92230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-54d6e962-aa53-482c-a8f0-194545ebf008 Sep 04 17:52:36 devstack sudo[92230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:36 devstack sudo[92230]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ae5de60b-7176-4bd8-bc3b-20760690cd03 tempest-AttachVolumeTestJSON-183267417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-54d6e962-aa53-482c-a8f0-194545ebf008" returned: 0 in 0.296s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:52:36 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ae5de60b-7176-4bd8-bc3b-20760690cd03 tempest-AttachVolumeTestJSON-183267417 None] Lock "cinder-quobyte-54d6e962-aa53-482c-a8f0-194545ebf008" released by "delete_volume" :: held 0.769s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:52:36 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-ae5de60b-7176-4bd8-bc3b-20760690cd03 tempest-AttachVolumeTestJSON-183267417 None] Created reservations ['a70bdf10-b087-4814-8d45-a50ed402816b', '64f5b8e4-808a-4412-a8af-547529402caa', '818debd5-d20b-4220-baa2-4a7c9644b10d', '719aaf65-6c99-4c88-895e-44e5c59aaff2'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:52:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ae5de60b-7176-4bd8-bc3b-20760690cd03 tempest-AttachVolumeTestJSON-183267417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:52:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ae5de60b-7176-4bd8-bc3b-20760690cd03 tempest-AttachVolumeTestJSON-183267417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:52:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ae5de60b-7176-4bd8-bc3b-20760690cd03 tempest-AttachVolumeTestJSON-183267417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:52:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ae5de60b-7176-4bd8-bc3b-20760690cd03 tempest-AttachVolumeTestJSON-183267417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:52:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ae5de60b-7176-4bd8-bc3b-20760690cd03 tempest-AttachVolumeTestJSON-183267417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:52:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ae5de60b-7176-4bd8-bc3b-20760690cd03 tempest-AttachVolumeTestJSON-183267417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:36 devstack sudo[92233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:52:36 devstack sudo[92233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7aca797e-7378-4460-aba0-5fdc2142d5f1 tempest-AttachVolumeTestJSON-183267417 None] Acquiring lock "cinder-03b001c3-5cb5-44d6-a0ab-4628ef7ea3d9-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:52:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7aca797e-7378-4460-aba0-5fdc2142d5f1 tempest-AttachVolumeTestJSON-183267417 None] Lock "cinder-03b001c3-5cb5-44d6-a0ab-4628ef7ea3d9-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:52:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7aca797e-7378-4460-aba0-5fdc2142d5f1 tempest-AttachVolumeTestJSON-183267417 None] Acquiring lock "cinder-quobyte-03b001c3-5cb5-44d6-a0ab-4628ef7ea3d9" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:52:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7aca797e-7378-4460-aba0-5fdc2142d5f1 tempest-AttachVolumeTestJSON-183267417 None] Lock "cinder-quobyte-03b001c3-5cb5-44d6-a0ab-4628ef7ea3d9" acquired by "delete_volume" :: waited 0.027s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:52:37 devstack sudo[92233]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ae5de60b-7176-4bd8-bc3b-20760690cd03 tempest-AttachVolumeTestJSON-183267417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.354s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:52:37 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-ae5de60b-7176-4bd8-bc3b-20760690cd03 tempest-AttachVolumeTestJSON-183267417 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:52:37 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-ae5de60b-7176-4bd8-bc3b-20760690cd03 tempest-AttachVolumeTestJSON-183267417 None] Deleted volume successfully. Sep 04 17:52:37 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[2332b4d7-de8e-4bc1-99c8-b3859b45760d]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:52:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7aca797e-7378-4460-aba0-5fdc2142d5f1 tempest-AttachVolumeTestJSON-183267417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-03b001c3-5cb5-44d6-a0ab-4628ef7ea3d9 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ae5de60b-7176-4bd8-bc3b-20760690cd03 tempest-AttachVolumeTestJSON-183267417 None] Lock "cinder-54d6e962-aa53-482c-a8f0-194545ebf008-delete_volume" released by "delete_volume" :: held 1.375s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:52:37 devstack sudo[92236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-03b001c3-5cb5-44d6-a0ab-4628ef7ea3d9 Sep 04 17:52:37 devstack sudo[92236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:37 devstack sudo[92236]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7aca797e-7378-4460-aba0-5fdc2142d5f1 tempest-AttachVolumeTestJSON-183267417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-03b001c3-5cb5-44d6-a0ab-4628ef7ea3d9" returned: 0 in 0.490s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:52:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7aca797e-7378-4460-aba0-5fdc2142d5f1 tempest-AttachVolumeTestJSON-183267417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-03b001c3-5cb5-44d6-a0ab-4628ef7ea3d9 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:37 devstack sudo[92241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-03b001c3-5cb5-44d6-a0ab-4628ef7ea3d9 Sep 04 17:52:37 devstack sudo[92241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:38 devstack sudo[92241]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7aca797e-7378-4460-aba0-5fdc2142d5f1 tempest-AttachVolumeTestJSON-183267417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-03b001c3-5cb5-44d6-a0ab-4628ef7ea3d9" returned: 0 in 0.295s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:52:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7aca797e-7378-4460-aba0-5fdc2142d5f1 tempest-AttachVolumeTestJSON-183267417 None] Lock "cinder-quobyte-03b001c3-5cb5-44d6-a0ab-4628ef7ea3d9" released by "delete_volume" :: held 0.844s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:52:38 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-7aca797e-7378-4460-aba0-5fdc2142d5f1 tempest-AttachVolumeTestJSON-183267417 None] Created reservations ['af78f481-425c-4e61-b148-21c920c09671', '3778adb6-76c5-45c2-9e5f-5aec32423906', 'ce4e0a09-8760-4159-ab02-db230789b50c', '492565fa-421d-42f0-8343-d0966a48533a'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:52:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7aca797e-7378-4460-aba0-5fdc2142d5f1 tempest-AttachVolumeTestJSON-183267417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:52:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7aca797e-7378-4460-aba0-5fdc2142d5f1 tempest-AttachVolumeTestJSON-183267417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:52:38 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7aca797e-7378-4460-aba0-5fdc2142d5f1 tempest-AttachVolumeTestJSON-183267417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:52:38 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7aca797e-7378-4460-aba0-5fdc2142d5f1 tempest-AttachVolumeTestJSON-183267417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:52:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7aca797e-7378-4460-aba0-5fdc2142d5f1 tempest-AttachVolumeTestJSON-183267417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:52:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7aca797e-7378-4460-aba0-5fdc2142d5f1 tempest-AttachVolumeTestJSON-183267417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:38 devstack sudo[92244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:52:38 devstack sudo[92244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5e3d04b5-bbbe-4b47-a06a-ecd11290cb6f tempest-AttachVolumeTestJSON-183267417 None] Acquiring lock "cinder-c0df7a3e-2952-43a2-899d-6fb5e153948a-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:52:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5e3d04b5-bbbe-4b47-a06a-ecd11290cb6f tempest-AttachVolumeTestJSON-183267417 None] Lock "cinder-c0df7a3e-2952-43a2-899d-6fb5e153948a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:52:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5e3d04b5-bbbe-4b47-a06a-ecd11290cb6f tempest-AttachVolumeTestJSON-183267417 None] Acquiring lock "cinder-quobyte-c0df7a3e-2952-43a2-899d-6fb5e153948a" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:52:38 devstack sudo[92244]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7aca797e-7378-4460-aba0-5fdc2142d5f1 tempest-AttachVolumeTestJSON-183267417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.302s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:52:38 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-7aca797e-7378-4460-aba0-5fdc2142d5f1 tempest-AttachVolumeTestJSON-183267417 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:52:38 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-7aca797e-7378-4460-aba0-5fdc2142d5f1 tempest-AttachVolumeTestJSON-183267417 None] Deleted volume successfully. Sep 04 17:52:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5e3d04b5-bbbe-4b47-a06a-ecd11290cb6f tempest-AttachVolumeTestJSON-183267417 None] Lock "cinder-quobyte-c0df7a3e-2952-43a2-899d-6fb5e153948a" acquired by "delete_volume" :: waited 0.039s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:52:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7aca797e-7378-4460-aba0-5fdc2142d5f1 tempest-AttachVolumeTestJSON-183267417 None] Lock "cinder-03b001c3-5cb5-44d6-a0ab-4628ef7ea3d9-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:52:38 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b97258-ad7d-4324-9fca-408add0c6aab]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:52:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5e3d04b5-bbbe-4b47-a06a-ecd11290cb6f tempest-AttachVolumeTestJSON-183267417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c0df7a3e-2952-43a2-899d-6fb5e153948a {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:38 devstack sudo[92247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c0df7a3e-2952-43a2-899d-6fb5e153948a Sep 04 17:52:38 devstack sudo[92247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:39 devstack sudo[92247]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5e3d04b5-bbbe-4b47-a06a-ecd11290cb6f tempest-AttachVolumeTestJSON-183267417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c0df7a3e-2952-43a2-899d-6fb5e153948a" returned: 0 in 0.454s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:52:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5e3d04b5-bbbe-4b47-a06a-ecd11290cb6f tempest-AttachVolumeTestJSON-183267417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c0df7a3e-2952-43a2-899d-6fb5e153948a {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:39 devstack sudo[92252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c0df7a3e-2952-43a2-899d-6fb5e153948a Sep 04 17:52:39 devstack sudo[92252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:39 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-5750dc08-318c-4518-acf3-d5e6053a6432 tempest-VolumesTransfersTest-1566826907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:52:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5750dc08-318c-4518-acf3-d5e6053a6432 tempest-VolumesTransfersTest-1566826907 None] Flow 'volume_create_manager' (91d82fe7-c0dd-4faf-a07a-052c1b1e9c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:52:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5750dc08-318c-4518-acf3-d5e6053a6432 tempest-VolumesTransfersTest-1566826907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80850931-a358-40b1-acb7-aadd56f08a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:52:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5750dc08-318c-4518-acf3-d5e6053a6432 tempest-VolumesTransfersTest-1566826907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80850931-a358-40b1-acb7-aadd56f08a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:52:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-940448758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36e08e76-29ea-433c-86de-39e0cea40bee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff376c7c73b04b5a9defbd98b1f69bb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:52:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:52:39Z,use_quota=True,user_id='4cb9222f951d4b95a2dafea08d0d5632',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:52:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5750dc08-318c-4518-acf3-d5e6053a6432 tempest-VolumesTransfersTest-1566826907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa9fe63a-df10-496f-bb9d-8418a6016326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:52:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5750dc08-318c-4518-acf3-d5e6053a6432 tempest-VolumesTransfersTest-1566826907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa9fe63a-df10-496f-bb9d-8418a6016326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:52:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5750dc08-318c-4518-acf3-d5e6053a6432 tempest-VolumesTransfersTest-1566826907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17aa3d03-3dca-44bc-8595-1b5fa8bdd7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:52:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5750dc08-318c-4518-acf3-d5e6053a6432 tempest-VolumesTransfersTest-1566826907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17aa3d03-3dca-44bc-8595-1b5fa8bdd7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36e08e76-29ea-433c-86de-39e0cea40bee', 'volume_name': 'volume-36e08e76-29ea-433c-86de-39e0cea40bee', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:52:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5750dc08-318c-4518-acf3-d5e6053a6432 tempest-VolumesTransfersTest-1566826907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee7cffe9-8e6f-4e68-9484-4b6ba061028b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:52:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5750dc08-318c-4518-acf3-d5e6053a6432 tempest-VolumesTransfersTest-1566826907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee7cffe9-8e6f-4e68-9484-4b6ba061028b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:52:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5750dc08-318c-4518-acf3-d5e6053a6432 tempest-VolumesTransfersTest-1566826907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04e0b1dc-16a5-4516-acf0-c1ad6d40297f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:52:39 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-5750dc08-318c-4518-acf3-d5e6053a6432 tempest-VolumesTransfersTest-1566826907 None] Volume 36e08e76-29ea-433c-86de-39e0cea40bee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36e08e76-29ea-433c-86de-39e0cea40bee', 'volume_size': 1} Sep 04 17:52:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5750dc08-318c-4518-acf3-d5e6053a6432 tempest-VolumesTransfersTest-1566826907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:52:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5750dc08-318c-4518-acf3-d5e6053a6432 tempest-VolumesTransfersTest-1566826907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:52:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5750dc08-318c-4518-acf3-d5e6053a6432 tempest-VolumesTransfersTest-1566826907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:52:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-940448758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36e08e76-29ea-433c-86de-39e0cea40bee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff376c7c73b04b5a9defbd98b1f69bb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:52:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:52:39Z,use_quota=True,user_id='4cb9222f951d4b95a2dafea08d0d5632',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:52:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-5750dc08-318c-4518-acf3-d5e6053a6432 tempest-VolumesTransfersTest-1566826907 None] Creating volume 36e08e76-29ea-433c-86de-39e0cea40bee {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:52:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5750dc08-318c-4518-acf3-d5e6053a6432 tempest-VolumesTransfersTest-1566826907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:52:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5750dc08-318c-4518-acf3-d5e6053a6432 tempest-VolumesTransfersTest-1566826907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:52:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5750dc08-318c-4518-acf3-d5e6053a6432 tempest-VolumesTransfersTest-1566826907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:52:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5750dc08-318c-4518-acf3-d5e6053a6432 tempest-VolumesTransfersTest-1566826907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:52:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5750dc08-318c-4518-acf3-d5e6053a6432 tempest-VolumesTransfersTest-1566826907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:52:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5750dc08-318c-4518-acf3-d5e6053a6432 tempest-VolumesTransfersTest-1566826907 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:52:39 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-5750dc08-318c-4518-acf3-d5e6053a6432 tempest-VolumesTransfersTest-1566826907 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:52:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5750dc08-318c-4518-acf3-d5e6053a6432 tempest-VolumesTransfersTest-1566826907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-36e08e76-29ea-433c-86de-39e0cea40bee 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:39 devstack sudo[92254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-36e08e76-29ea-433c-86de-39e0cea40bee 1073741824 Sep 04 17:52:39 devstack sudo[92254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:39 devstack sudo[92252]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5e3d04b5-bbbe-4b47-a06a-ecd11290cb6f tempest-AttachVolumeTestJSON-183267417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c0df7a3e-2952-43a2-899d-6fb5e153948a" returned: 0 in 0.308s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:52:39 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5e3d04b5-bbbe-4b47-a06a-ecd11290cb6f tempest-AttachVolumeTestJSON-183267417 None] Lock "cinder-quobyte-c0df7a3e-2952-43a2-899d-6fb5e153948a" released by "delete_volume" :: held 0.813s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:52:39 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-5e3d04b5-bbbe-4b47-a06a-ecd11290cb6f tempest-AttachVolumeTestJSON-183267417 None] Created reservations ['f22c2ba7-b4a6-4188-a6fa-15008f9b308e', 'bb6016db-6b5d-45e7-a80b-98938bb8a970', '39d44417-b8eb-40d0-ba18-09031014e43b', 'b42dd77e-241e-49db-9a57-3288854f58b7'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:52:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5e3d04b5-bbbe-4b47-a06a-ecd11290cb6f tempest-AttachVolumeTestJSON-183267417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:52:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5e3d04b5-bbbe-4b47-a06a-ecd11290cb6f tempest-AttachVolumeTestJSON-183267417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:52:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5e3d04b5-bbbe-4b47-a06a-ecd11290cb6f tempest-AttachVolumeTestJSON-183267417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:52:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5e3d04b5-bbbe-4b47-a06a-ecd11290cb6f tempest-AttachVolumeTestJSON-183267417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:52:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5e3d04b5-bbbe-4b47-a06a-ecd11290cb6f tempest-AttachVolumeTestJSON-183267417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:52:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5e3d04b5-bbbe-4b47-a06a-ecd11290cb6f tempest-AttachVolumeTestJSON-183267417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:39 devstack sudo[92260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:52:39 devstack sudo[92260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:39 devstack sudo[92254]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5750dc08-318c-4518-acf3-d5e6053a6432 tempest-VolumesTransfersTest-1566826907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-36e08e76-29ea-433c-86de-39e0cea40bee 1073741824" returned: 0 in 0.493s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:52:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5750dc08-318c-4518-acf3-d5e6053a6432 tempest-VolumesTransfersTest-1566826907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-36e08e76-29ea-433c-86de-39e0cea40bee {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:39 devstack sudo[92263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-36e08e76-29ea-433c-86de-39e0cea40bee Sep 04 17:52:39 devstack sudo[92263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:39 devstack sudo[92260]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5e3d04b5-bbbe-4b47-a06a-ecd11290cb6f tempest-AttachVolumeTestJSON-183267417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.314s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:52:39 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-5e3d04b5-bbbe-4b47-a06a-ecd11290cb6f tempest-AttachVolumeTestJSON-183267417 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:52:39 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-5e3d04b5-bbbe-4b47-a06a-ecd11290cb6f tempest-AttachVolumeTestJSON-183267417 None] Deleted volume successfully. Sep 04 17:52:39 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5e3d04b5-bbbe-4b47-a06a-ecd11290cb6f tempest-AttachVolumeTestJSON-183267417 None] Lock "cinder-c0df7a3e-2952-43a2-899d-6fb5e153948a-delete_volume" released by "delete_volume" :: held 1.370s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:52:40 devstack sudo[92263]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5750dc08-318c-4518-acf3-d5e6053a6432 tempest-VolumesTransfersTest-1566826907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-36e08e76-29ea-433c-86de-39e0cea40bee" returned: 0 in 0.302s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:52:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5750dc08-318c-4518-acf3-d5e6053a6432 tempest-VolumesTransfersTest-1566826907 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:52:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5750dc08-318c-4518-acf3-d5e6053a6432 tempest-VolumesTransfersTest-1566826907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:52:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5750dc08-318c-4518-acf3-d5e6053a6432 tempest-VolumesTransfersTest-1566826907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04e0b1dc-16a5-4516-acf0-c1ad6d40297f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36e08e76-29ea-433c-86de-39e0cea40bee', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:52:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5750dc08-318c-4518-acf3-d5e6053a6432 tempest-VolumesTransfersTest-1566826907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1ff3ef6-fc74-4da1-98a2-5af683d7da2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:52:40 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-5750dc08-318c-4518-acf3-d5e6053a6432 tempest-VolumesTransfersTest-1566826907 None] Volume volume-36e08e76-29ea-433c-86de-39e0cea40bee (36e08e76-29ea-433c-86de-39e0cea40bee): created successfully Sep 04 17:52:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5750dc08-318c-4518-acf3-d5e6053a6432 tempest-VolumesTransfersTest-1566826907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1ff3ef6-fc74-4da1-98a2-5af683d7da2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:52:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5750dc08-318c-4518-acf3-d5e6053a6432 tempest-VolumesTransfersTest-1566826907 None] Flow 'volume_create_manager' (91d82fe7-c0dd-4faf-a07a-052c1b1e9c89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:52:40 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-5750dc08-318c-4518-acf3-d5e6053a6432 tempest-VolumesTransfersTest-1566826907 None] Created volume successfully. Sep 04 17:52:41 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-99879518-5e3a-4e51-9f05-324cf6530ab9 tempest-VolumesTransfersTest-1646408878 None] Transfer volume completed successfully. Sep 04 17:52:42 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-805c8cc6-c6e7-4069-9728-f5393f0cd51f tempest-VolumesTransfersTest-672647990 None] Acquiring lock "cinder-36e08e76-29ea-433c-86de-39e0cea40bee-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:52:42 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-805c8cc6-c6e7-4069-9728-f5393f0cd51f tempest-VolumesTransfersTest-672647990 None] Lock "cinder-36e08e76-29ea-433c-86de-39e0cea40bee-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:52:42 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-805c8cc6-c6e7-4069-9728-f5393f0cd51f tempest-VolumesTransfersTest-672647990 None] Acquiring lock "cinder-quobyte-36e08e76-29ea-433c-86de-39e0cea40bee" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:52:42 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-805c8cc6-c6e7-4069-9728-f5393f0cd51f tempest-VolumesTransfersTest-672647990 None] Lock "cinder-quobyte-36e08e76-29ea-433c-86de-39e0cea40bee" acquired by "delete_volume" :: waited 0.023s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:52:42 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d33673-15e9-46a4-a870-cfb75201a99a]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:52:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-805c8cc6-c6e7-4069-9728-f5393f0cd51f tempest-VolumesTransfersTest-672647990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-36e08e76-29ea-433c-86de-39e0cea40bee {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:43 devstack sudo[92271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-36e08e76-29ea-433c-86de-39e0cea40bee Sep 04 17:52:43 devstack sudo[92271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:43 devstack sudo[92271]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-805c8cc6-c6e7-4069-9728-f5393f0cd51f tempest-VolumesTransfersTest-672647990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-36e08e76-29ea-433c-86de-39e0cea40bee" returned: 0 in 0.479s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:52:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-805c8cc6-c6e7-4069-9728-f5393f0cd51f tempest-VolumesTransfersTest-672647990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-36e08e76-29ea-433c-86de-39e0cea40bee {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:43 devstack sudo[92278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-36e08e76-29ea-433c-86de-39e0cea40bee Sep 04 17:52:43 devstack sudo[92278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:43 devstack sudo[92278]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-805c8cc6-c6e7-4069-9728-f5393f0cd51f tempest-VolumesTransfersTest-672647990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-36e08e76-29ea-433c-86de-39e0cea40bee" returned: 0 in 0.278s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:52:43 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-805c8cc6-c6e7-4069-9728-f5393f0cd51f tempest-VolumesTransfersTest-672647990 None] Lock "cinder-quobyte-36e08e76-29ea-433c-86de-39e0cea40bee" released by "delete_volume" :: held 0.817s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:52:43 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-805c8cc6-c6e7-4069-9728-f5393f0cd51f tempest-VolumesTransfersTest-672647990 None] Created reservations ['7d987dab-4aee-4399-95ec-e52c91f924e1', '547c18fa-35be-4555-93ea-c8f8db3da50d', '3996ec74-7872-48be-a1f7-54c6c5e59487', 'dcdea18f-d466-4f01-a94f-e4283a5d453b'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:52:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-805c8cc6-c6e7-4069-9728-f5393f0cd51f tempest-VolumesTransfersTest-672647990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:52:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-805c8cc6-c6e7-4069-9728-f5393f0cd51f tempest-VolumesTransfersTest-672647990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:52:43 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-805c8cc6-c6e7-4069-9728-f5393f0cd51f tempest-VolumesTransfersTest-672647990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:52:43 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-805c8cc6-c6e7-4069-9728-f5393f0cd51f tempest-VolumesTransfersTest-672647990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:52:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-805c8cc6-c6e7-4069-9728-f5393f0cd51f tempest-VolumesTransfersTest-672647990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:52:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-805c8cc6-c6e7-4069-9728-f5393f0cd51f tempest-VolumesTransfersTest-672647990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:43 devstack sudo[92281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:52:43 devstack sudo[92281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:44 devstack sudo[92281]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-805c8cc6-c6e7-4069-9728-f5393f0cd51f tempest-VolumesTransfersTest-672647990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.474s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:52:44 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-805c8cc6-c6e7-4069-9728-f5393f0cd51f tempest-VolumesTransfersTest-672647990 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:52:44 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-805c8cc6-c6e7-4069-9728-f5393f0cd51f tempest-VolumesTransfersTest-672647990 None] Deleted volume successfully. Sep 04 17:52:44 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-805c8cc6-c6e7-4069-9728-f5393f0cd51f tempest-VolumesTransfersTest-672647990 None] Lock "cinder-36e08e76-29ea-433c-86de-39e0cea40bee-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:52:45 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-55c9be6f-c7be-414d-bf5d-24ee10ac49e7 tempest-VolumesTransfersTest-1566826907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:52:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-55c9be6f-c7be-414d-bf5d-24ee10ac49e7 tempest-VolumesTransfersTest-1566826907 None] Flow 'volume_create_manager' (68735a2d-384d-44b3-8c50-61f6b1855409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:52:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-55c9be6f-c7be-414d-bf5d-24ee10ac49e7 tempest-VolumesTransfersTest-1566826907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (996a44bb-1a47-49d1-994c-8be3a1b60082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:52:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-55c9be6f-c7be-414d-bf5d-24ee10ac49e7 tempest-VolumesTransfersTest-1566826907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (996a44bb-1a47-49d1-994c-8be3a1b60082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:52:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-460524881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09961702-2bd1-4429-ad91-e341c94ea8e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff376c7c73b04b5a9defbd98b1f69bb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:52:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:52:45Z,use_quota=True,user_id='4cb9222f951d4b95a2dafea08d0d5632',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:52:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-55c9be6f-c7be-414d-bf5d-24ee10ac49e7 tempest-VolumesTransfersTest-1566826907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (146c5137-4451-4ace-886c-91d63f043d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:52:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-55c9be6f-c7be-414d-bf5d-24ee10ac49e7 tempest-VolumesTransfersTest-1566826907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (146c5137-4451-4ace-886c-91d63f043d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:52:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-55c9be6f-c7be-414d-bf5d-24ee10ac49e7 tempest-VolumesTransfersTest-1566826907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (340db5dd-2eae-4fa0-bd05-a771f92a7980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:52:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-55c9be6f-c7be-414d-bf5d-24ee10ac49e7 tempest-VolumesTransfersTest-1566826907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (340db5dd-2eae-4fa0-bd05-a771f92a7980) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09961702-2bd1-4429-ad91-e341c94ea8e3', 'volume_name': 'volume-09961702-2bd1-4429-ad91-e341c94ea8e3', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:52:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-55c9be6f-c7be-414d-bf5d-24ee10ac49e7 tempest-VolumesTransfersTest-1566826907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ace2a2c-6f6e-4b19-a0a9-06551ca2e404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:52:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-55c9be6f-c7be-414d-bf5d-24ee10ac49e7 tempest-VolumesTransfersTest-1566826907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ace2a2c-6f6e-4b19-a0a9-06551ca2e404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:52:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-55c9be6f-c7be-414d-bf5d-24ee10ac49e7 tempest-VolumesTransfersTest-1566826907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04e2c9e1-7d42-4619-bf98-d31716326acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:52:45 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-55c9be6f-c7be-414d-bf5d-24ee10ac49e7 tempest-VolumesTransfersTest-1566826907 None] Volume 09961702-2bd1-4429-ad91-e341c94ea8e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09961702-2bd1-4429-ad91-e341c94ea8e3', 'volume_size': 1} Sep 04 17:52:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-55c9be6f-c7be-414d-bf5d-24ee10ac49e7 tempest-VolumesTransfersTest-1566826907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:52:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-55c9be6f-c7be-414d-bf5d-24ee10ac49e7 tempest-VolumesTransfersTest-1566826907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:52:45 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-55c9be6f-c7be-414d-bf5d-24ee10ac49e7 tempest-VolumesTransfersTest-1566826907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:52:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-460524881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09961702-2bd1-4429-ad91-e341c94ea8e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff376c7c73b04b5a9defbd98b1f69bb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:52:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:52:45Z,use_quota=True,user_id='4cb9222f951d4b95a2dafea08d0d5632',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:52:45 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-55c9be6f-c7be-414d-bf5d-24ee10ac49e7 tempest-VolumesTransfersTest-1566826907 None] Creating volume 09961702-2bd1-4429-ad91-e341c94ea8e3 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:52:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-55c9be6f-c7be-414d-bf5d-24ee10ac49e7 tempest-VolumesTransfersTest-1566826907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:52:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-55c9be6f-c7be-414d-bf5d-24ee10ac49e7 tempest-VolumesTransfersTest-1566826907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:52:45 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-55c9be6f-c7be-414d-bf5d-24ee10ac49e7 tempest-VolumesTransfersTest-1566826907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:52:45 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-55c9be6f-c7be-414d-bf5d-24ee10ac49e7 tempest-VolumesTransfersTest-1566826907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:52:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-55c9be6f-c7be-414d-bf5d-24ee10ac49e7 tempest-VolumesTransfersTest-1566826907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:52:45 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-55c9be6f-c7be-414d-bf5d-24ee10ac49e7 tempest-VolumesTransfersTest-1566826907 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:52:45 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-55c9be6f-c7be-414d-bf5d-24ee10ac49e7 tempest-VolumesTransfersTest-1566826907 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:52:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-55c9be6f-c7be-414d-bf5d-24ee10ac49e7 tempest-VolumesTransfersTest-1566826907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-09961702-2bd1-4429-ad91-e341c94ea8e3 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:45 devstack sudo[92299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-09961702-2bd1-4429-ad91-e341c94ea8e3 1073741824 Sep 04 17:52:45 devstack sudo[92299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:45 devstack sudo[92299]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-55c9be6f-c7be-414d-bf5d-24ee10ac49e7 tempest-VolumesTransfersTest-1566826907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-09961702-2bd1-4429-ad91-e341c94ea8e3 1073741824" returned: 0 in 0.579s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:52:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-55c9be6f-c7be-414d-bf5d-24ee10ac49e7 tempest-VolumesTransfersTest-1566826907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-09961702-2bd1-4429-ad91-e341c94ea8e3 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:45 devstack sudo[92310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-09961702-2bd1-4429-ad91-e341c94ea8e3 Sep 04 17:52:45 devstack sudo[92310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:46 devstack sudo[92310]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-55c9be6f-c7be-414d-bf5d-24ee10ac49e7 tempest-VolumesTransfersTest-1566826907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-09961702-2bd1-4429-ad91-e341c94ea8e3" returned: 0 in 0.292s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:52:46 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-55c9be6f-c7be-414d-bf5d-24ee10ac49e7 tempest-VolumesTransfersTest-1566826907 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:52:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-55c9be6f-c7be-414d-bf5d-24ee10ac49e7 tempest-VolumesTransfersTest-1566826907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:52:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-55c9be6f-c7be-414d-bf5d-24ee10ac49e7 tempest-VolumesTransfersTest-1566826907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04e2c9e1-7d42-4619-bf98-d31716326acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09961702-2bd1-4429-ad91-e341c94ea8e3', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:52:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-55c9be6f-c7be-414d-bf5d-24ee10ac49e7 tempest-VolumesTransfersTest-1566826907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cabc460-a421-4352-a0d0-3e82a51017d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:52:46 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-55c9be6f-c7be-414d-bf5d-24ee10ac49e7 tempest-VolumesTransfersTest-1566826907 None] Volume volume-09961702-2bd1-4429-ad91-e341c94ea8e3 (09961702-2bd1-4429-ad91-e341c94ea8e3): created successfully Sep 04 17:52:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-55c9be6f-c7be-414d-bf5d-24ee10ac49e7 tempest-VolumesTransfersTest-1566826907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cabc460-a421-4352-a0d0-3e82a51017d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:52:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-55c9be6f-c7be-414d-bf5d-24ee10ac49e7 tempest-VolumesTransfersTest-1566826907 None] Flow 'volume_create_manager' (68735a2d-384d-44b3-8c50-61f6b1855409) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:52:46 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-55c9be6f-c7be-414d-bf5d-24ee10ac49e7 tempest-VolumesTransfersTest-1566826907 None] Created volume successfully. Sep 04 17:52:47 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-711875aa-a6ef-404c-9f0b-6e9fb9966a04 tempest-VolumesTransfersTest-672647990 None] Acquiring lock "cinder-09961702-2bd1-4429-ad91-e341c94ea8e3-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:52:47 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-711875aa-a6ef-404c-9f0b-6e9fb9966a04 tempest-VolumesTransfersTest-672647990 None] Lock "cinder-09961702-2bd1-4429-ad91-e341c94ea8e3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:52:47 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-711875aa-a6ef-404c-9f0b-6e9fb9966a04 tempest-VolumesTransfersTest-672647990 None] Acquiring lock "cinder-quobyte-09961702-2bd1-4429-ad91-e341c94ea8e3" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:52:47 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-711875aa-a6ef-404c-9f0b-6e9fb9966a04 tempest-VolumesTransfersTest-672647990 None] Lock "cinder-quobyte-09961702-2bd1-4429-ad91-e341c94ea8e3" acquired by "delete_volume" :: waited 0.015s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:52:47 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c7215e-edc6-4ef0-bd95-04add80b9a29]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:52:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-711875aa-a6ef-404c-9f0b-6e9fb9966a04 tempest-VolumesTransfersTest-672647990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-09961702-2bd1-4429-ad91-e341c94ea8e3 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:47 devstack sudo[92315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-09961702-2bd1-4429-ad91-e341c94ea8e3 Sep 04 17:52:47 devstack sudo[92315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:48 devstack sudo[92315]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-711875aa-a6ef-404c-9f0b-6e9fb9966a04 tempest-VolumesTransfersTest-672647990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-09961702-2bd1-4429-ad91-e341c94ea8e3" returned: 0 in 0.820s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:52:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-711875aa-a6ef-404c-9f0b-6e9fb9966a04 tempest-VolumesTransfersTest-672647990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-09961702-2bd1-4429-ad91-e341c94ea8e3 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:48 devstack sudo[92382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-09961702-2bd1-4429-ad91-e341c94ea8e3 Sep 04 17:52:48 devstack sudo[92382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:49 devstack sudo[92382]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-711875aa-a6ef-404c-9f0b-6e9fb9966a04 tempest-VolumesTransfersTest-672647990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-09961702-2bd1-4429-ad91-e341c94ea8e3" returned: 0 in 0.633s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:52:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-711875aa-a6ef-404c-9f0b-6e9fb9966a04 tempest-VolumesTransfersTest-672647990 None] Lock "cinder-quobyte-09961702-2bd1-4429-ad91-e341c94ea8e3" released by "delete_volume" :: held 1.537s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:52:49 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-711875aa-a6ef-404c-9f0b-6e9fb9966a04 tempest-VolumesTransfersTest-672647990 None] Created reservations ['30062fd4-8251-42c0-87ea-c96a78aec745', '092e971b-4214-42fc-a184-66ebdc432b8b', 'b9c2afa8-db52-447d-aa5b-4a4cbcb8798f', '0507d98f-d006-40fc-a34b-cdb48c7ec254'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:52:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-711875aa-a6ef-404c-9f0b-6e9fb9966a04 tempest-VolumesTransfersTest-672647990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:52:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-711875aa-a6ef-404c-9f0b-6e9fb9966a04 tempest-VolumesTransfersTest-672647990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:52:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-711875aa-a6ef-404c-9f0b-6e9fb9966a04 tempest-VolumesTransfersTest-672647990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:52:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-711875aa-a6ef-404c-9f0b-6e9fb9966a04 tempest-VolumesTransfersTest-672647990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:52:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-711875aa-a6ef-404c-9f0b-6e9fb9966a04 tempest-VolumesTransfersTest-672647990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:52:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-711875aa-a6ef-404c-9f0b-6e9fb9966a04 tempest-VolumesTransfersTest-672647990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:49 devstack sudo[92393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:52:49 devstack sudo[92393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:49 devstack sudo[92393]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-711875aa-a6ef-404c-9f0b-6e9fb9966a04 tempest-VolumesTransfersTest-672647990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.359s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:52:49 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-711875aa-a6ef-404c-9f0b-6e9fb9966a04 tempest-VolumesTransfersTest-672647990 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:52:49 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-711875aa-a6ef-404c-9f0b-6e9fb9966a04 tempest-VolumesTransfersTest-672647990 None] Deleted volume successfully. Sep 04 17:52:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-711875aa-a6ef-404c-9f0b-6e9fb9966a04 tempest-VolumesTransfersTest-672647990 None] Lock "cinder-09961702-2bd1-4429-ad91-e341c94ea8e3-delete_volume" released by "delete_volume" :: held 2.239s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:52:50 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [req-d6f05b6e-004b-428a-aec4-341f2ddc5830 req-458779e1-f111-4c77-8082-6dee7def8936 tempest-VolumesSnapshotsTestJSON-464415568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:52:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-d6f05b6e-004b-428a-aec4-341f2ddc5830 req-458779e1-f111-4c77-8082-6dee7def8936 tempest-VolumesSnapshotsTestJSON-464415568 None] Flow 'volume_create_manager' (08c00413-7fe2-45af-8f63-5b6588b57918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:52:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-d6f05b6e-004b-428a-aec4-341f2ddc5830 req-458779e1-f111-4c77-8082-6dee7def8936 tempest-VolumesSnapshotsTestJSON-464415568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d1eec17-ce40-4147-8ed7-87b8bc2d1fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:52:51 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-d6f05b6e-004b-428a-aec4-341f2ddc5830 req-458779e1-f111-4c77-8082-6dee7def8936 tempest-VolumesSnapshotsTestJSON-464415568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d1eec17-ce40-4147-8ed7-87b8bc2d1fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:52:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-442803500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c09df168-cd7c-4b2c-88d5-086748101b3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c94c5f867164df7b9883d9f3cffb2be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:52:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:52:51Z,use_quota=True,user_id='3bcf2ce973ef460eb65b8e820c3b01b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:52:51 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-d6f05b6e-004b-428a-aec4-341f2ddc5830 req-458779e1-f111-4c77-8082-6dee7def8936 tempest-VolumesSnapshotsTestJSON-464415568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e927be5-26a0-4abb-a377-e22ba03bc1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:52:51 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-d6f05b6e-004b-428a-aec4-341f2ddc5830 req-458779e1-f111-4c77-8082-6dee7def8936 tempest-VolumesSnapshotsTestJSON-464415568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e927be5-26a0-4abb-a377-e22ba03bc1fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:52:51 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-d6f05b6e-004b-428a-aec4-341f2ddc5830 req-458779e1-f111-4c77-8082-6dee7def8936 tempest-VolumesSnapshotsTestJSON-464415568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80758309-3475-4ad1-9cde-a6a16ad241f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:52:51 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-d6f05b6e-004b-428a-aec4-341f2ddc5830 req-458779e1-f111-4c77-8082-6dee7def8936 tempest-VolumesSnapshotsTestJSON-464415568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80758309-3475-4ad1-9cde-a6a16ad241f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c09df168-cd7c-4b2c-88d5-086748101b3b', 'volume_name': 'volume-c09df168-cd7c-4b2c-88d5-086748101b3b', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:52:51 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-d6f05b6e-004b-428a-aec4-341f2ddc5830 req-458779e1-f111-4c77-8082-6dee7def8936 tempest-VolumesSnapshotsTestJSON-464415568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c148fae-edf9-43d6-a089-14cd14a83f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:52:51 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-d6f05b6e-004b-428a-aec4-341f2ddc5830 req-458779e1-f111-4c77-8082-6dee7def8936 tempest-VolumesSnapshotsTestJSON-464415568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c148fae-edf9-43d6-a089-14cd14a83f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:52:51 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-d6f05b6e-004b-428a-aec4-341f2ddc5830 req-458779e1-f111-4c77-8082-6dee7def8936 tempest-VolumesSnapshotsTestJSON-464415568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cc40a44-5ab4-4ccc-8cb5-038cfa40920e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:52:51 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [req-d6f05b6e-004b-428a-aec4-341f2ddc5830 req-458779e1-f111-4c77-8082-6dee7def8936 tempest-VolumesSnapshotsTestJSON-464415568 None] Volume c09df168-cd7c-4b2c-88d5-086748101b3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c09df168-cd7c-4b2c-88d5-086748101b3b', 'volume_size': 1} Sep 04 17:52:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-d6f05b6e-004b-428a-aec4-341f2ddc5830 req-458779e1-f111-4c77-8082-6dee7def8936 tempest-VolumesSnapshotsTestJSON-464415568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:52:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-d6f05b6e-004b-428a-aec4-341f2ddc5830 req-458779e1-f111-4c77-8082-6dee7def8936 tempest-VolumesSnapshotsTestJSON-464415568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:52:51 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [req-d6f05b6e-004b-428a-aec4-341f2ddc5830 req-458779e1-f111-4c77-8082-6dee7def8936 tempest-VolumesSnapshotsTestJSON-464415568 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:52:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-442803500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c09df168-cd7c-4b2c-88d5-086748101b3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c94c5f867164df7b9883d9f3cffb2be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:52:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:52:51Z,use_quota=True,user_id='3bcf2ce973ef460eb65b8e820c3b01b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:52:51 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [req-d6f05b6e-004b-428a-aec4-341f2ddc5830 req-458779e1-f111-4c77-8082-6dee7def8936 tempest-VolumesSnapshotsTestJSON-464415568 None] Creating volume c09df168-cd7c-4b2c-88d5-086748101b3b {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:52:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-d6f05b6e-004b-428a-aec4-341f2ddc5830 req-458779e1-f111-4c77-8082-6dee7def8936 tempest-VolumesSnapshotsTestJSON-464415568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:52:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-d6f05b6e-004b-428a-aec4-341f2ddc5830 req-458779e1-f111-4c77-8082-6dee7def8936 tempest-VolumesSnapshotsTestJSON-464415568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:52:51 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [req-d6f05b6e-004b-428a-aec4-341f2ddc5830 req-458779e1-f111-4c77-8082-6dee7def8936 tempest-VolumesSnapshotsTestJSON-464415568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:52:51 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [req-d6f05b6e-004b-428a-aec4-341f2ddc5830 req-458779e1-f111-4c77-8082-6dee7def8936 tempest-VolumesSnapshotsTestJSON-464415568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:52:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-d6f05b6e-004b-428a-aec4-341f2ddc5830 req-458779e1-f111-4c77-8082-6dee7def8936 tempest-VolumesSnapshotsTestJSON-464415568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:52:51 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [req-d6f05b6e-004b-428a-aec4-341f2ddc5830 req-458779e1-f111-4c77-8082-6dee7def8936 tempest-VolumesSnapshotsTestJSON-464415568 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:52:51 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [req-d6f05b6e-004b-428a-aec4-341f2ddc5830 req-458779e1-f111-4c77-8082-6dee7def8936 tempest-VolumesSnapshotsTestJSON-464415568 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:52:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-d6f05b6e-004b-428a-aec4-341f2ddc5830 req-458779e1-f111-4c77-8082-6dee7def8936 tempest-VolumesSnapshotsTestJSON-464415568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c09df168-cd7c-4b2c-88d5-086748101b3b 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-4506bbe4-d833-4d38-9927-e7bbdcba58e8 req-71818d16-789f-45b4-9754-efb6baf4a709 tempest-ServerActionsTestOtherA-1015930920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:52:51 devstack sudo[92412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c09df168-cd7c-4b2c-88d5-086748101b3b 1073741824 Sep 04 17:52:51 devstack sudo[92412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:51 devstack sudo[92412]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-d6f05b6e-004b-428a-aec4-341f2ddc5830 req-458779e1-f111-4c77-8082-6dee7def8936 tempest-VolumesSnapshotsTestJSON-464415568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c09df168-cd7c-4b2c-88d5-086748101b3b 1073741824" returned: 0 in 0.629s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:52:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-d6f05b6e-004b-428a-aec4-341f2ddc5830 req-458779e1-f111-4c77-8082-6dee7def8936 tempest-VolumesSnapshotsTestJSON-464415568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c09df168-cd7c-4b2c-88d5-086748101b3b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:51 devstack sudo[92418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c09df168-cd7c-4b2c-88d5-086748101b3b Sep 04 17:52:51 devstack sudo[92418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:52 devstack sudo[92418]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-d6f05b6e-004b-428a-aec4-341f2ddc5830 req-458779e1-f111-4c77-8082-6dee7def8936 tempest-VolumesSnapshotsTestJSON-464415568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c09df168-cd7c-4b2c-88d5-086748101b3b" returned: 0 in 0.396s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:52:52 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [req-d6f05b6e-004b-428a-aec4-341f2ddc5830 req-458779e1-f111-4c77-8082-6dee7def8936 tempest-VolumesSnapshotsTestJSON-464415568 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:52:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-d6f05b6e-004b-428a-aec4-341f2ddc5830 req-458779e1-f111-4c77-8082-6dee7def8936 tempest-VolumesSnapshotsTestJSON-464415568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:52:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-4506bbe4-d833-4d38-9927-e7bbdcba58e8 req-71818d16-789f-45b4-9754-efb6baf4a709 tempest-ServerActionsTestOtherA-1015930920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.071s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:52:52 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-d6f05b6e-004b-428a-aec4-341f2ddc5830 req-458779e1-f111-4c77-8082-6dee7def8936 tempest-VolumesSnapshotsTestJSON-464415568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cc40a44-5ab4-4ccc-8cb5-038cfa40920e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c09df168-cd7c-4b2c-88d5-086748101b3b', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:52:52 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-d6f05b6e-004b-428a-aec4-341f2ddc5830 req-458779e1-f111-4c77-8082-6dee7def8936 tempest-VolumesSnapshotsTestJSON-464415568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c77c6bb-d0c3-4085-ae95-6bb0ba2ea85e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:52:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-4506bbe4-d833-4d38-9927-e7bbdcba58e8 req-71818d16-789f-45b4-9754-efb6baf4a709 tempest-ServerActionsTestOtherA-1015930920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.040s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:52:52 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [req-d6f05b6e-004b-428a-aec4-341f2ddc5830 req-458779e1-f111-4c77-8082-6dee7def8936 tempest-VolumesSnapshotsTestJSON-464415568 None] Volume volume-c09df168-cd7c-4b2c-88d5-086748101b3b (c09df168-cd7c-4b2c-88d5-086748101b3b): created successfully Sep 04 17:52:52 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-d6f05b6e-004b-428a-aec4-341f2ddc5830 req-458779e1-f111-4c77-8082-6dee7def8936 tempest-VolumesSnapshotsTestJSON-464415568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c77c6bb-d0c3-4085-ae95-6bb0ba2ea85e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:52:52 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-d6f05b6e-004b-428a-aec4-341f2ddc5830 req-458779e1-f111-4c77-8082-6dee7def8936 tempest-VolumesSnapshotsTestJSON-464415568 None] Flow 'volume_create_manager' (08c00413-7fe2-45af-8f63-5b6588b57918) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:52:52 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-d6f05b6e-004b-428a-aec4-341f2ddc5830 req-458779e1-f111-4c77-8082-6dee7def8936 tempest-VolumesSnapshotsTestJSON-464415568 None] Created volume successfully. Sep 04 17:52:52 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-4506bbe4-d833-4d38-9927-e7bbdcba58e8 req-71818d16-789f-45b4-9754-efb6baf4a709 tempest-ServerActionsTestOtherA-1015930920 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a', 'name': 'volume-c4140bdd-ea08-49d5-90d4-3f5ee64f5ea4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0cf3d643-0ce1-4a70-ab7d-f3173cb81164', 'enforce_multipath': True} {{(pid=87314) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 17:52:52 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-4506bbe4-d833-4d38-9927-e7bbdcba58e8 req-71818d16-789f-45b4-9754-efb6baf4a709 tempest-ServerActionsTestOtherA-1015930920 None] attachment_update completed successfully. Sep 04 17:52:53 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=100,cinder:UPDATE=106,cinder:INSERT=27,cinder:DELETE=6 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 17:52:53 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:UPDATE=112,cinder:SELECT=91,cinder:DELETE=13,cinder:INSERT=32 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 17:52:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-7d12628b-f447-42ba-b88d-9a4345ab63dd req-549cd971-7d0f-4549-af64-8ac4181d8bfc tempest-VolumesSnapshotsTestJSON-464415568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:52:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-7d12628b-f447-42ba-b88d-9a4345ab63dd req-549cd971-7d0f-4549-af64-8ac4181d8bfc tempest-VolumesSnapshotsTestJSON-464415568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:52:53 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [req-7d12628b-f447-42ba-b88d-9a4345ab63dd req-549cd971-7d0f-4549-af64-8ac4181d8bfc tempest-VolumesSnapshotsTestJSON-464415568 None] Creating offline snapshot 51b0ad71-8a4d-48ac-9284-a746f10e2209 of volume c09df168-cd7c-4b2c-88d5-086748101b3b {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 17:52:53 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf0af20-8889-4b01-b3e6-e553bbb7b9f3]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:52:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-7d12628b-f447-42ba-b88d-9a4345ab63dd req-549cd971-7d0f-4549-af64-8ac4181d8bfc tempest-VolumesSnapshotsTestJSON-464415568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c09df168-cd7c-4b2c-88d5-086748101b3b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:53 devstack sudo[92806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c09df168-cd7c-4b2c-88d5-086748101b3b Sep 04 17:52:53 devstack sudo[92806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:54 devstack sudo[92806]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-7d12628b-f447-42ba-b88d-9a4345ab63dd req-549cd971-7d0f-4549-af64-8ac4181d8bfc tempest-VolumesSnapshotsTestJSON-464415568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c09df168-cd7c-4b2c-88d5-086748101b3b" returned: 0 in 0.759s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:52:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-7d12628b-f447-42ba-b88d-9a4345ab63dd req-549cd971-7d0f-4549-af64-8ac4181d8bfc tempest-VolumesSnapshotsTestJSON-464415568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c09df168-cd7c-4b2c-88d5-086748101b3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c09df168-cd7c-4b2c-88d5-086748101b3b.51b0ad71-8a4d-48ac-9284-a746f10e2209 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:54 devstack sudo[92811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c09df168-cd7c-4b2c-88d5-086748101b3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c09df168-cd7c-4b2c-88d5-086748101b3b.51b0ad71-8a4d-48ac-9284-a746f10e2209 1G Sep 04 17:52:54 devstack sudo[92811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:55 devstack sudo[92811]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-7d12628b-f447-42ba-b88d-9a4345ab63dd req-549cd971-7d0f-4549-af64-8ac4181d8bfc tempest-VolumesSnapshotsTestJSON-464415568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c09df168-cd7c-4b2c-88d5-086748101b3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c09df168-cd7c-4b2c-88d5-086748101b3b.51b0ad71-8a4d-48ac-9284-a746f10e2209 1G" returned: 0 in 0.530s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:52:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-7d12628b-f447-42ba-b88d-9a4345ab63dd req-549cd971-7d0f-4549-af64-8ac4181d8bfc tempest-VolumesSnapshotsTestJSON-464415568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c09df168-cd7c-4b2c-88d5-086748101b3b -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c09df168-cd7c-4b2c-88d5-086748101b3b.51b0ad71-8a4d-48ac-9284-a746f10e2209 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:55 devstack sudo[92817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c09df168-cd7c-4b2c-88d5-086748101b3b -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c09df168-cd7c-4b2c-88d5-086748101b3b.51b0ad71-8a4d-48ac-9284-a746f10e2209 Sep 04 17:52:55 devstack sudo[92817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:55 devstack sudo[92817]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-7d12628b-f447-42ba-b88d-9a4345ab63dd req-549cd971-7d0f-4549-af64-8ac4181d8bfc tempest-VolumesSnapshotsTestJSON-464415568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c09df168-cd7c-4b2c-88d5-086748101b3b -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c09df168-cd7c-4b2c-88d5-086748101b3b.51b0ad71-8a4d-48ac-9284-a746f10e2209" returned: 0 in 0.398s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:52:55 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [req-7d12628b-f447-42ba-b88d-9a4345ab63dd req-549cd971-7d0f-4549-af64-8ac4181d8bfc tempest-VolumesSnapshotsTestJSON-464415568 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c09df168-cd7c-4b2c-88d5-086748101b3b.51b0ad71-8a4d-48ac-9284-a746f10e2209 is being set with open permissions: ugo+rw Sep 04 17:52:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-7d12628b-f447-42ba-b88d-9a4345ab63dd req-549cd971-7d0f-4549-af64-8ac4181d8bfc tempest-VolumesSnapshotsTestJSON-464415568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c09df168-cd7c-4b2c-88d5-086748101b3b.51b0ad71-8a4d-48ac-9284-a746f10e2209 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:55 devstack sudo[92823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c09df168-cd7c-4b2c-88d5-086748101b3b.51b0ad71-8a4d-48ac-9284-a746f10e2209 Sep 04 17:52:55 devstack sudo[92823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:55 devstack sudo[92823]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-7d12628b-f447-42ba-b88d-9a4345ab63dd req-549cd971-7d0f-4549-af64-8ac4181d8bfc tempest-VolumesSnapshotsTestJSON-464415568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c09df168-cd7c-4b2c-88d5-086748101b3b.51b0ad71-8a4d-48ac-9284-a746f10e2209" returned: 0 in 0.484s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:52:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-7d12628b-f447-42ba-b88d-9a4345ab63dd req-549cd971-7d0f-4549-af64-8ac4181d8bfc tempest-VolumesSnapshotsTestJSON-464415568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c09df168-cd7c-4b2c-88d5-086748101b3b.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:56 devstack sudo[92828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c09df168-cd7c-4b2c-88d5-086748101b3b.info Sep 04 17:52:56 devstack sudo[92828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:56 devstack sudo[92828]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-7d12628b-f447-42ba-b88d-9a4345ab63dd req-549cd971-7d0f-4549-af64-8ac4181d8bfc tempest-VolumesSnapshotsTestJSON-464415568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c09df168-cd7c-4b2c-88d5-086748101b3b.info" returned: 0 in 0.319s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:52:56 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [req-7d12628b-f447-42ba-b88d-9a4345ab63dd req-549cd971-7d0f-4549-af64-8ac4181d8bfc tempest-VolumesSnapshotsTestJSON-464415568 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c09df168-cd7c-4b2c-88d5-086748101b3b.info is being set with open permissions: ugo+rw Sep 04 17:52:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-7d12628b-f447-42ba-b88d-9a4345ab63dd req-549cd971-7d0f-4549-af64-8ac4181d8bfc tempest-VolumesSnapshotsTestJSON-464415568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c09df168-cd7c-4b2c-88d5-086748101b3b.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:56 devstack sudo[92837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c09df168-cd7c-4b2c-88d5-086748101b3b.info Sep 04 17:52:56 devstack sudo[92837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:56 devstack sudo[92837]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-7d12628b-f447-42ba-b88d-9a4345ab63dd req-549cd971-7d0f-4549-af64-8ac4181d8bfc tempest-VolumesSnapshotsTestJSON-464415568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c09df168-cd7c-4b2c-88d5-086748101b3b.info" returned: 0 in 0.364s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:52:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-7d12628b-f447-42ba-b88d-9a4345ab63dd req-549cd971-7d0f-4549-af64-8ac4181d8bfc tempest-VolumesSnapshotsTestJSON-464415568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.993s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:52:56 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-1c6aeab8-6416-468d-9118-8011e7ebbde6 req-fc78a166-7b37-44c2-944b-97491f9f0f45 tempest-ServerActionsTestOtherA-1015930920 None] Terminate volume connection completed successfully. Sep 04 17:52:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-1c6aeab8-6416-468d-9118-8011e7ebbde6 req-fc78a166-7b37-44c2-944b-97491f9f0f45 tempest-ServerActionsTestOtherA-1015930920 None] Deleting attachment 0cf3d643-0ce1-4a70-ab7d-f3173cb81164. {{(pid=87314) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 17:52:56 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-7d12628b-f447-42ba-b88d-9a4345ab63dd req-549cd971-7d0f-4549-af64-8ac4181d8bfc tempest-VolumesSnapshotsTestJSON-464415568 None] Create snapshot completed successfully Sep 04 17:52:57 devstack cinder-volume[87314]: DEBUG cinder.coordination [req-51596da9-7174-4f8b-b065-927ed9925edf req-b75b5f6d-028d-4356-a71b-3beb6547d976 tempest-VolumesSnapshotsTestJSON-464415568 None] Acquiring lock "cinder-51b0ad71-8a4d-48ac-9284-a746f10e2209-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:52:57 devstack cinder-volume[87314]: DEBUG cinder.coordination [req-51596da9-7174-4f8b-b065-927ed9925edf req-b75b5f6d-028d-4356-a71b-3beb6547d976 tempest-VolumesSnapshotsTestJSON-464415568 None] Lock "cinder-51b0ad71-8a4d-48ac-9284-a746f10e2209-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:52:57 devstack cinder-volume[87314]: DEBUG cinder.coordination [req-51596da9-7174-4f8b-b065-927ed9925edf req-b75b5f6d-028d-4356-a71b-3beb6547d976 tempest-VolumesSnapshotsTestJSON-464415568 None] Acquiring lock "cinder-quobyte-c09df168-cd7c-4b2c-88d5-086748101b3b" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:52:57 devstack cinder-volume[87314]: DEBUG cinder.coordination [req-51596da9-7174-4f8b-b065-927ed9925edf req-b75b5f6d-028d-4356-a71b-3beb6547d976 tempest-VolumesSnapshotsTestJSON-464415568 None] Lock "cinder-quobyte-c09df168-cd7c-4b2c-88d5-086748101b3b" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:52:57 devstack cinder-volume[87314]: DEBUG cinder.coordination [req-51596da9-7174-4f8b-b065-927ed9925edf req-b75b5f6d-028d-4356-a71b-3beb6547d976 tempest-VolumesSnapshotsTestJSON-464415568 None] Acquiring lock "cinder-quobyte-51b0ad71-8a4d-48ac-9284-a746f10e2209" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:52:57 devstack cinder-volume[87314]: DEBUG cinder.coordination [req-51596da9-7174-4f8b-b065-927ed9925edf req-b75b5f6d-028d-4356-a71b-3beb6547d976 tempest-VolumesSnapshotsTestJSON-464415568 None] Lock "cinder-quobyte-51b0ad71-8a4d-48ac-9284-a746f10e2209" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:52:57 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [req-51596da9-7174-4f8b-b065-927ed9925edf req-b75b5f6d-028d-4356-a71b-3beb6547d976 tempest-VolumesSnapshotsTestJSON-464415568 None] Deleting offline snapshot 51b0ad71-8a4d-48ac-9284-a746f10e2209 of volume c09df168-cd7c-4b2c-88d5-086748101b3b {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 17:52:57 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [req-51596da9-7174-4f8b-b065-927ed9925edf req-b75b5f6d-028d-4356-a71b-3beb6547d976 tempest-VolumesSnapshotsTestJSON-464415568 None] snapshot_file for this snap is: volume-c09df168-cd7c-4b2c-88d5-086748101b3b.51b0ad71-8a4d-48ac-9284-a746f10e2209 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 17:52:57 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3947a38-63a9-464f-aa04-d1ff6055762b]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:52:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-51596da9-7174-4f8b-b065-927ed9925edf req-b75b5f6d-028d-4356-a71b-3beb6547d976 tempest-VolumesSnapshotsTestJSON-464415568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c09df168-cd7c-4b2c-88d5-086748101b3b.51b0ad71-8a4d-48ac-9284-a746f10e2209 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-1c6aeab8-6416-468d-9118-8011e7ebbde6 req-3a4c26e1-9a22-4e4a-bc76-1afc1930c390 tempest-ServerActionsTestOtherA-1015930920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:52:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-1c6aeab8-6416-468d-9118-8011e7ebbde6 req-3a4c26e1-9a22-4e4a-bc76-1afc1930c390 tempest-ServerActionsTestOtherA-1015930920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:52:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-1c6aeab8-6416-468d-9118-8011e7ebbde6 req-3a4c26e1-9a22-4e4a-bc76-1afc1930c390 tempest-ServerActionsTestOtherA-1015930920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:52:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-1c6aeab8-6416-468d-9118-8011e7ebbde6 req-3a4c26e1-9a22-4e4a-bc76-1afc1930c390 tempest-ServerActionsTestOtherA-1015930920 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a', 'name': 'volume-c4140bdd-ea08-49d5-90d4-3f5ee64f5ea4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '087fc336-a2cc-48b6-842b-7dbdecf2067e', 'enforce_multipath': True} {{(pid=87314) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 17:52:58 devstack sudo[92895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c09df168-cd7c-4b2c-88d5-086748101b3b.51b0ad71-8a4d-48ac-9284-a746f10e2209 Sep 04 17:52:58 devstack sudo[92895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:58 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-1c6aeab8-6416-468d-9118-8011e7ebbde6 req-3a4c26e1-9a22-4e4a-bc76-1afc1930c390 tempest-ServerActionsTestOtherA-1015930920 None] attachment_update completed successfully. Sep 04 17:52:58 devstack sudo[92895]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-51596da9-7174-4f8b-b065-927ed9925edf req-b75b5f6d-028d-4356-a71b-3beb6547d976 tempest-VolumesSnapshotsTestJSON-464415568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c09df168-cd7c-4b2c-88d5-086748101b3b.51b0ad71-8a4d-48ac-9284-a746f10e2209" returned: 0 in 0.506s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:52:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [req-51596da9-7174-4f8b-b065-927ed9925edf req-b75b5f6d-028d-4356-a71b-3beb6547d976 tempest-VolumesSnapshotsTestJSON-464415568 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c09df168-cd7c-4b2c-88d5-086748101b3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 17:52:58 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18f6aad-3b30-4eb3-b53b-11ce7e02a7f2]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:52:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-51596da9-7174-4f8b-b065-927ed9925edf req-b75b5f6d-028d-4356-a71b-3beb6547d976 tempest-VolumesSnapshotsTestJSON-464415568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c09df168-cd7c-4b2c-88d5-086748101b3b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:58 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0d17286-e275-4136-8e51-e5404614297f tempest-VolumesCloneNegativeTest-1025585763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:52:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a0d17286-e275-4136-8e51-e5404614297f tempest-VolumesCloneNegativeTest-1025585763 None] Flow 'volume_create_manager' (b9bad292-249a-4c24-a62d-ade97ade1e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:52:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a0d17286-e275-4136-8e51-e5404614297f tempest-VolumesCloneNegativeTest-1025585763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f25717b-4010-4af9-9c25-ae593bcf2298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:52:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a0d17286-e275-4136-8e51-e5404614297f tempest-VolumesCloneNegativeTest-1025585763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f25717b-4010-4af9-9c25-ae593bcf2298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:52:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1700312312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25a68efb-e8a8-425e-ba73-37ff026a5705,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='507e73a0a22a4a8c802ce9d4ce7a68f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:52:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:52:59Z,use_quota=True,user_id='9fc3064add15446c8bd0db5bb19aed97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:52:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a0d17286-e275-4136-8e51-e5404614297f tempest-VolumesCloneNegativeTest-1025585763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ec165e9-440e-480a-b318-6d6d726c3620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:52:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a0d17286-e275-4136-8e51-e5404614297f tempest-VolumesCloneNegativeTest-1025585763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ec165e9-440e-480a-b318-6d6d726c3620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:52:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a0d17286-e275-4136-8e51-e5404614297f tempest-VolumesCloneNegativeTest-1025585763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (815406ad-d14d-489f-9ebf-adfe5e400bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:52:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a0d17286-e275-4136-8e51-e5404614297f tempest-VolumesCloneNegativeTest-1025585763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (815406ad-d14d-489f-9ebf-adfe5e400bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25a68efb-e8a8-425e-ba73-37ff026a5705', 'volume_name': 'volume-25a68efb-e8a8-425e-ba73-37ff026a5705', 'volume_size': 2}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:52:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a0d17286-e275-4136-8e51-e5404614297f tempest-VolumesCloneNegativeTest-1025585763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3efa6260-9841-494e-a780-8c0c2b3ebed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:52:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a0d17286-e275-4136-8e51-e5404614297f tempest-VolumesCloneNegativeTest-1025585763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3efa6260-9841-494e-a780-8c0c2b3ebed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:52:58 devstack sudo[92901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c09df168-cd7c-4b2c-88d5-086748101b3b Sep 04 17:52:58 devstack sudo[92901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a0d17286-e275-4136-8e51-e5404614297f tempest-VolumesCloneNegativeTest-1025585763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1ea6b46-5ef5-4db1-8c60-2c620b4c1475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:52:58 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-a0d17286-e275-4136-8e51-e5404614297f tempest-VolumesCloneNegativeTest-1025585763 None] Volume 25a68efb-e8a8-425e-ba73-37ff026a5705: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25a68efb-e8a8-425e-ba73-37ff026a5705', 'volume_size': 2} Sep 04 17:52:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a0d17286-e275-4136-8e51-e5404614297f tempest-VolumesCloneNegativeTest-1025585763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:52:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a0d17286-e275-4136-8e51-e5404614297f tempest-VolumesCloneNegativeTest-1025585763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:52:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a0d17286-e275-4136-8e51-e5404614297f tempest-VolumesCloneNegativeTest-1025585763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:52:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1700312312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25a68efb-e8a8-425e-ba73-37ff026a5705,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='507e73a0a22a4a8c802ce9d4ce7a68f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:52:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:52:59Z,use_quota=True,user_id='9fc3064add15446c8bd0db5bb19aed97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:52:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-a0d17286-e275-4136-8e51-e5404614297f tempest-VolumesCloneNegativeTest-1025585763 None] Creating volume 25a68efb-e8a8-425e-ba73-37ff026a5705 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:52:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a0d17286-e275-4136-8e51-e5404614297f tempest-VolumesCloneNegativeTest-1025585763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:52:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a0d17286-e275-4136-8e51-e5404614297f tempest-VolumesCloneNegativeTest-1025585763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:52:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a0d17286-e275-4136-8e51-e5404614297f tempest-VolumesCloneNegativeTest-1025585763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:52:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a0d17286-e275-4136-8e51-e5404614297f tempest-VolumesCloneNegativeTest-1025585763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:52:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a0d17286-e275-4136-8e51-e5404614297f tempest-VolumesCloneNegativeTest-1025585763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:52:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a0d17286-e275-4136-8e51-e5404614297f tempest-VolumesCloneNegativeTest-1025585763 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:52:58 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-a0d17286-e275-4136-8e51-e5404614297f tempest-VolumesCloneNegativeTest-1025585763 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:52:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a0d17286-e275-4136-8e51-e5404614297f tempest-VolumesCloneNegativeTest-1025585763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-25a68efb-e8a8-425e-ba73-37ff026a5705 2147483648 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:58 devstack sudo[92906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-25a68efb-e8a8-425e-ba73-37ff026a5705 2147483648 Sep 04 17:52:58 devstack sudo[92906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:59 devstack sudo[92901]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-51596da9-7174-4f8b-b065-927ed9925edf req-b75b5f6d-028d-4356-a71b-3beb6547d976 tempest-VolumesSnapshotsTestJSON-464415568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c09df168-cd7c-4b2c-88d5-086748101b3b" returned: 0 in 0.553s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:52:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-51596da9-7174-4f8b-b065-927ed9925edf req-b75b5f6d-028d-4356-a71b-3beb6547d976 tempest-VolumesSnapshotsTestJSON-464415568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c09df168-cd7c-4b2c-88d5-086748101b3b.51b0ad71-8a4d-48ac-9284-a746f10e2209 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:59 devstack sudo[92920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c09df168-cd7c-4b2c-88d5-086748101b3b.51b0ad71-8a4d-48ac-9284-a746f10e2209 Sep 04 17:52:59 devstack sudo[92920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:59 devstack sudo[92906]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a0d17286-e275-4136-8e51-e5404614297f tempest-VolumesCloneNegativeTest-1025585763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-25a68efb-e8a8-425e-ba73-37ff026a5705 2147483648" returned: 0 in 0.594s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:52:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a0d17286-e275-4136-8e51-e5404614297f tempest-VolumesCloneNegativeTest-1025585763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-25a68efb-e8a8-425e-ba73-37ff026a5705 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:59 devstack sudo[92942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-25a68efb-e8a8-425e-ba73-37ff026a5705 Sep 04 17:52:59 devstack sudo[92942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:59 devstack sudo[92920]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-51596da9-7174-4f8b-b065-927ed9925edf req-b75b5f6d-028d-4356-a71b-3beb6547d976 tempest-VolumesSnapshotsTestJSON-464415568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c09df168-cd7c-4b2c-88d5-086748101b3b.51b0ad71-8a4d-48ac-9284-a746f10e2209" returned: 0 in 0.437s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:52:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-51596da9-7174-4f8b-b065-927ed9925edf req-b75b5f6d-028d-4356-a71b-3beb6547d976 tempest-VolumesSnapshotsTestJSON-464415568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c09df168-cd7c-4b2c-88d5-086748101b3b.51b0ad71-8a4d-48ac-9284-a746f10e2209 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:52:59 devstack sudo[92944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c09df168-cd7c-4b2c-88d5-086748101b3b.51b0ad71-8a4d-48ac-9284-a746f10e2209 Sep 04 17:52:59 devstack sudo[92944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:52:59 devstack sudo[92942]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a0d17286-e275-4136-8e51-e5404614297f tempest-VolumesCloneNegativeTest-1025585763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-25a68efb-e8a8-425e-ba73-37ff026a5705" returned: 0 in 0.348s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:52:59 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a0d17286-e275-4136-8e51-e5404614297f tempest-VolumesCloneNegativeTest-1025585763 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:52:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a0d17286-e275-4136-8e51-e5404614297f tempest-VolumesCloneNegativeTest-1025585763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:52:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a0d17286-e275-4136-8e51-e5404614297f tempest-VolumesCloneNegativeTest-1025585763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1ea6b46-5ef5-4db1-8c60-2c620b4c1475) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25a68efb-e8a8-425e-ba73-37ff026a5705', 'volume_size': 2}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:52:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a0d17286-e275-4136-8e51-e5404614297f tempest-VolumesCloneNegativeTest-1025585763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (468948d1-b7ca-403c-8759-06fad4f0425c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:52:59 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-a0d17286-e275-4136-8e51-e5404614297f tempest-VolumesCloneNegativeTest-1025585763 None] Volume volume-25a68efb-e8a8-425e-ba73-37ff026a5705 (25a68efb-e8a8-425e-ba73-37ff026a5705): created successfully Sep 04 17:52:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a0d17286-e275-4136-8e51-e5404614297f tempest-VolumesCloneNegativeTest-1025585763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (468948d1-b7ca-403c-8759-06fad4f0425c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:52:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a0d17286-e275-4136-8e51-e5404614297f tempest-VolumesCloneNegativeTest-1025585763 None] Flow 'volume_create_manager' (b9bad292-249a-4c24-a62d-ade97ade1e43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:52:59 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-a0d17286-e275-4136-8e51-e5404614297f tempest-VolumesCloneNegativeTest-1025585763 None] Created volume successfully. Sep 04 17:52:59 devstack sudo[92944]: pam_unix(sudo:session): session closed for user root Sep 04 17:52:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-51596da9-7174-4f8b-b065-927ed9925edf req-b75b5f6d-028d-4356-a71b-3beb6547d976 tempest-VolumesSnapshotsTestJSON-464415568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c09df168-cd7c-4b2c-88d5-086748101b3b.51b0ad71-8a4d-48ac-9284-a746f10e2209" returned: 0 in 0.388s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:53:00 devstack cinder-volume[87314]: DEBUG cinder.coordination [req-51596da9-7174-4f8b-b065-927ed9925edf req-b75b5f6d-028d-4356-a71b-3beb6547d976 tempest-VolumesSnapshotsTestJSON-464415568 None] Lock "cinder-quobyte-51b0ad71-8a4d-48ac-9284-a746f10e2209" released by "_delete_snapshot" :: held 2.169s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:53:00 devstack cinder-volume[87314]: DEBUG cinder.coordination [req-51596da9-7174-4f8b-b065-927ed9925edf req-b75b5f6d-028d-4356-a71b-3beb6547d976 tempest-VolumesSnapshotsTestJSON-464415568 None] Lock "cinder-quobyte-c09df168-cd7c-4b2c-88d5-086748101b3b" released by "delete_snapshot" :: held 2.242s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:53:00 devstack cinder-volume[87314]: WARNING cinder.quota [req-51596da9-7174-4f8b-b065-927ed9925edf req-b75b5f6d-028d-4356-a71b-3beb6547d976 tempest-VolumesSnapshotsTestJSON-464415568 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 04 17:53:00 devstack cinder-volume[87314]: DEBUG cinder.quota [req-51596da9-7174-4f8b-b065-927ed9925edf req-b75b5f6d-028d-4356-a71b-3beb6547d976 tempest-VolumesSnapshotsTestJSON-464415568 None] Created reservations ['02a7eb3f-0644-4a8e-943f-91c4ef18a2a9', '7513b8b5-9c0c-49a4-9b0c-cfec65ca4cac', '706e0272-c5b0-4734-ba45-57889d4bdda6', '6ced39c5-1e01-4156-975b-8c84a660596e'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:53:00 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-51596da9-7174-4f8b-b065-927ed9925edf req-b75b5f6d-028d-4356-a71b-3beb6547d976 tempest-VolumesSnapshotsTestJSON-464415568 None] Delete snapshot completed successfully. Sep 04 17:53:00 devstack cinder-volume[87314]: DEBUG cinder.coordination [req-51596da9-7174-4f8b-b065-927ed9925edf req-b75b5f6d-028d-4356-a71b-3beb6547d976 tempest-VolumesSnapshotsTestJSON-464415568 None] Lock "cinder-51b0ad71-8a4d-48ac-9284-a746f10e2209-delete_snapshot" released by "delete_snapshot" :: held 2.630s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:53:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-246f7619-e7dd-495f-801d-94943787f004 tempest-VolumesCloneNegativeTest-1025585763 None] Acquiring lock "cinder-25a68efb-e8a8-425e-ba73-37ff026a5705-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:53:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-246f7619-e7dd-495f-801d-94943787f004 tempest-VolumesCloneNegativeTest-1025585763 None] Lock "cinder-25a68efb-e8a8-425e-ba73-37ff026a5705-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:53:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-246f7619-e7dd-495f-801d-94943787f004 tempest-VolumesCloneNegativeTest-1025585763 None] Acquiring lock "cinder-quobyte-25a68efb-e8a8-425e-ba73-37ff026a5705" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:53:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-246f7619-e7dd-495f-801d-94943787f004 tempest-VolumesCloneNegativeTest-1025585763 None] Lock "cinder-quobyte-25a68efb-e8a8-425e-ba73-37ff026a5705" acquired by "delete_volume" :: waited 0.041s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:53:01 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a87a3b2-fcff-40d9-9c94-cdaefce69f47]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:53:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-246f7619-e7dd-495f-801d-94943787f004 tempest-VolumesCloneNegativeTest-1025585763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-25a68efb-e8a8-425e-ba73-37ff026a5705 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:53:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [req-b5b96db1-ba14-4301-b7c2-02d556f818ee req-88af027a-be82-4ee5-a3ed-42da639b1c68 tempest-VolumesSnapshotsTestJSON-464415568 None] Acquiring lock "cinder-c09df168-cd7c-4b2c-88d5-086748101b3b-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:53:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [req-b5b96db1-ba14-4301-b7c2-02d556f818ee req-88af027a-be82-4ee5-a3ed-42da639b1c68 tempest-VolumesSnapshotsTestJSON-464415568 None] Lock "cinder-c09df168-cd7c-4b2c-88d5-086748101b3b-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:53:01 devstack sudo[93370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-25a68efb-e8a8-425e-ba73-37ff026a5705 Sep 04 17:53:01 devstack sudo[93370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:53:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [req-b5b96db1-ba14-4301-b7c2-02d556f818ee req-88af027a-be82-4ee5-a3ed-42da639b1c68 tempest-VolumesSnapshotsTestJSON-464415568 None] Acquiring lock "cinder-quobyte-c09df168-cd7c-4b2c-88d5-086748101b3b" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:53:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [req-b5b96db1-ba14-4301-b7c2-02d556f818ee req-88af027a-be82-4ee5-a3ed-42da639b1c68 tempest-VolumesSnapshotsTestJSON-464415568 None] Lock "cinder-quobyte-c09df168-cd7c-4b2c-88d5-086748101b3b" acquired by "delete_volume" :: waited 0.044s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:53:01 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[04239ebb-22a7-485d-a9e9-e2e1cc73bb35]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:53:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-b5b96db1-ba14-4301-b7c2-02d556f818ee req-88af027a-be82-4ee5-a3ed-42da639b1c68 tempest-VolumesSnapshotsTestJSON-464415568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c09df168-cd7c-4b2c-88d5-086748101b3b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:53:02 devstack sudo[93381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c09df168-cd7c-4b2c-88d5-086748101b3b Sep 04 17:53:02 devstack sudo[93381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:53:02 devstack sudo[93370]: pam_unix(sudo:session): session closed for user root Sep 04 17:53:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-246f7619-e7dd-495f-801d-94943787f004 tempest-VolumesCloneNegativeTest-1025585763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-25a68efb-e8a8-425e-ba73-37ff026a5705" returned: 0 in 1.180s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:53:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-246f7619-e7dd-495f-801d-94943787f004 tempest-VolumesCloneNegativeTest-1025585763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-25a68efb-e8a8-425e-ba73-37ff026a5705 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:53:02 devstack sudo[93441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-25a68efb-e8a8-425e-ba73-37ff026a5705 Sep 04 17:53:02 devstack sudo[93441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:53:02 devstack sudo[93381]: pam_unix(sudo:session): session closed for user root Sep 04 17:53:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-b5b96db1-ba14-4301-b7c2-02d556f818ee req-88af027a-be82-4ee5-a3ed-42da639b1c68 tempest-VolumesSnapshotsTestJSON-464415568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c09df168-cd7c-4b2c-88d5-086748101b3b" returned: 0 in 0.772s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:53:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-b5b96db1-ba14-4301-b7c2-02d556f818ee req-88af027a-be82-4ee5-a3ed-42da639b1c68 tempest-VolumesSnapshotsTestJSON-464415568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c09df168-cd7c-4b2c-88d5-086748101b3b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:53:02 devstack sudo[93449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c09df168-cd7c-4b2c-88d5-086748101b3b Sep 04 17:53:02 devstack sudo[93449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:53:03 devstack sudo[93441]: pam_unix(sudo:session): session closed for user root Sep 04 17:53:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-246f7619-e7dd-495f-801d-94943787f004 tempest-VolumesCloneNegativeTest-1025585763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-25a68efb-e8a8-425e-ba73-37ff026a5705" returned: 0 in 0.568s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:53:03 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-246f7619-e7dd-495f-801d-94943787f004 tempest-VolumesCloneNegativeTest-1025585763 None] Lock "cinder-quobyte-25a68efb-e8a8-425e-ba73-37ff026a5705" released by "delete_volume" :: held 1.848s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:53:03 devstack sudo[93449]: pam_unix(sudo:session): session closed for user root Sep 04 17:53:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-b5b96db1-ba14-4301-b7c2-02d556f818ee req-88af027a-be82-4ee5-a3ed-42da639b1c68 tempest-VolumesSnapshotsTestJSON-464415568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c09df168-cd7c-4b2c-88d5-086748101b3b" returned: 0 in 0.459s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:53:03 devstack cinder-volume[87314]: DEBUG cinder.coordination [req-b5b96db1-ba14-4301-b7c2-02d556f818ee req-88af027a-be82-4ee5-a3ed-42da639b1c68 tempest-VolumesSnapshotsTestJSON-464415568 None] Lock "cinder-quobyte-c09df168-cd7c-4b2c-88d5-086748101b3b" released by "delete_volume" :: held 1.364s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:53:03 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-246f7619-e7dd-495f-801d-94943787f004 tempest-VolumesCloneNegativeTest-1025585763 None] Created reservations ['c9b7b0e2-35d7-4c60-9ca3-dda286e84b04', '851fb5f4-26be-4d68-9cec-33fad110f7d6', '6a343ea2-2312-453e-920c-072ec1115414', '152c521b-a0b7-47ea-921b-ba56d26016d9'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:53:03 devstack cinder-volume[87314]: DEBUG cinder.quota [req-b5b96db1-ba14-4301-b7c2-02d556f818ee req-88af027a-be82-4ee5-a3ed-42da639b1c68 tempest-VolumesSnapshotsTestJSON-464415568 None] Created reservations ['75ba1eee-774c-48b7-ba0f-e453384fc8c0', '7bb451c4-1eff-43ca-9581-d2260d84dd0e', '72246103-a8da-431e-a7d3-1aae0db942bf', '64d1fb8b-3269-4cdf-9014-41c8fb30db85'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:53:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-246f7619-e7dd-495f-801d-94943787f004 tempest-VolumesCloneNegativeTest-1025585763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:53:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-246f7619-e7dd-495f-801d-94943787f004 tempest-VolumesCloneNegativeTest-1025585763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:53:03 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-246f7619-e7dd-495f-801d-94943787f004 tempest-VolumesCloneNegativeTest-1025585763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:53:03 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-246f7619-e7dd-495f-801d-94943787f004 tempest-VolumesCloneNegativeTest-1025585763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:53:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-246f7619-e7dd-495f-801d-94943787f004 tempest-VolumesCloneNegativeTest-1025585763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:53:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-246f7619-e7dd-495f-801d-94943787f004 tempest-VolumesCloneNegativeTest-1025585763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:53:03 devstack sudo[93458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:53:03 devstack sudo[93458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:53:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-b5b96db1-ba14-4301-b7c2-02d556f818ee req-88af027a-be82-4ee5-a3ed-42da639b1c68 tempest-VolumesSnapshotsTestJSON-464415568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:53:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-b5b96db1-ba14-4301-b7c2-02d556f818ee req-88af027a-be82-4ee5-a3ed-42da639b1c68 tempest-VolumesSnapshotsTestJSON-464415568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:53:03 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [req-b5b96db1-ba14-4301-b7c2-02d556f818ee req-88af027a-be82-4ee5-a3ed-42da639b1c68 tempest-VolumesSnapshotsTestJSON-464415568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:53:03 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [req-b5b96db1-ba14-4301-b7c2-02d556f818ee req-88af027a-be82-4ee5-a3ed-42da639b1c68 tempest-VolumesSnapshotsTestJSON-464415568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:53:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-b5b96db1-ba14-4301-b7c2-02d556f818ee req-88af027a-be82-4ee5-a3ed-42da639b1c68 tempest-VolumesSnapshotsTestJSON-464415568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:53:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-b5b96db1-ba14-4301-b7c2-02d556f818ee req-88af027a-be82-4ee5-a3ed-42da639b1c68 tempest-VolumesSnapshotsTestJSON-464415568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:53:03 devstack sudo[93460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:53:03 devstack sudo[93460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:53:03 devstack sudo[93458]: pam_unix(sudo:session): session closed for user root Sep 04 17:53:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-246f7619-e7dd-495f-801d-94943787f004 tempest-VolumesCloneNegativeTest-1025585763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.409s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:53:03 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-246f7619-e7dd-495f-801d-94943787f004 tempest-VolumesCloneNegativeTest-1025585763 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:53:03 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-246f7619-e7dd-495f-801d-94943787f004 tempest-VolumesCloneNegativeTest-1025585763 None] Deleted volume successfully. Sep 04 17:53:03 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-246f7619-e7dd-495f-801d-94943787f004 tempest-VolumesCloneNegativeTest-1025585763 None] Lock "cinder-25a68efb-e8a8-425e-ba73-37ff026a5705-delete_volume" released by "delete_volume" :: held 2.802s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:53:04 devstack sudo[93460]: pam_unix(sudo:session): session closed for user root Sep 04 17:53:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-b5b96db1-ba14-4301-b7c2-02d556f818ee req-88af027a-be82-4ee5-a3ed-42da639b1c68 tempest-VolumesSnapshotsTestJSON-464415568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.486s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:53:04 devstack cinder-volume[87314]: DEBUG cinder.manager [req-b5b96db1-ba14-4301-b7c2-02d556f818ee req-88af027a-be82-4ee5-a3ed-42da639b1c68 tempest-VolumesSnapshotsTestJSON-464415568 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:53:04 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-b5b96db1-ba14-4301-b7c2-02d556f818ee req-88af027a-be82-4ee5-a3ed-42da639b1c68 tempest-VolumesSnapshotsTestJSON-464415568 None] Deleted volume successfully. Sep 04 17:53:04 devstack cinder-volume[87314]: DEBUG cinder.coordination [req-b5b96db1-ba14-4301-b7c2-02d556f818ee req-88af027a-be82-4ee5-a3ed-42da639b1c68 tempest-VolumesSnapshotsTestJSON-464415568 None] Lock "cinder-c09df168-cd7c-4b2c-88d5-086748101b3b-delete_volume" released by "delete_volume" :: held 2.423s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:53:08 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [req-2280fda2-7f0c-448f-a779-f4e15de2c2e8 req-e9c0f789-c200-4454-ba2c-cf41d6f441b2 tempest-VolumesGetTestJSON-1748651627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:53:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-2280fda2-7f0c-448f-a779-f4e15de2c2e8 req-e9c0f789-c200-4454-ba2c-cf41d6f441b2 tempest-VolumesGetTestJSON-1748651627 None] Flow 'volume_create_manager' (3e65d85b-c2d4-471d-92b5-8c8e615c62d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:53:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-2280fda2-7f0c-448f-a779-f4e15de2c2e8 req-e9c0f789-c200-4454-ba2c-cf41d6f441b2 tempest-VolumesGetTestJSON-1748651627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4669f3e5-ccd2-4abf-befd-73f27af13d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:53:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-2280fda2-7f0c-448f-a779-f4e15de2c2e8 req-e9c0f789-c200-4454-ba2c-cf41d6f441b2 tempest-VolumesGetTestJSON-1748651627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4669f3e5-ccd2-4abf-befd-73f27af13d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:53:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1710715804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=529f2979-479a-4d93-9c92-56d9c1df7fe3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6bc36a52282a441d8786c306885aadcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:53:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:53:09Z,use_quota=True,user_id='798f8078ae4944278bb4863efea3b1cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:53:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-2280fda2-7f0c-448f-a779-f4e15de2c2e8 req-e9c0f789-c200-4454-ba2c-cf41d6f441b2 tempest-VolumesGetTestJSON-1748651627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39d2b3da-4bc5-4709-9be5-b6b70e084c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:53:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-2280fda2-7f0c-448f-a779-f4e15de2c2e8 req-e9c0f789-c200-4454-ba2c-cf41d6f441b2 tempest-VolumesGetTestJSON-1748651627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39d2b3da-4bc5-4709-9be5-b6b70e084c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:53:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-2280fda2-7f0c-448f-a779-f4e15de2c2e8 req-e9c0f789-c200-4454-ba2c-cf41d6f441b2 tempest-VolumesGetTestJSON-1748651627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94924145-89bb-4a92-8f6e-343cc8cebbf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:53:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-2280fda2-7f0c-448f-a779-f4e15de2c2e8 req-e9c0f789-c200-4454-ba2c-cf41d6f441b2 tempest-VolumesGetTestJSON-1748651627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94924145-89bb-4a92-8f6e-343cc8cebbf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '529f2979-479a-4d93-9c92-56d9c1df7fe3', 'volume_name': 'volume-529f2979-479a-4d93-9c92-56d9c1df7fe3', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:53:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-2280fda2-7f0c-448f-a779-f4e15de2c2e8 req-e9c0f789-c200-4454-ba2c-cf41d6f441b2 tempest-VolumesGetTestJSON-1748651627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9b0cca6-122e-4b99-8f77-d97ac62be1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:53:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-2280fda2-7f0c-448f-a779-f4e15de2c2e8 req-e9c0f789-c200-4454-ba2c-cf41d6f441b2 tempest-VolumesGetTestJSON-1748651627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9b0cca6-122e-4b99-8f77-d97ac62be1af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:53:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-2280fda2-7f0c-448f-a779-f4e15de2c2e8 req-e9c0f789-c200-4454-ba2c-cf41d6f441b2 tempest-VolumesGetTestJSON-1748651627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b727e537-eb2d-49d4-bb00-147f4db0b237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:53:08 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [req-2280fda2-7f0c-448f-a779-f4e15de2c2e8 req-e9c0f789-c200-4454-ba2c-cf41d6f441b2 tempest-VolumesGetTestJSON-1748651627 None] Volume 529f2979-479a-4d93-9c92-56d9c1df7fe3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-529f2979-479a-4d93-9c92-56d9c1df7fe3', 'volume_size': 1} Sep 04 17:53:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-2280fda2-7f0c-448f-a779-f4e15de2c2e8 req-e9c0f789-c200-4454-ba2c-cf41d6f441b2 tempest-VolumesGetTestJSON-1748651627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:53:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-2280fda2-7f0c-448f-a779-f4e15de2c2e8 req-e9c0f789-c200-4454-ba2c-cf41d6f441b2 tempest-VolumesGetTestJSON-1748651627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:53:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [req-2280fda2-7f0c-448f-a779-f4e15de2c2e8 req-e9c0f789-c200-4454-ba2c-cf41d6f441b2 tempest-VolumesGetTestJSON-1748651627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:53:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1710715804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=529f2979-479a-4d93-9c92-56d9c1df7fe3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6bc36a52282a441d8786c306885aadcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:53:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:53:09Z,use_quota=True,user_id='798f8078ae4944278bb4863efea3b1cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:53:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [req-2280fda2-7f0c-448f-a779-f4e15de2c2e8 req-e9c0f789-c200-4454-ba2c-cf41d6f441b2 tempest-VolumesGetTestJSON-1748651627 None] Creating volume 529f2979-479a-4d93-9c92-56d9c1df7fe3 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:53:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-2280fda2-7f0c-448f-a779-f4e15de2c2e8 req-e9c0f789-c200-4454-ba2c-cf41d6f441b2 tempest-VolumesGetTestJSON-1748651627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:53:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-2280fda2-7f0c-448f-a779-f4e15de2c2e8 req-e9c0f789-c200-4454-ba2c-cf41d6f441b2 tempest-VolumesGetTestJSON-1748651627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:53:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [req-2280fda2-7f0c-448f-a779-f4e15de2c2e8 req-e9c0f789-c200-4454-ba2c-cf41d6f441b2 tempest-VolumesGetTestJSON-1748651627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:53:09 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [req-2280fda2-7f0c-448f-a779-f4e15de2c2e8 req-e9c0f789-c200-4454-ba2c-cf41d6f441b2 tempest-VolumesGetTestJSON-1748651627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:53:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-2280fda2-7f0c-448f-a779-f4e15de2c2e8 req-e9c0f789-c200-4454-ba2c-cf41d6f441b2 tempest-VolumesGetTestJSON-1748651627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:53:09 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [req-2280fda2-7f0c-448f-a779-f4e15de2c2e8 req-e9c0f789-c200-4454-ba2c-cf41d6f441b2 tempest-VolumesGetTestJSON-1748651627 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:53:09 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [req-2280fda2-7f0c-448f-a779-f4e15de2c2e8 req-e9c0f789-c200-4454-ba2c-cf41d6f441b2 tempest-VolumesGetTestJSON-1748651627 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:53:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-2280fda2-7f0c-448f-a779-f4e15de2c2e8 req-e9c0f789-c200-4454-ba2c-cf41d6f441b2 tempest-VolumesGetTestJSON-1748651627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-529f2979-479a-4d93-9c92-56d9c1df7fe3 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:53:09 devstack sudo[93464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-529f2979-479a-4d93-9c92-56d9c1df7fe3 1073741824 Sep 04 17:53:09 devstack sudo[93464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:53:09 devstack sudo[93464]: pam_unix(sudo:session): session closed for user root Sep 04 17:53:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-2280fda2-7f0c-448f-a779-f4e15de2c2e8 req-e9c0f789-c200-4454-ba2c-cf41d6f441b2 tempest-VolumesGetTestJSON-1748651627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-529f2979-479a-4d93-9c92-56d9c1df7fe3 1073741824" returned: 0 in 0.504s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:53:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-2280fda2-7f0c-448f-a779-f4e15de2c2e8 req-e9c0f789-c200-4454-ba2c-cf41d6f441b2 tempest-VolumesGetTestJSON-1748651627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-529f2979-479a-4d93-9c92-56d9c1df7fe3 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:53:09 devstack sudo[93470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-529f2979-479a-4d93-9c92-56d9c1df7fe3 Sep 04 17:53:09 devstack sudo[93470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:53:09 devstack sudo[93470]: pam_unix(sudo:session): session closed for user root Sep 04 17:53:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-2280fda2-7f0c-448f-a779-f4e15de2c2e8 req-e9c0f789-c200-4454-ba2c-cf41d6f441b2 tempest-VolumesGetTestJSON-1748651627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-529f2979-479a-4d93-9c92-56d9c1df7fe3" returned: 0 in 0.372s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:53:09 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [req-2280fda2-7f0c-448f-a779-f4e15de2c2e8 req-e9c0f789-c200-4454-ba2c-cf41d6f441b2 tempest-VolumesGetTestJSON-1748651627 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:53:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-2280fda2-7f0c-448f-a779-f4e15de2c2e8 req-e9c0f789-c200-4454-ba2c-cf41d6f441b2 tempest-VolumesGetTestJSON-1748651627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:53:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-2280fda2-7f0c-448f-a779-f4e15de2c2e8 req-e9c0f789-c200-4454-ba2c-cf41d6f441b2 tempest-VolumesGetTestJSON-1748651627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b727e537-eb2d-49d4-bb00-147f4db0b237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-529f2979-479a-4d93-9c92-56d9c1df7fe3', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:53:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-2280fda2-7f0c-448f-a779-f4e15de2c2e8 req-e9c0f789-c200-4454-ba2c-cf41d6f441b2 tempest-VolumesGetTestJSON-1748651627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5778643e-d1c9-438d-9192-94d32cc98929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:53:09 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [req-2280fda2-7f0c-448f-a779-f4e15de2c2e8 req-e9c0f789-c200-4454-ba2c-cf41d6f441b2 tempest-VolumesGetTestJSON-1748651627 None] Volume volume-529f2979-479a-4d93-9c92-56d9c1df7fe3 (529f2979-479a-4d93-9c92-56d9c1df7fe3): created successfully Sep 04 17:53:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-2280fda2-7f0c-448f-a779-f4e15de2c2e8 req-e9c0f789-c200-4454-ba2c-cf41d6f441b2 tempest-VolumesGetTestJSON-1748651627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5778643e-d1c9-438d-9192-94d32cc98929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:53:10 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-2280fda2-7f0c-448f-a779-f4e15de2c2e8 req-e9c0f789-c200-4454-ba2c-cf41d6f441b2 tempest-VolumesGetTestJSON-1748651627 None] Flow 'volume_create_manager' (3e65d85b-c2d4-471d-92b5-8c8e615c62d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:53:10 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-2280fda2-7f0c-448f-a779-f4e15de2c2e8 req-e9c0f789-c200-4454-ba2c-cf41d6f441b2 tempest-VolumesGetTestJSON-1748651627 None] Created volume successfully. Sep 04 17:53:11 devstack cinder-volume[87314]: DEBUG cinder.coordination [req-5920777a-4e24-418f-a8f9-79b5a8a8bb80 req-64183112-7c27-4cee-ac73-018f4296d447 tempest-VolumesGetTestJSON-1748651627 None] Acquiring lock "cinder-529f2979-479a-4d93-9c92-56d9c1df7fe3-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:53:11 devstack cinder-volume[87314]: DEBUG cinder.coordination [req-5920777a-4e24-418f-a8f9-79b5a8a8bb80 req-64183112-7c27-4cee-ac73-018f4296d447 tempest-VolumesGetTestJSON-1748651627 None] Lock "cinder-529f2979-479a-4d93-9c92-56d9c1df7fe3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:53:11 devstack cinder-volume[87314]: DEBUG cinder.coordination [req-5920777a-4e24-418f-a8f9-79b5a8a8bb80 req-64183112-7c27-4cee-ac73-018f4296d447 tempest-VolumesGetTestJSON-1748651627 None] Acquiring lock "cinder-quobyte-529f2979-479a-4d93-9c92-56d9c1df7fe3" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:53:11 devstack cinder-volume[87314]: DEBUG cinder.coordination [req-5920777a-4e24-418f-a8f9-79b5a8a8bb80 req-64183112-7c27-4cee-ac73-018f4296d447 tempest-VolumesGetTestJSON-1748651627 None] Lock "cinder-quobyte-529f2979-479a-4d93-9c92-56d9c1df7fe3" acquired by "delete_volume" :: waited 0.027s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:53:11 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4911a2-fa89-4f8c-b0a0-85305967abe6]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:53:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-5920777a-4e24-418f-a8f9-79b5a8a8bb80 req-64183112-7c27-4cee-ac73-018f4296d447 tempest-VolumesGetTestJSON-1748651627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-529f2979-479a-4d93-9c92-56d9c1df7fe3 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:53:11 devstack sudo[93487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-529f2979-479a-4d93-9c92-56d9c1df7fe3 Sep 04 17:53:11 devstack sudo[93487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:53:11 devstack sudo[93487]: pam_unix(sudo:session): session closed for user root Sep 04 17:53:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-5920777a-4e24-418f-a8f9-79b5a8a8bb80 req-64183112-7c27-4cee-ac73-018f4296d447 tempest-VolumesGetTestJSON-1748651627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-529f2979-479a-4d93-9c92-56d9c1df7fe3" returned: 0 in 0.362s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:53:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-5920777a-4e24-418f-a8f9-79b5a8a8bb80 req-64183112-7c27-4cee-ac73-018f4296d447 tempest-VolumesGetTestJSON-1748651627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-529f2979-479a-4d93-9c92-56d9c1df7fe3 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:53:11 devstack sudo[93492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-529f2979-479a-4d93-9c92-56d9c1df7fe3 Sep 04 17:53:11 devstack sudo[93492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:53:12 devstack sudo[93492]: pam_unix(sudo:session): session closed for user root Sep 04 17:53:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-5920777a-4e24-418f-a8f9-79b5a8a8bb80 req-64183112-7c27-4cee-ac73-018f4296d447 tempest-VolumesGetTestJSON-1748651627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-529f2979-479a-4d93-9c92-56d9c1df7fe3" returned: 0 in 0.248s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:53:12 devstack cinder-volume[87314]: DEBUG cinder.coordination [req-5920777a-4e24-418f-a8f9-79b5a8a8bb80 req-64183112-7c27-4cee-ac73-018f4296d447 tempest-VolumesGetTestJSON-1748651627 None] Lock "cinder-quobyte-529f2979-479a-4d93-9c92-56d9c1df7fe3" released by "delete_volume" :: held 0.673s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:53:12 devstack cinder-volume[87314]: DEBUG cinder.quota [req-5920777a-4e24-418f-a8f9-79b5a8a8bb80 req-64183112-7c27-4cee-ac73-018f4296d447 tempest-VolumesGetTestJSON-1748651627 None] Created reservations ['f8b868b0-27c5-4375-9470-60e5c71d2919', '2185d5db-704e-45ec-a237-f452c18d89cb', '23a86d97-6b25-4722-8eec-035d0ae3479d', '29816d81-eb35-4da3-91aa-842834ada498'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:53:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-5920777a-4e24-418f-a8f9-79b5a8a8bb80 req-64183112-7c27-4cee-ac73-018f4296d447 tempest-VolumesGetTestJSON-1748651627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:53:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-5920777a-4e24-418f-a8f9-79b5a8a8bb80 req-64183112-7c27-4cee-ac73-018f4296d447 tempest-VolumesGetTestJSON-1748651627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:53:12 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [req-5920777a-4e24-418f-a8f9-79b5a8a8bb80 req-64183112-7c27-4cee-ac73-018f4296d447 tempest-VolumesGetTestJSON-1748651627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:53:12 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [req-5920777a-4e24-418f-a8f9-79b5a8a8bb80 req-64183112-7c27-4cee-ac73-018f4296d447 tempest-VolumesGetTestJSON-1748651627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:53:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-5920777a-4e24-418f-a8f9-79b5a8a8bb80 req-64183112-7c27-4cee-ac73-018f4296d447 tempest-VolumesGetTestJSON-1748651627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:53:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-5920777a-4e24-418f-a8f9-79b5a8a8bb80 req-64183112-7c27-4cee-ac73-018f4296d447 tempest-VolumesGetTestJSON-1748651627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:53:12 devstack sudo[93495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:53:12 devstack sudo[93495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:53:12 devstack sudo[93495]: pam_unix(sudo:session): session closed for user root Sep 04 17:53:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-5920777a-4e24-418f-a8f9-79b5a8a8bb80 req-64183112-7c27-4cee-ac73-018f4296d447 tempest-VolumesGetTestJSON-1748651627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.450s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:53:12 devstack cinder-volume[87314]: DEBUG cinder.manager [req-5920777a-4e24-418f-a8f9-79b5a8a8bb80 req-64183112-7c27-4cee-ac73-018f4296d447 tempest-VolumesGetTestJSON-1748651627 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:53:12 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-5920777a-4e24-418f-a8f9-79b5a8a8bb80 req-64183112-7c27-4cee-ac73-018f4296d447 tempest-VolumesGetTestJSON-1748651627 None] Deleted volume successfully. Sep 04 17:53:13 devstack cinder-volume[87314]: DEBUG cinder.coordination [req-5920777a-4e24-418f-a8f9-79b5a8a8bb80 req-64183112-7c27-4cee-ac73-018f4296d447 tempest-VolumesGetTestJSON-1748651627 None] Lock "cinder-529f2979-479a-4d93-9c92-56d9c1df7fe3-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:53:14 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-041e34c7-4ae8-4c71-8d1a-90b898473bdf tempest-AttachVolumeNegativeTest-221345582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:53:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-041e34c7-4ae8-4c71-8d1a-90b898473bdf tempest-AttachVolumeNegativeTest-221345582 None] Flow 'volume_create_manager' (e635ffe8-11f8-4c48-9a44-ad6344020422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:53:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-041e34c7-4ae8-4c71-8d1a-90b898473bdf tempest-AttachVolumeNegativeTest-221345582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c677522-fb7b-444f-8005-e429fb415de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:53:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-041e34c7-4ae8-4c71-8d1a-90b898473bdf tempest-AttachVolumeNegativeTest-221345582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c677522-fb7b-444f-8005-e429fb415de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:53:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1894617396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2ea5ce7-0b61-45a3-a3b7-4e4cc94688e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cb92ac13b534f169ec45e07b30f7478',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:53:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:53:14Z,use_quota=True,user_id='059c6c050db2446f85a498a65fe5bd6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:53:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-041e34c7-4ae8-4c71-8d1a-90b898473bdf tempest-AttachVolumeNegativeTest-221345582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aac5ed31-bc73-4817-9100-83a2aed0590e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:53:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-041e34c7-4ae8-4c71-8d1a-90b898473bdf tempest-AttachVolumeNegativeTest-221345582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aac5ed31-bc73-4817-9100-83a2aed0590e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:53:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-041e34c7-4ae8-4c71-8d1a-90b898473bdf tempest-AttachVolumeNegativeTest-221345582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a11f4bda-3eba-4aec-b248-a6d00331f194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:53:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-041e34c7-4ae8-4c71-8d1a-90b898473bdf tempest-AttachVolumeNegativeTest-221345582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a11f4bda-3eba-4aec-b248-a6d00331f194) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2ea5ce7-0b61-45a3-a3b7-4e4cc94688e2', 'volume_name': 'volume-b2ea5ce7-0b61-45a3-a3b7-4e4cc94688e2', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:53:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-041e34c7-4ae8-4c71-8d1a-90b898473bdf tempest-AttachVolumeNegativeTest-221345582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a61ee9c-c44c-48b1-96b3-8c2024b3f829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:53:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-041e34c7-4ae8-4c71-8d1a-90b898473bdf tempest-AttachVolumeNegativeTest-221345582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a61ee9c-c44c-48b1-96b3-8c2024b3f829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:53:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-041e34c7-4ae8-4c71-8d1a-90b898473bdf tempest-AttachVolumeNegativeTest-221345582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (323d65a7-34c8-4d7b-aa48-6a3793cf44b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:53:14 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-041e34c7-4ae8-4c71-8d1a-90b898473bdf tempest-AttachVolumeNegativeTest-221345582 None] Volume b2ea5ce7-0b61-45a3-a3b7-4e4cc94688e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2ea5ce7-0b61-45a3-a3b7-4e4cc94688e2', 'volume_size': 1} Sep 04 17:53:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-041e34c7-4ae8-4c71-8d1a-90b898473bdf tempest-AttachVolumeNegativeTest-221345582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:53:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-041e34c7-4ae8-4c71-8d1a-90b898473bdf tempest-AttachVolumeNegativeTest-221345582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:53:14 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-041e34c7-4ae8-4c71-8d1a-90b898473bdf tempest-AttachVolumeNegativeTest-221345582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:53:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1894617396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2ea5ce7-0b61-45a3-a3b7-4e4cc94688e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cb92ac13b534f169ec45e07b30f7478',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:53:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:53:14Z,use_quota=True,user_id='059c6c050db2446f85a498a65fe5bd6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:53:14 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-041e34c7-4ae8-4c71-8d1a-90b898473bdf tempest-AttachVolumeNegativeTest-221345582 None] Creating volume b2ea5ce7-0b61-45a3-a3b7-4e4cc94688e2 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:53:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-041e34c7-4ae8-4c71-8d1a-90b898473bdf tempest-AttachVolumeNegativeTest-221345582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:53:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-041e34c7-4ae8-4c71-8d1a-90b898473bdf tempest-AttachVolumeNegativeTest-221345582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:53:14 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-041e34c7-4ae8-4c71-8d1a-90b898473bdf tempest-AttachVolumeNegativeTest-221345582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:53:14 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-041e34c7-4ae8-4c71-8d1a-90b898473bdf tempest-AttachVolumeNegativeTest-221345582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:53:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-041e34c7-4ae8-4c71-8d1a-90b898473bdf tempest-AttachVolumeNegativeTest-221345582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:53:14 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-041e34c7-4ae8-4c71-8d1a-90b898473bdf tempest-AttachVolumeNegativeTest-221345582 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:53:14 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-041e34c7-4ae8-4c71-8d1a-90b898473bdf tempest-AttachVolumeNegativeTest-221345582 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:53:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-041e34c7-4ae8-4c71-8d1a-90b898473bdf tempest-AttachVolumeNegativeTest-221345582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b2ea5ce7-0b61-45a3-a3b7-4e4cc94688e2 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:53:14 devstack sudo[93502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b2ea5ce7-0b61-45a3-a3b7-4e4cc94688e2 1073741824 Sep 04 17:53:14 devstack sudo[93502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:53:14 devstack sudo[93502]: pam_unix(sudo:session): session closed for user root Sep 04 17:53:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-041e34c7-4ae8-4c71-8d1a-90b898473bdf tempest-AttachVolumeNegativeTest-221345582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b2ea5ce7-0b61-45a3-a3b7-4e4cc94688e2 1073741824" returned: 0 in 0.732s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:53:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-041e34c7-4ae8-4c71-8d1a-90b898473bdf tempest-AttachVolumeNegativeTest-221345582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b2ea5ce7-0b61-45a3-a3b7-4e4cc94688e2 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:53:15 devstack sudo[93513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b2ea5ce7-0b61-45a3-a3b7-4e4cc94688e2 Sep 04 17:53:15 devstack sudo[93513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:53:15 devstack sudo[93513]: pam_unix(sudo:session): session closed for user root Sep 04 17:53:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-041e34c7-4ae8-4c71-8d1a-90b898473bdf tempest-AttachVolumeNegativeTest-221345582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b2ea5ce7-0b61-45a3-a3b7-4e4cc94688e2" returned: 0 in 0.431s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:53:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-041e34c7-4ae8-4c71-8d1a-90b898473bdf tempest-AttachVolumeNegativeTest-221345582 None] <== create_volume: return (1279ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:53:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-041e34c7-4ae8-4c71-8d1a-90b898473bdf tempest-AttachVolumeNegativeTest-221345582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.284s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:53:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-041e34c7-4ae8-4c71-8d1a-90b898473bdf tempest-AttachVolumeNegativeTest-221345582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (323d65a7-34c8-4d7b-aa48-6a3793cf44b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2ea5ce7-0b61-45a3-a3b7-4e4cc94688e2', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:53:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-041e34c7-4ae8-4c71-8d1a-90b898473bdf tempest-AttachVolumeNegativeTest-221345582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fedd590-ed21-475b-8724-49b2d16687ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:53:15 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-041e34c7-4ae8-4c71-8d1a-90b898473bdf tempest-AttachVolumeNegativeTest-221345582 None] Volume volume-b2ea5ce7-0b61-45a3-a3b7-4e4cc94688e2 (b2ea5ce7-0b61-45a3-a3b7-4e4cc94688e2): created successfully Sep 04 17:53:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-041e34c7-4ae8-4c71-8d1a-90b898473bdf tempest-AttachVolumeNegativeTest-221345582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fedd590-ed21-475b-8724-49b2d16687ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:53:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-041e34c7-4ae8-4c71-8d1a-90b898473bdf tempest-AttachVolumeNegativeTest-221345582 None] Flow 'volume_create_manager' (e635ffe8-11f8-4c48-9a44-ad6344020422) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:53:15 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-041e34c7-4ae8-4c71-8d1a-90b898473bdf tempest-AttachVolumeNegativeTest-221345582 None] Created volume successfully. Sep 04 17:53:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-6536562f-bda0-4131-aaba-ce5ce815cb6f req-693aafd7-5e5a-45ad-bf87-3d2c50022312 tempest-AttachVolumeNegativeTest-221345582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:53:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-6536562f-bda0-4131-aaba-ce5ce815cb6f req-693aafd7-5e5a-45ad-bf87-3d2c50022312 tempest-AttachVolumeNegativeTest-221345582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:53:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-6536562f-bda0-4131-aaba-ce5ce815cb6f req-693aafd7-5e5a-45ad-bf87-3d2c50022312 tempest-AttachVolumeNegativeTest-221345582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:53:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-6536562f-bda0-4131-aaba-ce5ce815cb6f req-693aafd7-5e5a-45ad-bf87-3d2c50022312 tempest-AttachVolumeNegativeTest-221345582 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a', 'name': 'volume-b2ea5ce7-0b61-45a3-a3b7-4e4cc94688e2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8763c030-7a17-4f9d-9522-dbb266df8107', 'enforce_multipath': True} {{(pid=87314) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 17:53:16 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-6536562f-bda0-4131-aaba-ce5ce815cb6f req-693aafd7-5e5a-45ad-bf87-3d2c50022312 tempest-AttachVolumeNegativeTest-221345582 None] attachment_update completed successfully. Sep 04 17:53:19 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-181a3f59-6205-4dd6-ad3c-73d49ac34ebc tempest-VolumesTestJSON-367195872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:53:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-181a3f59-6205-4dd6-ad3c-73d49ac34ebc tempest-VolumesTestJSON-367195872 None] Flow 'volume_create_manager' (045d92c2-6bf8-42a2-8979-bea72fad5f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:53:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-181a3f59-6205-4dd6-ad3c-73d49ac34ebc tempest-VolumesTestJSON-367195872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fb41cdc-db9d-4ab2-b48a-1b76dcff2f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:53:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-181a3f59-6205-4dd6-ad3c-73d49ac34ebc tempest-VolumesTestJSON-367195872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fb41cdc-db9d-4ab2-b48a-1b76dcff2f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:53:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-444022913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c60bdf0-ebee-476b-acf1-79fb2a134b97,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f500b73d626e487f9741081505026b59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:53:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:53:20Z,use_quota=True,user_id='50f9f7a135174440814bd6e83989ba41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:53:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-181a3f59-6205-4dd6-ad3c-73d49ac34ebc tempest-VolumesTestJSON-367195872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f83eba7b-710d-4e0c-95b4-1aa97b86f8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:53:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-181a3f59-6205-4dd6-ad3c-73d49ac34ebc tempest-VolumesTestJSON-367195872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f83eba7b-710d-4e0c-95b4-1aa97b86f8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:53:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-181a3f59-6205-4dd6-ad3c-73d49ac34ebc tempest-VolumesTestJSON-367195872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (345b24c1-15f1-414f-a9b0-46ed4db39e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:53:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-181a3f59-6205-4dd6-ad3c-73d49ac34ebc tempest-VolumesTestJSON-367195872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (345b24c1-15f1-414f-a9b0-46ed4db39e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c60bdf0-ebee-476b-acf1-79fb2a134b97', 'volume_name': 'volume-8c60bdf0-ebee-476b-acf1-79fb2a134b97', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:53:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-181a3f59-6205-4dd6-ad3c-73d49ac34ebc tempest-VolumesTestJSON-367195872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4eedac0-3e92-46f9-a57d-e1406d1885be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:53:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-181a3f59-6205-4dd6-ad3c-73d49ac34ebc tempest-VolumesTestJSON-367195872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4eedac0-3e92-46f9-a57d-e1406d1885be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:53:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-181a3f59-6205-4dd6-ad3c-73d49ac34ebc tempest-VolumesTestJSON-367195872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd23dc4b-69fc-445b-9275-35eca7b44ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:53:19 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-181a3f59-6205-4dd6-ad3c-73d49ac34ebc tempest-VolumesTestJSON-367195872 None] Volume 8c60bdf0-ebee-476b-acf1-79fb2a134b97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c60bdf0-ebee-476b-acf1-79fb2a134b97', 'volume_size': 1} Sep 04 17:53:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-181a3f59-6205-4dd6-ad3c-73d49ac34ebc tempest-VolumesTestJSON-367195872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:53:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-181a3f59-6205-4dd6-ad3c-73d49ac34ebc tempest-VolumesTestJSON-367195872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:53:19 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-181a3f59-6205-4dd6-ad3c-73d49ac34ebc tempest-VolumesTestJSON-367195872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:53:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-444022913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c60bdf0-ebee-476b-acf1-79fb2a134b97,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f500b73d626e487f9741081505026b59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:53:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:53:20Z,use_quota=True,user_id='50f9f7a135174440814bd6e83989ba41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:53:19 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-181a3f59-6205-4dd6-ad3c-73d49ac34ebc tempest-VolumesTestJSON-367195872 None] Creating volume 8c60bdf0-ebee-476b-acf1-79fb2a134b97 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:53:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-181a3f59-6205-4dd6-ad3c-73d49ac34ebc tempest-VolumesTestJSON-367195872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:53:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-181a3f59-6205-4dd6-ad3c-73d49ac34ebc tempest-VolumesTestJSON-367195872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:53:19 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-181a3f59-6205-4dd6-ad3c-73d49ac34ebc tempest-VolumesTestJSON-367195872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:53:19 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-181a3f59-6205-4dd6-ad3c-73d49ac34ebc tempest-VolumesTestJSON-367195872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:53:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-181a3f59-6205-4dd6-ad3c-73d49ac34ebc tempest-VolumesTestJSON-367195872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:53:19 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-181a3f59-6205-4dd6-ad3c-73d49ac34ebc tempest-VolumesTestJSON-367195872 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:53:19 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-181a3f59-6205-4dd6-ad3c-73d49ac34ebc tempest-VolumesTestJSON-367195872 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:53:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-181a3f59-6205-4dd6-ad3c-73d49ac34ebc tempest-VolumesTestJSON-367195872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8c60bdf0-ebee-476b-acf1-79fb2a134b97 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:53:19 devstack sudo[93573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8c60bdf0-ebee-476b-acf1-79fb2a134b97 1073741824 Sep 04 17:53:19 devstack sudo[93573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:53:20 devstack sudo[93573]: pam_unix(sudo:session): session closed for user root Sep 04 17:53:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-181a3f59-6205-4dd6-ad3c-73d49ac34ebc tempest-VolumesTestJSON-367195872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8c60bdf0-ebee-476b-acf1-79fb2a134b97 1073741824" returned: 0 in 0.504s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:53:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-181a3f59-6205-4dd6-ad3c-73d49ac34ebc tempest-VolumesTestJSON-367195872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8c60bdf0-ebee-476b-acf1-79fb2a134b97 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:53:20 devstack sudo[93579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8c60bdf0-ebee-476b-acf1-79fb2a134b97 Sep 04 17:53:20 devstack sudo[93579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:53:20 devstack sudo[93579]: pam_unix(sudo:session): session closed for user root Sep 04 17:53:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-181a3f59-6205-4dd6-ad3c-73d49ac34ebc tempest-VolumesTestJSON-367195872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8c60bdf0-ebee-476b-acf1-79fb2a134b97" returned: 0 in 0.300s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:53:20 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-181a3f59-6205-4dd6-ad3c-73d49ac34ebc tempest-VolumesTestJSON-367195872 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:53:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-181a3f59-6205-4dd6-ad3c-73d49ac34ebc tempest-VolumesTestJSON-367195872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:53:20 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-181a3f59-6205-4dd6-ad3c-73d49ac34ebc tempest-VolumesTestJSON-367195872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd23dc4b-69fc-445b-9275-35eca7b44ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c60bdf0-ebee-476b-acf1-79fb2a134b97', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:53:20 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-181a3f59-6205-4dd6-ad3c-73d49ac34ebc tempest-VolumesTestJSON-367195872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3427ba6-677c-4286-b8d4-8c71e760e64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:53:20 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-181a3f59-6205-4dd6-ad3c-73d49ac34ebc tempest-VolumesTestJSON-367195872 None] Volume volume-8c60bdf0-ebee-476b-acf1-79fb2a134b97 (8c60bdf0-ebee-476b-acf1-79fb2a134b97): created successfully Sep 04 17:53:20 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-181a3f59-6205-4dd6-ad3c-73d49ac34ebc tempest-VolumesTestJSON-367195872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3427ba6-677c-4286-b8d4-8c71e760e64c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:53:20 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-181a3f59-6205-4dd6-ad3c-73d49ac34ebc tempest-VolumesTestJSON-367195872 None] Flow 'volume_create_manager' (045d92c2-6bf8-42a2-8979-bea72fad5f41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:53:20 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-181a3f59-6205-4dd6-ad3c-73d49ac34ebc tempest-VolumesTestJSON-367195872 None] Created volume successfully. Sep 04 17:53:21 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 17:53:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:53:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:53:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:53:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:53:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:53:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:53:21 devstack sudo[93582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:53:21 devstack sudo[93582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:53:21 devstack sudo[93582]: pam_unix(sudo:session): session closed for user root Sep 04 17:53:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.282s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:53:21 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:53:22 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-52184c83-772a-4371-a349-5de3ccb08b6a tempest-VolumesTestJSON-367195872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:53:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-52184c83-772a-4371-a349-5de3ccb08b6a tempest-VolumesTestJSON-367195872 None] Flow 'volume_create_manager' (a0643f55-5423-4150-949b-421b1fe165b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:53:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-52184c83-772a-4371-a349-5de3ccb08b6a tempest-VolumesTestJSON-367195872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3abbaf86-128a-46d6-85f3-479c97da5282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:53:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-52184c83-772a-4371-a349-5de3ccb08b6a tempest-VolumesTestJSON-367195872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3abbaf86-128a-46d6-85f3-479c97da5282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:53:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1381164572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ded69e9-afc3-4d27-9885-4303dda52633,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f500b73d626e487f9741081505026b59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:53:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:53:23Z,use_quota=True,user_id='50f9f7a135174440814bd6e83989ba41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:53:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-52184c83-772a-4371-a349-5de3ccb08b6a tempest-VolumesTestJSON-367195872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11989c9e-c450-4735-89d8-c148ef20ba12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:53:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-52184c83-772a-4371-a349-5de3ccb08b6a tempest-VolumesTestJSON-367195872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11989c9e-c450-4735-89d8-c148ef20ba12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:53:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-52184c83-772a-4371-a349-5de3ccb08b6a tempest-VolumesTestJSON-367195872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1fbbc00-871e-4c21-bac5-ed2a951eadd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:53:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-52184c83-772a-4371-a349-5de3ccb08b6a tempest-VolumesTestJSON-367195872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1fbbc00-871e-4c21-bac5-ed2a951eadd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ded69e9-afc3-4d27-9885-4303dda52633', 'volume_name': 'volume-0ded69e9-afc3-4d27-9885-4303dda52633', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:53:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-52184c83-772a-4371-a349-5de3ccb08b6a tempest-VolumesTestJSON-367195872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b809c504-0e85-4204-a612-01a2d179851c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:53:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-52184c83-772a-4371-a349-5de3ccb08b6a tempest-VolumesTestJSON-367195872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b809c504-0e85-4204-a612-01a2d179851c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:53:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-52184c83-772a-4371-a349-5de3ccb08b6a tempest-VolumesTestJSON-367195872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4735a2ae-49d1-4277-abda-f237831ae0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:53:22 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-52184c83-772a-4371-a349-5de3ccb08b6a tempest-VolumesTestJSON-367195872 None] Volume 0ded69e9-afc3-4d27-9885-4303dda52633: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ded69e9-afc3-4d27-9885-4303dda52633', 'volume_size': 1} Sep 04 17:53:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-52184c83-772a-4371-a349-5de3ccb08b6a tempest-VolumesTestJSON-367195872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:53:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-52184c83-772a-4371-a349-5de3ccb08b6a tempest-VolumesTestJSON-367195872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:53:22 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-52184c83-772a-4371-a349-5de3ccb08b6a tempest-VolumesTestJSON-367195872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:53:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1381164572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ded69e9-afc3-4d27-9885-4303dda52633,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f500b73d626e487f9741081505026b59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:53:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:53:23Z,use_quota=True,user_id='50f9f7a135174440814bd6e83989ba41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:53:22 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-52184c83-772a-4371-a349-5de3ccb08b6a tempest-VolumesTestJSON-367195872 None] Creating volume 0ded69e9-afc3-4d27-9885-4303dda52633 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:53:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-52184c83-772a-4371-a349-5de3ccb08b6a tempest-VolumesTestJSON-367195872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:53:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-52184c83-772a-4371-a349-5de3ccb08b6a tempest-VolumesTestJSON-367195872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:53:22 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-52184c83-772a-4371-a349-5de3ccb08b6a tempest-VolumesTestJSON-367195872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:53:22 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-52184c83-772a-4371-a349-5de3ccb08b6a tempest-VolumesTestJSON-367195872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:53:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-52184c83-772a-4371-a349-5de3ccb08b6a tempest-VolumesTestJSON-367195872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:53:22 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-52184c83-772a-4371-a349-5de3ccb08b6a tempest-VolumesTestJSON-367195872 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:53:22 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-52184c83-772a-4371-a349-5de3ccb08b6a tempest-VolumesTestJSON-367195872 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:53:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-52184c83-772a-4371-a349-5de3ccb08b6a tempest-VolumesTestJSON-367195872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0ded69e9-afc3-4d27-9885-4303dda52633 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:53:23 devstack sudo[93588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0ded69e9-afc3-4d27-9885-4303dda52633 1073741824 Sep 04 17:53:23 devstack sudo[93588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:53:23 devstack sudo[93588]: pam_unix(sudo:session): session closed for user root Sep 04 17:53:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-52184c83-772a-4371-a349-5de3ccb08b6a tempest-VolumesTestJSON-367195872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0ded69e9-afc3-4d27-9885-4303dda52633 1073741824" returned: 0 in 0.605s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:53:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-52184c83-772a-4371-a349-5de3ccb08b6a tempest-VolumesTestJSON-367195872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0ded69e9-afc3-4d27-9885-4303dda52633 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:53:23 devstack sudo[93596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0ded69e9-afc3-4d27-9885-4303dda52633 Sep 04 17:53:23 devstack sudo[93596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:53:24 devstack sudo[93596]: pam_unix(sudo:session): session closed for user root Sep 04 17:53:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-52184c83-772a-4371-a349-5de3ccb08b6a tempest-VolumesTestJSON-367195872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0ded69e9-afc3-4d27-9885-4303dda52633" returned: 0 in 0.607s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:53:24 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-52184c83-772a-4371-a349-5de3ccb08b6a tempest-VolumesTestJSON-367195872 None] <== create_volume: return (1265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:53:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-52184c83-772a-4371-a349-5de3ccb08b6a tempest-VolumesTestJSON-367195872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.268s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:53:24 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-52184c83-772a-4371-a349-5de3ccb08b6a tempest-VolumesTestJSON-367195872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4735a2ae-49d1-4277-abda-f237831ae0af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ded69e9-afc3-4d27-9885-4303dda52633', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:53:24 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-52184c83-772a-4371-a349-5de3ccb08b6a tempest-VolumesTestJSON-367195872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (113996fa-84c8-49fc-bcfa-e46b091f3f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:53:24 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-52184c83-772a-4371-a349-5de3ccb08b6a tempest-VolumesTestJSON-367195872 None] Volume volume-0ded69e9-afc3-4d27-9885-4303dda52633 (0ded69e9-afc3-4d27-9885-4303dda52633): created successfully Sep 04 17:53:24 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-52184c83-772a-4371-a349-5de3ccb08b6a tempest-VolumesTestJSON-367195872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (113996fa-84c8-49fc-bcfa-e46b091f3f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:53:24 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-52184c83-772a-4371-a349-5de3ccb08b6a tempest-VolumesTestJSON-367195872 None] Flow 'volume_create_manager' (a0643f55-5423-4150-949b-421b1fe165b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:53:24 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-52184c83-772a-4371-a349-5de3ccb08b6a tempest-VolumesTestJSON-367195872 None] Created volume successfully. Sep 04 17:53:25 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-b499175c-a39c-441a-a043-08a98fda721e tempest-VolumesTestJSON-367195872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:53:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b499175c-a39c-441a-a043-08a98fda721e tempest-VolumesTestJSON-367195872 None] Flow 'volume_create_manager' (d1920b36-8404-4c69-a6d8-697a5e2008b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:53:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b499175c-a39c-441a-a043-08a98fda721e tempest-VolumesTestJSON-367195872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fdc002c-4ec8-45ee-be88-57e5ea0e1cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:53:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b499175c-a39c-441a-a043-08a98fda721e tempest-VolumesTestJSON-367195872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fdc002c-4ec8-45ee-be88-57e5ea0e1cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:53:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-419358406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16449017-9369-49de-84eb-80cb48df2f5d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f500b73d626e487f9741081505026b59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:53:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:53:26Z,use_quota=True,user_id='50f9f7a135174440814bd6e83989ba41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:53:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b499175c-a39c-441a-a043-08a98fda721e tempest-VolumesTestJSON-367195872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9065a79-56e5-4b33-9dd2-1183e29e35e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:53:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b499175c-a39c-441a-a043-08a98fda721e tempest-VolumesTestJSON-367195872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9065a79-56e5-4b33-9dd2-1183e29e35e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:53:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b499175c-a39c-441a-a043-08a98fda721e tempest-VolumesTestJSON-367195872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c52e8550-afce-4fea-b9f1-37ae7ea98981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:53:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b499175c-a39c-441a-a043-08a98fda721e tempest-VolumesTestJSON-367195872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c52e8550-afce-4fea-b9f1-37ae7ea98981) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16449017-9369-49de-84eb-80cb48df2f5d', 'volume_name': 'volume-16449017-9369-49de-84eb-80cb48df2f5d', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:53:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b499175c-a39c-441a-a043-08a98fda721e tempest-VolumesTestJSON-367195872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2b0e4b4-9cf4-4541-87b4-38c719650d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:53:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b499175c-a39c-441a-a043-08a98fda721e tempest-VolumesTestJSON-367195872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2b0e4b4-9cf4-4541-87b4-38c719650d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:53:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b499175c-a39c-441a-a043-08a98fda721e tempest-VolumesTestJSON-367195872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65ec9306-3caf-48fc-a640-d6bf30941ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:53:25 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-b499175c-a39c-441a-a043-08a98fda721e tempest-VolumesTestJSON-367195872 None] Volume 16449017-9369-49de-84eb-80cb48df2f5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16449017-9369-49de-84eb-80cb48df2f5d', 'volume_size': 1} Sep 04 17:53:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b499175c-a39c-441a-a043-08a98fda721e tempest-VolumesTestJSON-367195872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:53:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b499175c-a39c-441a-a043-08a98fda721e tempest-VolumesTestJSON-367195872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:53:25 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b499175c-a39c-441a-a043-08a98fda721e tempest-VolumesTestJSON-367195872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:53:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-419358406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16449017-9369-49de-84eb-80cb48df2f5d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f500b73d626e487f9741081505026b59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:53:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:53:26Z,use_quota=True,user_id='50f9f7a135174440814bd6e83989ba41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:53:25 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-b499175c-a39c-441a-a043-08a98fda721e tempest-VolumesTestJSON-367195872 None] Creating volume 16449017-9369-49de-84eb-80cb48df2f5d {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:53:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b499175c-a39c-441a-a043-08a98fda721e tempest-VolumesTestJSON-367195872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:53:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b499175c-a39c-441a-a043-08a98fda721e tempest-VolumesTestJSON-367195872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:53:25 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b499175c-a39c-441a-a043-08a98fda721e tempest-VolumesTestJSON-367195872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:53:25 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b499175c-a39c-441a-a043-08a98fda721e tempest-VolumesTestJSON-367195872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:53:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b499175c-a39c-441a-a043-08a98fda721e tempest-VolumesTestJSON-367195872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:53:25 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b499175c-a39c-441a-a043-08a98fda721e tempest-VolumesTestJSON-367195872 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:53:25 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-b499175c-a39c-441a-a043-08a98fda721e tempest-VolumesTestJSON-367195872 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:53:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b499175c-a39c-441a-a043-08a98fda721e tempest-VolumesTestJSON-367195872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-16449017-9369-49de-84eb-80cb48df2f5d 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:53:25 devstack sudo[93620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-16449017-9369-49de-84eb-80cb48df2f5d 1073741824 Sep 04 17:53:25 devstack sudo[93620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:53:26 devstack sudo[93620]: pam_unix(sudo:session): session closed for user root Sep 04 17:53:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b499175c-a39c-441a-a043-08a98fda721e tempest-VolumesTestJSON-367195872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-16449017-9369-49de-84eb-80cb48df2f5d 1073741824" returned: 0 in 0.538s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:53:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b499175c-a39c-441a-a043-08a98fda721e tempest-VolumesTestJSON-367195872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-16449017-9369-49de-84eb-80cb48df2f5d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:53:26 devstack sudo[93626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-16449017-9369-49de-84eb-80cb48df2f5d Sep 04 17:53:26 devstack sudo[93626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:53:26 devstack sudo[93626]: pam_unix(sudo:session): session closed for user root Sep 04 17:53:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b499175c-a39c-441a-a043-08a98fda721e tempest-VolumesTestJSON-367195872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-16449017-9369-49de-84eb-80cb48df2f5d" returned: 0 in 0.316s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:53:26 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b499175c-a39c-441a-a043-08a98fda721e tempest-VolumesTestJSON-367195872 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:53:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b499175c-a39c-441a-a043-08a98fda721e tempest-VolumesTestJSON-367195872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:53:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b499175c-a39c-441a-a043-08a98fda721e tempest-VolumesTestJSON-367195872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65ec9306-3caf-48fc-a640-d6bf30941ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16449017-9369-49de-84eb-80cb48df2f5d', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:53:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b499175c-a39c-441a-a043-08a98fda721e tempest-VolumesTestJSON-367195872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (150d0a3e-20d4-4918-8bd9-5dd2cd1b5094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:53:26 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-b499175c-a39c-441a-a043-08a98fda721e tempest-VolumesTestJSON-367195872 None] Volume volume-16449017-9369-49de-84eb-80cb48df2f5d (16449017-9369-49de-84eb-80cb48df2f5d): created successfully Sep 04 17:53:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b499175c-a39c-441a-a043-08a98fda721e tempest-VolumesTestJSON-367195872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (150d0a3e-20d4-4918-8bd9-5dd2cd1b5094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:53:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b499175c-a39c-441a-a043-08a98fda721e tempest-VolumesTestJSON-367195872 None] Flow 'volume_create_manager' (d1920b36-8404-4c69-a6d8-697a5e2008b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:53:26 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-b499175c-a39c-441a-a043-08a98fda721e tempest-VolumesTestJSON-367195872 None] Created volume successfully. Sep 04 17:53:29 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-e277cf34-a566-432d-9e0b-a2ebd52f1311 req-d87db4d4-8cfb-49f6-833b-922cd1558452 tempest-ServerActionsTestOtherA-1015930920 None] Terminate volume connection completed successfully. Sep 04 17:53:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-e277cf34-a566-432d-9e0b-a2ebd52f1311 req-d87db4d4-8cfb-49f6-833b-922cd1558452 tempest-ServerActionsTestOtherA-1015930920 None] Deleting attachment 087fc336-a2cc-48b6-842b-7dbdecf2067e. {{(pid=87314) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 17:53:29 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-70bf6fd0-075b-477b-9019-2cfd7d6b357a tempest-VolumesTestJSON-367195872 None] Acquiring lock "cinder-16449017-9369-49de-84eb-80cb48df2f5d-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:53:29 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-70bf6fd0-075b-477b-9019-2cfd7d6b357a tempest-VolumesTestJSON-367195872 None] Lock "cinder-16449017-9369-49de-84eb-80cb48df2f5d-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:53:29 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-70bf6fd0-075b-477b-9019-2cfd7d6b357a tempest-VolumesTestJSON-367195872 None] Acquiring lock "cinder-quobyte-16449017-9369-49de-84eb-80cb48df2f5d" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:53:29 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-70bf6fd0-075b-477b-9019-2cfd7d6b357a tempest-VolumesTestJSON-367195872 None] Lock "cinder-quobyte-16449017-9369-49de-84eb-80cb48df2f5d" acquired by "delete_volume" :: waited 0.049s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:53:29 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34bddf2-651a-4de8-ab0c-f5cbcacf394a]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:53:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-70bf6fd0-075b-477b-9019-2cfd7d6b357a tempest-VolumesTestJSON-367195872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-16449017-9369-49de-84eb-80cb48df2f5d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:53:30 devstack sudo[93674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-16449017-9369-49de-84eb-80cb48df2f5d Sep 04 17:53:30 devstack sudo[93674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:53:30 devstack sudo[93674]: pam_unix(sudo:session): session closed for user root Sep 04 17:53:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-70bf6fd0-075b-477b-9019-2cfd7d6b357a tempest-VolumesTestJSON-367195872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-16449017-9369-49de-84eb-80cb48df2f5d" returned: 0 in 0.756s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:53:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-70bf6fd0-075b-477b-9019-2cfd7d6b357a tempest-VolumesTestJSON-367195872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-16449017-9369-49de-84eb-80cb48df2f5d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:53:30 devstack sudo[93698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-16449017-9369-49de-84eb-80cb48df2f5d Sep 04 17:53:30 devstack sudo[93698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:53:31 devstack sudo[93698]: pam_unix(sudo:session): session closed for user root Sep 04 17:53:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-70bf6fd0-075b-477b-9019-2cfd7d6b357a tempest-VolumesTestJSON-367195872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-16449017-9369-49de-84eb-80cb48df2f5d" returned: 0 in 0.779s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:53:31 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-70bf6fd0-075b-477b-9019-2cfd7d6b357a tempest-VolumesTestJSON-367195872 None] Lock "cinder-quobyte-16449017-9369-49de-84eb-80cb48df2f5d" released by "delete_volume" :: held 1.650s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:53:31 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-70bf6fd0-075b-477b-9019-2cfd7d6b357a tempest-VolumesTestJSON-367195872 None] Created reservations ['397a5cb6-e117-4ba8-8b26-41b2e8724ce8', '2790a535-5323-47a0-951d-192940ad7a16', 'd47122dd-379f-45e9-9400-bab558f86049', 'd039d43f-a30f-4f08-b1af-ec5f27006127'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:53:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-70bf6fd0-075b-477b-9019-2cfd7d6b357a tempest-VolumesTestJSON-367195872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:53:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-70bf6fd0-075b-477b-9019-2cfd7d6b357a tempest-VolumesTestJSON-367195872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:53:31 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-70bf6fd0-075b-477b-9019-2cfd7d6b357a tempest-VolumesTestJSON-367195872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:53:31 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-70bf6fd0-075b-477b-9019-2cfd7d6b357a tempest-VolumesTestJSON-367195872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:53:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-70bf6fd0-075b-477b-9019-2cfd7d6b357a tempest-VolumesTestJSON-367195872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:53:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-70bf6fd0-075b-477b-9019-2cfd7d6b357a tempest-VolumesTestJSON-367195872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:53:31 devstack sudo[93709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:53:31 devstack sudo[93709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:53:32 devstack sudo[93709]: pam_unix(sudo:session): session closed for user root Sep 04 17:53:32 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-81f23ece-e7fc-4c82-afdb-f145e67cf7a7 tempest-VolumesTestJSON-367195872 None] Acquiring lock "cinder-0ded69e9-afc3-4d27-9885-4303dda52633-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:53:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-70bf6fd0-075b-477b-9019-2cfd7d6b357a tempest-VolumesTestJSON-367195872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.496s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:53:32 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-70bf6fd0-075b-477b-9019-2cfd7d6b357a tempest-VolumesTestJSON-367195872 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:53:32 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-70bf6fd0-075b-477b-9019-2cfd7d6b357a tempest-VolumesTestJSON-367195872 None] Deleted volume successfully. Sep 04 17:53:32 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-81f23ece-e7fc-4c82-afdb-f145e67cf7a7 tempest-VolumesTestJSON-367195872 None] Lock "cinder-0ded69e9-afc3-4d27-9885-4303dda52633-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:53:32 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-70bf6fd0-075b-477b-9019-2cfd7d6b357a tempest-VolumesTestJSON-367195872 None] Lock "cinder-16449017-9369-49de-84eb-80cb48df2f5d-delete_volume" released by "delete_volume" :: held 2.731s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:53:32 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-81f23ece-e7fc-4c82-afdb-f145e67cf7a7 tempest-VolumesTestJSON-367195872 None] Acquiring lock "cinder-quobyte-0ded69e9-afc3-4d27-9885-4303dda52633" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:53:32 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-81f23ece-e7fc-4c82-afdb-f145e67cf7a7 tempest-VolumesTestJSON-367195872 None] Lock "cinder-quobyte-0ded69e9-afc3-4d27-9885-4303dda52633" acquired by "delete_volume" :: waited 0.030s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:53:32 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7bb92c-b2ba-436a-be92-084e2fa6d1ad]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:53:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-81f23ece-e7fc-4c82-afdb-f145e67cf7a7 tempest-VolumesTestJSON-367195872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0ded69e9-afc3-4d27-9885-4303dda52633 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:53:32 devstack sudo[93713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0ded69e9-afc3-4d27-9885-4303dda52633 Sep 04 17:53:32 devstack sudo[93713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:53:33 devstack sudo[93713]: pam_unix(sudo:session): session closed for user root Sep 04 17:53:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-81f23ece-e7fc-4c82-afdb-f145e67cf7a7 tempest-VolumesTestJSON-367195872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0ded69e9-afc3-4d27-9885-4303dda52633" returned: 0 in 0.594s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:53:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-81f23ece-e7fc-4c82-afdb-f145e67cf7a7 tempest-VolumesTestJSON-367195872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0ded69e9-afc3-4d27-9885-4303dda52633 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:53:33 devstack sudo[93720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0ded69e9-afc3-4d27-9885-4303dda52633 Sep 04 17:53:33 devstack sudo[93720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:53:33 devstack sudo[93720]: pam_unix(sudo:session): session closed for user root Sep 04 17:53:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-81f23ece-e7fc-4c82-afdb-f145e67cf7a7 tempest-VolumesTestJSON-367195872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0ded69e9-afc3-4d27-9885-4303dda52633" returned: 0 in 0.383s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:53:33 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-81f23ece-e7fc-4c82-afdb-f145e67cf7a7 tempest-VolumesTestJSON-367195872 None] Lock "cinder-quobyte-0ded69e9-afc3-4d27-9885-4303dda52633" released by "delete_volume" :: held 1.083s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:53:33 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-81f23ece-e7fc-4c82-afdb-f145e67cf7a7 tempest-VolumesTestJSON-367195872 None] Created reservations ['c67dd6a7-d05d-4f8f-963f-ec4871e53db4', 'fc2a8dac-6354-4571-972f-84fdc1ef33f5', 'b5dd8a69-9fae-42ff-92c6-d071c12e80f4', '61beaeab-9f28-4292-b9b5-51a3162f09b3'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:53:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-81f23ece-e7fc-4c82-afdb-f145e67cf7a7 tempest-VolumesTestJSON-367195872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:53:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-81f23ece-e7fc-4c82-afdb-f145e67cf7a7 tempest-VolumesTestJSON-367195872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:53:33 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-81f23ece-e7fc-4c82-afdb-f145e67cf7a7 tempest-VolumesTestJSON-367195872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:53:33 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-81f23ece-e7fc-4c82-afdb-f145e67cf7a7 tempest-VolumesTestJSON-367195872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:53:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-81f23ece-e7fc-4c82-afdb-f145e67cf7a7 tempest-VolumesTestJSON-367195872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:53:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-81f23ece-e7fc-4c82-afdb-f145e67cf7a7 tempest-VolumesTestJSON-367195872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:53:33 devstack sudo[93723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:53:33 devstack sudo[93723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:53:34 devstack sudo[93723]: pam_unix(sudo:session): session closed for user root Sep 04 17:53:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-81f23ece-e7fc-4c82-afdb-f145e67cf7a7 tempest-VolumesTestJSON-367195872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.377s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:53:34 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-81f23ece-e7fc-4c82-afdb-f145e67cf7a7 tempest-VolumesTestJSON-367195872 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:53:34 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-81f23ece-e7fc-4c82-afdb-f145e67cf7a7 tempest-VolumesTestJSON-367195872 None] Deleted volume successfully. Sep 04 17:53:34 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-81f23ece-e7fc-4c82-afdb-f145e67cf7a7 tempest-VolumesTestJSON-367195872 None] Lock "cinder-0ded69e9-afc3-4d27-9885-4303dda52633-delete_volume" released by "delete_volume" :: held 1.932s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:53:34 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-22c1c384-d98c-4b60-af26-8b13c797d740 tempest-VolumesTestJSON-367195872 None] Acquiring lock "cinder-8c60bdf0-ebee-476b-acf1-79fb2a134b97-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:53:34 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-22c1c384-d98c-4b60-af26-8b13c797d740 tempest-VolumesTestJSON-367195872 None] Lock "cinder-8c60bdf0-ebee-476b-acf1-79fb2a134b97-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:53:34 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-22c1c384-d98c-4b60-af26-8b13c797d740 tempest-VolumesTestJSON-367195872 None] Acquiring lock "cinder-quobyte-8c60bdf0-ebee-476b-acf1-79fb2a134b97" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:53:34 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-22c1c384-d98c-4b60-af26-8b13c797d740 tempest-VolumesTestJSON-367195872 None] Lock "cinder-quobyte-8c60bdf0-ebee-476b-acf1-79fb2a134b97" acquired by "delete_volume" :: waited 0.034s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:53:35 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[20fa4f8e-c139-421d-b2d1-d15026b54671]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:53:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-22c1c384-d98c-4b60-af26-8b13c797d740 tempest-VolumesTestJSON-367195872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8c60bdf0-ebee-476b-acf1-79fb2a134b97 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:53:35 devstack sudo[93727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8c60bdf0-ebee-476b-acf1-79fb2a134b97 Sep 04 17:53:35 devstack sudo[93727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:53:35 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cf9e66c-7670-43c8-9182-d7e93c38ee9b tempest-TestImageHashVerification-872605357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:53:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3cf9e66c-7670-43c8-9182-d7e93c38ee9b tempest-TestImageHashVerification-872605357 None] Flow 'volume_create_manager' (286ee072-0e06-46ac-b130-5a52be25e980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:53:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3cf9e66c-7670-43c8-9182-d7e93c38ee9b tempest-TestImageHashVerification-872605357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (663c0cce-5865-4ee8-8562-62f9de52b951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:53:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3cf9e66c-7670-43c8-9182-d7e93c38ee9b tempest-TestImageHashVerification-872605357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (663c0cce-5865-4ee8-8562-62f9de52b951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1503472799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=604382f0-69c8-415a-994d-2580339164f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fecad82025a04c7db49f4a8d03e98568',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:53:36Z,use_quota=True,user_id='a56f423b550844f0961587158e36e065',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:53:35 devstack sudo[93727]: pam_unix(sudo:session): session closed for user root Sep 04 17:53:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3cf9e66c-7670-43c8-9182-d7e93c38ee9b tempest-TestImageHashVerification-872605357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c749bb1-febe-438a-9445-8ea06aa7562c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:53:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3cf9e66c-7670-43c8-9182-d7e93c38ee9b tempest-TestImageHashVerification-872605357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c749bb1-febe-438a-9445-8ea06aa7562c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:53:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3cf9e66c-7670-43c8-9182-d7e93c38ee9b tempest-TestImageHashVerification-872605357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b6692a0-6ec1-4839-95fd-880b9c21357e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:53:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3cf9e66c-7670-43c8-9182-d7e93c38ee9b tempest-TestImageHashVerification-872605357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b6692a0-6ec1-4839-95fd-880b9c21357e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '604382f0-69c8-415a-994d-2580339164f3', 'volume_name': 'volume-604382f0-69c8-415a-994d-2580339164f3', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:53:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3cf9e66c-7670-43c8-9182-d7e93c38ee9b tempest-TestImageHashVerification-872605357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0389652a-10fe-457c-ae95-870ed52b8107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:53:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3cf9e66c-7670-43c8-9182-d7e93c38ee9b tempest-TestImageHashVerification-872605357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0389652a-10fe-457c-ae95-870ed52b8107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:53:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3cf9e66c-7670-43c8-9182-d7e93c38ee9b tempest-TestImageHashVerification-872605357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (959166cd-d0ca-4442-8daf-b8039eb7e547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:53:36 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-3cf9e66c-7670-43c8-9182-d7e93c38ee9b tempest-TestImageHashVerification-872605357 None] Volume 604382f0-69c8-415a-994d-2580339164f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-604382f0-69c8-415a-994d-2580339164f3', 'volume_size': 1} Sep 04 17:53:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3cf9e66c-7670-43c8-9182-d7e93c38ee9b tempest-TestImageHashVerification-872605357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:53:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3cf9e66c-7670-43c8-9182-d7e93c38ee9b tempest-TestImageHashVerification-872605357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:53:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-3cf9e66c-7670-43c8-9182-d7e93c38ee9b tempest-TestImageHashVerification-872605357 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1503472799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=604382f0-69c8-415a-994d-2580339164f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fecad82025a04c7db49f4a8d03e98568',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:53:36Z,use_quota=True,user_id='a56f423b550844f0961587158e36e065',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:53:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-3cf9e66c-7670-43c8-9182-d7e93c38ee9b tempest-TestImageHashVerification-872605357 None] Creating volume 604382f0-69c8-415a-994d-2580339164f3 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:53:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3cf9e66c-7670-43c8-9182-d7e93c38ee9b tempest-TestImageHashVerification-872605357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:53:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3cf9e66c-7670-43c8-9182-d7e93c38ee9b tempest-TestImageHashVerification-872605357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:53:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-3cf9e66c-7670-43c8-9182-d7e93c38ee9b tempest-TestImageHashVerification-872605357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:53:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-3cf9e66c-7670-43c8-9182-d7e93c38ee9b tempest-TestImageHashVerification-872605357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:53:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3cf9e66c-7670-43c8-9182-d7e93c38ee9b tempest-TestImageHashVerification-872605357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:53:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-3cf9e66c-7670-43c8-9182-d7e93c38ee9b tempest-TestImageHashVerification-872605357 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:53:36 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-3cf9e66c-7670-43c8-9182-d7e93c38ee9b tempest-TestImageHashVerification-872605357 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:53:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3cf9e66c-7670-43c8-9182-d7e93c38ee9b tempest-TestImageHashVerification-872605357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-604382f0-69c8-415a-994d-2580339164f3 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:53:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-22c1c384-d98c-4b60-af26-8b13c797d740 tempest-VolumesTestJSON-367195872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8c60bdf0-ebee-476b-acf1-79fb2a134b97" returned: 0 in 1.059s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:53:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-22c1c384-d98c-4b60-af26-8b13c797d740 tempest-VolumesTestJSON-367195872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8c60bdf0-ebee-476b-acf1-79fb2a134b97 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:53:36 devstack sudo[93769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8c60bdf0-ebee-476b-acf1-79fb2a134b97 Sep 04 17:53:36 devstack sudo[93769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:53:36 devstack sudo[93768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-604382f0-69c8-415a-994d-2580339164f3 1073741824 Sep 04 17:53:36 devstack sudo[93768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:53:36 devstack sudo[93769]: pam_unix(sudo:session): session closed for user root Sep 04 17:53:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-22c1c384-d98c-4b60-af26-8b13c797d740 tempest-VolumesTestJSON-367195872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8c60bdf0-ebee-476b-acf1-79fb2a134b97" returned: 0 in 0.662s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:53:36 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-22c1c384-d98c-4b60-af26-8b13c797d740 tempest-VolumesTestJSON-367195872 None] Lock "cinder-quobyte-8c60bdf0-ebee-476b-acf1-79fb2a134b97" released by "delete_volume" :: held 1.801s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:53:36 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-22c1c384-d98c-4b60-af26-8b13c797d740 tempest-VolumesTestJSON-367195872 None] Created reservations ['55a2fb5c-6c3e-48c6-beca-97fd13ca28bb', '9770914a-a191-4ae5-9b36-431b8ae13ab0', '6325ca65-db1b-422c-b738-4178f0d1d79d', '7c88d6c6-72a6-48d6-ae7c-6dbf41a858b9'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:53:36 devstack sudo[93768]: pam_unix(sudo:session): session closed for user root Sep 04 17:53:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3cf9e66c-7670-43c8-9182-d7e93c38ee9b tempest-TestImageHashVerification-872605357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-604382f0-69c8-415a-994d-2580339164f3 1073741824" returned: 0 in 0.943s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:53:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-22c1c384-d98c-4b60-af26-8b13c797d740 tempest-VolumesTestJSON-367195872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:53:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-22c1c384-d98c-4b60-af26-8b13c797d740 tempest-VolumesTestJSON-367195872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:53:37 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-22c1c384-d98c-4b60-af26-8b13c797d740 tempest-VolumesTestJSON-367195872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:53:37 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-22c1c384-d98c-4b60-af26-8b13c797d740 tempest-VolumesTestJSON-367195872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:53:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-22c1c384-d98c-4b60-af26-8b13c797d740 tempest-VolumesTestJSON-367195872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:53:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-22c1c384-d98c-4b60-af26-8b13c797d740 tempest-VolumesTestJSON-367195872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:53:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3cf9e66c-7670-43c8-9182-d7e93c38ee9b tempest-TestImageHashVerification-872605357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-604382f0-69c8-415a-994d-2580339164f3 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:53:37 devstack sudo[93779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:53:37 devstack sudo[93779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:53:37 devstack sudo[93781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-604382f0-69c8-415a-994d-2580339164f3 Sep 04 17:53:37 devstack sudo[93781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:53:37 devstack sudo[93779]: pam_unix(sudo:session): session closed for user root Sep 04 17:53:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-22c1c384-d98c-4b60-af26-8b13c797d740 tempest-VolumesTestJSON-367195872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.412s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:53:37 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-22c1c384-d98c-4b60-af26-8b13c797d740 tempest-VolumesTestJSON-367195872 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:53:37 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-22c1c384-d98c-4b60-af26-8b13c797d740 tempest-VolumesTestJSON-367195872 None] Deleted volume successfully. Sep 04 17:53:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-22c1c384-d98c-4b60-af26-8b13c797d740 tempest-VolumesTestJSON-367195872 None] Lock "cinder-8c60bdf0-ebee-476b-acf1-79fb2a134b97-delete_volume" released by "delete_volume" :: held 2.704s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:53:37 devstack sudo[93781]: pam_unix(sudo:session): session closed for user root Sep 04 17:53:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3cf9e66c-7670-43c8-9182-d7e93c38ee9b tempest-TestImageHashVerification-872605357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-604382f0-69c8-415a-994d-2580339164f3" returned: 0 in 0.497s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:53:37 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-3cf9e66c-7670-43c8-9182-d7e93c38ee9b tempest-TestImageHashVerification-872605357 None] <== create_volume: return (1598ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:53:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3cf9e66c-7670-43c8-9182-d7e93c38ee9b tempest-TestImageHashVerification-872605357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.603s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:53:37 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3cf9e66c-7670-43c8-9182-d7e93c38ee9b tempest-TestImageHashVerification-872605357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (959166cd-d0ca-4442-8daf-b8039eb7e547) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-604382f0-69c8-415a-994d-2580339164f3', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:53:37 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3cf9e66c-7670-43c8-9182-d7e93c38ee9b tempest-TestImageHashVerification-872605357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06646428-190c-4dff-8760-35515d8778c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:53:37 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-3cf9e66c-7670-43c8-9182-d7e93c38ee9b tempest-TestImageHashVerification-872605357 None] Volume volume-604382f0-69c8-415a-994d-2580339164f3 (604382f0-69c8-415a-994d-2580339164f3): created successfully Sep 04 17:53:37 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3cf9e66c-7670-43c8-9182-d7e93c38ee9b tempest-TestImageHashVerification-872605357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06646428-190c-4dff-8760-35515d8778c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:53:37 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3cf9e66c-7670-43c8-9182-d7e93c38ee9b tempest-TestImageHashVerification-872605357 None] Flow 'volume_create_manager' (286ee072-0e06-46ac-b130-5a52be25e980) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:53:37 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-3cf9e66c-7670-43c8-9182-d7e93c38ee9b tempest-TestImageHashVerification-872605357 None] Created volume successfully. Sep 04 17:53:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-db31397a-de98-456f-8e74-a927ab60e1f6 tempest-TestImageHashVerification-872605357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:53:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-db31397a-de98-456f-8e74-a927ab60e1f6 tempest-TestImageHashVerification-872605357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:53:40 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d30bd4-ee03-4ff2-aa82-cf2f54587de0]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:53:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-db31397a-de98-456f-8e74-a927ab60e1f6 tempest-TestImageHashVerification-872605357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-604382f0-69c8-415a-994d-2580339164f3 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:53:40 devstack sudo[93787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-604382f0-69c8-415a-994d-2580339164f3 Sep 04 17:53:40 devstack sudo[93787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:53:40 devstack sudo[93787]: pam_unix(sudo:session): session closed for user root Sep 04 17:53:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-db31397a-de98-456f-8e74-a927ab60e1f6 tempest-TestImageHashVerification-872605357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-604382f0-69c8-415a-994d-2580339164f3" returned: 0 in 0.528s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:53:40 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd35567f-7bbc-43f8-81e5-0a92bfe5446d]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:53:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-db31397a-de98-456f-8e74-a927ab60e1f6 tempest-TestImageHashVerification-872605357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-604382f0-69c8-415a-994d-2580339164f3 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:53:40 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-25cc3905-aac7-424e-8c41-394a04fbce1e tempest-ServerActionsTestOtherA-1015930920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:53:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-25cc3905-aac7-424e-8c41-394a04fbce1e tempest-ServerActionsTestOtherA-1015930920 None] Flow 'volume_create_manager' (cf474096-6386-49e1-a8a4-04a3f52be174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:53:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-25cc3905-aac7-424e-8c41-394a04fbce1e tempest-ServerActionsTestOtherA-1015930920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bce65b59-e1e0-4b93-b603-1c971d9e527e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:53:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-25cc3905-aac7-424e-8c41-394a04fbce1e tempest-ServerActionsTestOtherA-1015930920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bce65b59-e1e0-4b93-b603-1c971d9e527e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:53:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1952882679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa30b325-b68f-453d-bc16-a72e3ad267cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0498a9fd04d426080085417f1d1ee5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:53:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:53:41Z,use_quota=True,user_id='93b6e3f4bd6b4ee7b9720be68f95a058',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:53:40 devstack sudo[93793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-604382f0-69c8-415a-994d-2580339164f3 Sep 04 17:53:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-25cc3905-aac7-424e-8c41-394a04fbce1e tempest-ServerActionsTestOtherA-1015930920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8191cbdf-8bd6-4f33-a8e0-b6a5f37c4ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:53:40 devstack sudo[93793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:53:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-25cc3905-aac7-424e-8c41-394a04fbce1e tempest-ServerActionsTestOtherA-1015930920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8191cbdf-8bd6-4f33-a8e0-b6a5f37c4ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:53:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-25cc3905-aac7-424e-8c41-394a04fbce1e tempest-ServerActionsTestOtherA-1015930920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8681cea7-0497-4ed7-9783-6f6a7e92e7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:53:40 devstack cinder-volume[87314]: DEBUG cinder.image.glance [None req-25cc3905-aac7-424e-8c41-394a04fbce1e tempest-ServerActionsTestOtherA-1015930920 None] Creating Keystone auth plugin from conf {{(pid=87314) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 04 17:53:41 devstack sudo[93793]: pam_unix(sudo:session): session closed for user root Sep 04 17:53:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-db31397a-de98-456f-8e74-a927ab60e1f6 tempest-TestImageHashVerification-872605357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-604382f0-69c8-415a-994d-2580339164f3" returned: 0 in 0.470s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:53:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-db31397a-de98-456f-8e74-a927ab60e1f6 tempest-TestImageHashVerification-872605357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-604382f0-69c8-415a-994d-2580339164f3 /opt/stack/data/cinder/conversion/604382f0-69c8-415a-994d-2580339164f3.temp_image.e1e7312f-a0b6-4918-b74c-f64f3b8a6c712hgw2uzf.img {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:53:41 devstack sudo[93798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-604382f0-69c8-415a-994d-2580339164f3 /opt/stack/data/cinder/conversion/604382f0-69c8-415a-994d-2580339164f3.temp_image.e1e7312f-a0b6-4918-b74c-f64f3b8a6c712hgw2uzf.img Sep 04 17:53:41 devstack sudo[93798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:53:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-25cc3905-aac7-424e-8c41-394a04fbce1e tempest-ServerActionsTestOtherA-1015930920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8681cea7-0497-4ed7-9783-6f6a7e92e7b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fa30b325-b68f-453d-bc16-a72e3ad267cc', 'volume_name': 'volume-fa30b325-b68f-453d-bc16-a72e3ad267cc', 'volume_size': 1, 'image_id': 'eeb1e1b9-f612-4acd-9439-6285840a52d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eeb1e1b9-f612-4acd-9439-6285840a52d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'be7dacacfc0f482c9fff51cfcb1c78e5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eeb1e1b9-f612-4acd-9439-6285840a52d1', 'created_at': datetime.datetime(2026, 9, 4, 15, 43, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 15, 43, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eeb1e1b9-f612-4acd-9439-6285840a52d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:53:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-25cc3905-aac7-424e-8c41-394a04fbce1e tempest-ServerActionsTestOtherA-1015930920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85a29dbf-9456-4ef0-b011-d4775849c673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:53:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-25cc3905-aac7-424e-8c41-394a04fbce1e tempest-ServerActionsTestOtherA-1015930920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85a29dbf-9456-4ef0-b011-d4775849c673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:53:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-25cc3905-aac7-424e-8c41-394a04fbce1e tempest-ServerActionsTestOtherA-1015930920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a71bbc8d-634b-467a-b1d9-2683001e9562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:53:41 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-25cc3905-aac7-424e-8c41-394a04fbce1e tempest-ServerActionsTestOtherA-1015930920 None] Volume fa30b325-b68f-453d-bc16-a72e3ad267cc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fa30b325-b68f-453d-bc16-a72e3ad267cc', 'volume_size': 1, 'image_id': 'eeb1e1b9-f612-4acd-9439-6285840a52d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eeb1e1b9-f612-4acd-9439-6285840a52d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'be7dacacfc0f482c9fff51cfcb1c78e5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eeb1e1b9-f612-4acd-9439-6285840a52d1', 'created_at': datetime.datetime(2026, 9, 4, 15, 43, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 15, 43, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eeb1e1b9-f612-4acd-9439-6285840a52d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 04 17:53:41 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-25cc3905-aac7-424e-8c41-394a04fbce1e tempest-ServerActionsTestOtherA-1015930920 None] Trying to clone fa30b325-b68f-453d-bc16-a72e3ad267cc from image eeb1e1b9-f612-4acd-9439-6285840a52d1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/eeb1e1b9-f612-4acd-9439-6285840a52d1', 'metadata': {}}]). {{(pid=87314) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 04 17:53:42 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-25cc3905-aac7-424e-8c41-394a04fbce1e tempest-ServerActionsTestOtherA-1015930920 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1_lqek71mwdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87314) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 04 17:53:42 devstack cinder-volume[87314]: INFO cinder.image.image_utils [None req-25cc3905-aac7-424e-8c41-394a04fbce1e tempest-ServerActionsTestOtherA-1015930920 None] Image download 20.69 MB at 20.69 MB/s Sep 04 17:53:42 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc80334-1c48-4c15-9c77-c8e1a41151a3]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:53:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-25cc3905-aac7-424e-8c41-394a04fbce1e tempest-ServerActionsTestOtherA-1015930920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1_lqek71mwdevstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:53:42 devstack sudo[93826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1_lqek71mwdevstack@QuobyteHD Sep 04 17:53:42 devstack sudo[93826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:53:43 devstack sudo[93826]: pam_unix(sudo:session): session closed for user root Sep 04 17:53:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-25cc3905-aac7-424e-8c41-394a04fbce1e tempest-ServerActionsTestOtherA-1015930920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1_lqek71mwdevstack@QuobyteHD" returned: 0 in 0.988s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:53:43 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-25cc3905-aac7-424e-8c41-394a04fbce1e tempest-ServerActionsTestOtherA-1015930920 None] Temporary image eeb1e1b9-f612-4acd-9439-6285840a52d1 is fetched for user 93b6e3f4bd6b4ee7b9720be68f95a058. {{(pid=87314) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 04 17:53:43 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[3877e70e-5faf-4b13-a4bf-98a146b2a6bb]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:53:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-25cc3905-aac7-424e-8c41-394a04fbce1e tempest-ServerActionsTestOtherA-1015930920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1_lqek71mwdevstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:53:43 devstack sudo[93832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1_lqek71mwdevstack@QuobyteHD Sep 04 17:53:43 devstack sudo[93832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:53:44 devstack sudo[93832]: pam_unix(sudo:session): session closed for user root Sep 04 17:53:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-25cc3905-aac7-424e-8c41-394a04fbce1e tempest-ServerActionsTestOtherA-1015930920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1_lqek71mwdevstack@QuobyteHD" returned: 0 in 0.874s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:53:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-25cc3905-aac7-424e-8c41-394a04fbce1e tempest-ServerActionsTestOtherA-1015930920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:53:45 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-b81aa43d-990e-41f1-9b27-bb68e7fc76fd tempest-SnapshotsActionsTest-645252037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:53:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b81aa43d-990e-41f1-9b27-bb68e7fc76fd tempest-SnapshotsActionsTest-645252037 None] Flow 'volume_create_manager' (9dd9f7ee-8b3e-4899-ad24-3886c64dca24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:53:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b81aa43d-990e-41f1-9b27-bb68e7fc76fd tempest-SnapshotsActionsTest-645252037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c441509-445f-43af-8419-38863e53a611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:53:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b81aa43d-990e-41f1-9b27-bb68e7fc76fd tempest-SnapshotsActionsTest-645252037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c441509-445f-43af-8419-38863e53a611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:53:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-795978386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=431da365-79df-4788-b7bb-e3118a36fca0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab499f34b2874075bea5e4ec145c6afe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:53:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:53:45Z,use_quota=True,user_id='d7cd832a5f9a4cf3a490e4410e8ba836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:53:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b81aa43d-990e-41f1-9b27-bb68e7fc76fd tempest-SnapshotsActionsTest-645252037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b0ef0d4-092a-4a87-aaa5-26b84d6e5a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:53:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b81aa43d-990e-41f1-9b27-bb68e7fc76fd tempest-SnapshotsActionsTest-645252037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b0ef0d4-092a-4a87-aaa5-26b84d6e5a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:53:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b81aa43d-990e-41f1-9b27-bb68e7fc76fd tempest-SnapshotsActionsTest-645252037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12109e7f-d7de-42e0-9380-eb53151bcba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:53:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b81aa43d-990e-41f1-9b27-bb68e7fc76fd tempest-SnapshotsActionsTest-645252037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12109e7f-d7de-42e0-9380-eb53151bcba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '431da365-79df-4788-b7bb-e3118a36fca0', 'volume_name': 'volume-431da365-79df-4788-b7bb-e3118a36fca0', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:53:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b81aa43d-990e-41f1-9b27-bb68e7fc76fd tempest-SnapshotsActionsTest-645252037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (376dd2b6-b2ad-44f4-891d-9413d14df64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:53:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b81aa43d-990e-41f1-9b27-bb68e7fc76fd tempest-SnapshotsActionsTest-645252037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (376dd2b6-b2ad-44f4-891d-9413d14df64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:53:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b81aa43d-990e-41f1-9b27-bb68e7fc76fd tempest-SnapshotsActionsTest-645252037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd46c6a9-a178-4449-8b85-81b8b8157f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:53:45 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-b81aa43d-990e-41f1-9b27-bb68e7fc76fd tempest-SnapshotsActionsTest-645252037 None] Volume 431da365-79df-4788-b7bb-e3118a36fca0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-431da365-79df-4788-b7bb-e3118a36fca0', 'volume_size': 1} Sep 04 17:53:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b81aa43d-990e-41f1-9b27-bb68e7fc76fd tempest-SnapshotsActionsTest-645252037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:53:46 devstack sudo[93798]: pam_unix(sudo:session): session closed for user root Sep 04 17:53:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-db31397a-de98-456f-8e74-a927ab60e1f6 tempest-TestImageHashVerification-872605357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-604382f0-69c8-415a-994d-2580339164f3 /opt/stack/data/cinder/conversion/604382f0-69c8-415a-994d-2580339164f3.temp_image.e1e7312f-a0b6-4918-b74c-f64f3b8a6c712hgw2uzf.img" returned: 0 in 5.402s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:53:46 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[18387649-e050-4c1d-8c8f-54e23a3ae8d6]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:53:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-db31397a-de98-456f-8e74-a927ab60e1f6 tempest-TestImageHashVerification-872605357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-604382f0-69c8-415a-994d-2580339164f3 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:53:46 devstack sudo[93859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-604382f0-69c8-415a-994d-2580339164f3 Sep 04 17:53:46 devstack sudo[93859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:53:47 devstack sudo[93859]: pam_unix(sudo:session): session closed for user root Sep 04 17:53:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-db31397a-de98-456f-8e74-a927ab60e1f6 tempest-TestImageHashVerification-872605357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-604382f0-69c8-415a-994d-2580339164f3" returned: 0 in 0.517s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:53:47 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-db31397a-de98-456f-8e74-a927ab60e1f6 tempest-TestImageHashVerification-872605357 None] Image conversion details: src /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-604382f0-69c8-415a-994d-2580339164f3, size 1024.00 MB, duration 5.40 sec, destination /opt/stack/data/cinder/conversion/604382f0-69c8-415a-994d-2580339164f3.temp_image.e1e7312f-a0b6-4918-b74c-f64f3b8a6c712hgw2uzf.img {{(pid=87314) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 17:53:47 devstack cinder-volume[87314]: INFO cinder.image.image_utils [None req-db31397a-de98-456f-8e74-a927ab60e1f6 tempest-TestImageHashVerification-872605357 None] Converted 1024.00 MB image at 189.53 MB/s Sep 04 17:53:47 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-db31397a-de98-456f-8e74-a927ab60e1f6 tempest-TestImageHashVerification-872605357 None] e1e7312f-a0b6-4918-b74c-f64f3b8a6c71 was raw, no need to convert to raw {{(pid=87314) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 04 17:53:57 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=60,cinder:UPDATE=85,cinder:INSERT=20,cinder:DELETE=9 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 17:53:57 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=84,cinder:DELETE=5,cinder:UPDATE=74,cinder:INSERT=17 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 17:54:03 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-21ef6c88-8f9e-4a11-974d-5531e90f5975 req-911a43e0-5e16-42dc-b3b4-e451b9929f90 tempest-AttachVolumeNegativeTest-221345582 None] Terminate volume connection completed successfully. Sep 04 17:54:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-21ef6c88-8f9e-4a11-974d-5531e90f5975 req-911a43e0-5e16-42dc-b3b4-e451b9929f90 tempest-AttachVolumeNegativeTest-221345582 None] Deleting attachment 8763c030-7a17-4f9d-9522-dbb266df8107. {{(pid=87314) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 17:54:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-db31397a-de98-456f-8e74-a927ab60e1f6 tempest-TestImageHashVerification-872605357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.848s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:54:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-db31397a-de98-456f-8e74-a927ab60e1f6 tempest-TestImageHashVerification-872605357 None] Uploaded volume to glance image-id: e1e7312f-a0b6-4918-b74c-f64f3b8a6c71. {{(pid=87314) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 04 17:54:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-25cc3905-aac7-424e-8c41-394a04fbce1e tempest-ServerActionsTestOtherA-1015930920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 23.634s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:54:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-25cc3905-aac7-424e-8c41-394a04fbce1e tempest-ServerActionsTestOtherA-1015930920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:53:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1952882679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa30b325-b68f-453d-bc16-a72e3ad267cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0498a9fd04d426080085417f1d1ee5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:53:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:53:41Z,use_quota=True,user_id='93b6e3f4bd6b4ee7b9720be68f95a058',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:54:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-25cc3905-aac7-424e-8c41-394a04fbce1e tempest-ServerActionsTestOtherA-1015930920 None] Creating volume fa30b325-b68f-453d-bc16-a72e3ad267cc {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:54:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-25cc3905-aac7-424e-8c41-394a04fbce1e tempest-ServerActionsTestOtherA-1015930920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:54:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-25cc3905-aac7-424e-8c41-394a04fbce1e tempest-ServerActionsTestOtherA-1015930920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:54:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-25cc3905-aac7-424e-8c41-394a04fbce1e tempest-ServerActionsTestOtherA-1015930920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:54:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-25cc3905-aac7-424e-8c41-394a04fbce1e tempest-ServerActionsTestOtherA-1015930920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:54:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-25cc3905-aac7-424e-8c41-394a04fbce1e tempest-ServerActionsTestOtherA-1015930920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:54:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-25cc3905-aac7-424e-8c41-394a04fbce1e tempest-ServerActionsTestOtherA-1015930920 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:54:08 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-25cc3905-aac7-424e-8c41-394a04fbce1e tempest-ServerActionsTestOtherA-1015930920 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:54:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-25cc3905-aac7-424e-8c41-394a04fbce1e tempest-ServerActionsTestOtherA-1015930920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-fa30b325-b68f-453d-bc16-a72e3ad267cc 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:08 devstack sudo[93949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-fa30b325-b68f-453d-bc16-a72e3ad267cc 1073741824 Sep 04 17:54:08 devstack sudo[93949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:08 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-db31397a-de98-456f-8e74-a927ab60e1f6 tempest-TestImageHashVerification-872605357 None] Copy volume to image completed successfully. Sep 04 17:54:08 devstack sudo[93949]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-25cc3905-aac7-424e-8c41-394a04fbce1e tempest-ServerActionsTestOtherA-1015930920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-fa30b325-b68f-453d-bc16-a72e3ad267cc 1073741824" returned: 0 in 0.530s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-25cc3905-aac7-424e-8c41-394a04fbce1e tempest-ServerActionsTestOtherA-1015930920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-fa30b325-b68f-453d-bc16-a72e3ad267cc {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:08 devstack sudo[93955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-fa30b325-b68f-453d-bc16-a72e3ad267cc Sep 04 17:54:08 devstack sudo[93955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:08 devstack sudo[93955]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-25cc3905-aac7-424e-8c41-394a04fbce1e tempest-ServerActionsTestOtherA-1015930920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-fa30b325-b68f-453d-bc16-a72e3ad267cc" returned: 0 in 0.242s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-25cc3905-aac7-424e-8c41-394a04fbce1e tempest-ServerActionsTestOtherA-1015930920 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:54:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-25cc3905-aac7-424e-8c41-394a04fbce1e tempest-ServerActionsTestOtherA-1015930920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:54:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b81aa43d-990e-41f1-9b27-bb68e7fc76fd tempest-SnapshotsActionsTest-645252037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 23.147s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:54:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b81aa43d-990e-41f1-9b27-bb68e7fc76fd tempest-SnapshotsActionsTest-645252037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:53:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-795978386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=431da365-79df-4788-b7bb-e3118a36fca0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab499f34b2874075bea5e4ec145c6afe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:53:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:53:45Z,use_quota=True,user_id='d7cd832a5f9a4cf3a490e4410e8ba836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:54:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-b81aa43d-990e-41f1-9b27-bb68e7fc76fd tempest-SnapshotsActionsTest-645252037 None] Creating volume 431da365-79df-4788-b7bb-e3118a36fca0 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:54:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b81aa43d-990e-41f1-9b27-bb68e7fc76fd tempest-SnapshotsActionsTest-645252037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:54:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b81aa43d-990e-41f1-9b27-bb68e7fc76fd tempest-SnapshotsActionsTest-645252037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:54:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b81aa43d-990e-41f1-9b27-bb68e7fc76fd tempest-SnapshotsActionsTest-645252037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:54:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b81aa43d-990e-41f1-9b27-bb68e7fc76fd tempest-SnapshotsActionsTest-645252037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:54:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b81aa43d-990e-41f1-9b27-bb68e7fc76fd tempest-SnapshotsActionsTest-645252037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:54:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b81aa43d-990e-41f1-9b27-bb68e7fc76fd tempest-SnapshotsActionsTest-645252037 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:54:08 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-b81aa43d-990e-41f1-9b27-bb68e7fc76fd tempest-SnapshotsActionsTest-645252037 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:54:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b81aa43d-990e-41f1-9b27-bb68e7fc76fd tempest-SnapshotsActionsTest-645252037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:08 devstack sudo[93958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0 1073741824 Sep 04 17:54:08 devstack sudo[93958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:08 devstack cinder-volume[87314]: DEBUG cinder.volume.volume_utils [None req-25cc3905-aac7-424e-8c41-394a04fbce1e tempest-ServerActionsTestOtherA-1015930920 None] Attempting download of eeb1e1b9-f612-4acd-9439-6285840a52d1 ((None, [{'url': 'file:///opt/stack/data/glance/images/eeb1e1b9-f612-4acd-9439-6285840a52d1', 'metadata': {}}])) to volume fa30b325-b68f-453d-bc16-a72e3ad267cc. {{(pid=87314) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 04 17:54:08 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df6faca-0d9d-4483-89aa-7490c56ad3ae]: (4, 'raw') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:54:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-25cc3905-aac7-424e-8c41-394a04fbce1e tempest-ServerActionsTestOtherA-1015930920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eeb1e1b9-f612-4acd-9439-6285840a52d1_g9mcg6v9 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:09 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f7b828c4-58dd-4a81-8be0-1ca58065f654 tempest-TestImageHashVerification-872605357 None] Acquiring lock "cinder-604382f0-69c8-415a-994d-2580339164f3-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:54:09 devstack sudo[93960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eeb1e1b9-f612-4acd-9439-6285840a52d1_g9mcg6v9 Sep 04 17:54:09 devstack sudo[93960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:09 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f7b828c4-58dd-4a81-8be0-1ca58065f654 tempest-TestImageHashVerification-872605357 None] Lock "cinder-604382f0-69c8-415a-994d-2580339164f3-delete_volume" acquired by "delete_volume" :: waited 0.093s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:54:09 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f7b828c4-58dd-4a81-8be0-1ca58065f654 tempest-TestImageHashVerification-872605357 None] Acquiring lock "cinder-quobyte-604382f0-69c8-415a-994d-2580339164f3" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:54:09 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f7b828c4-58dd-4a81-8be0-1ca58065f654 tempest-TestImageHashVerification-872605357 None] Lock "cinder-quobyte-604382f0-69c8-415a-994d-2580339164f3" acquired by "delete_volume" :: waited 0.036s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:54:09 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee83dd5-cbd6-4dbf-9322-059497b8e0fa]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:54:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f7b828c4-58dd-4a81-8be0-1ca58065f654 tempest-TestImageHashVerification-872605357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-604382f0-69c8-415a-994d-2580339164f3 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:09 devstack sudo[93958]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b81aa43d-990e-41f1-9b27-bb68e7fc76fd tempest-SnapshotsActionsTest-645252037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0 1073741824" returned: 0 in 0.590s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:09 devstack sudo[93960]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-25cc3905-aac7-424e-8c41-394a04fbce1e tempest-ServerActionsTestOtherA-1015930920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eeb1e1b9-f612-4acd-9439-6285840a52d1_g9mcg6v9" returned: 0 in 0.486s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-25cc3905-aac7-424e-8c41-394a04fbce1e tempest-ServerActionsTestOtherA-1015930920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eeb1e1b9-f612-4acd-9439-6285840a52d1_g9mcg6v9 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:09 devstack sudo[93967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-604382f0-69c8-415a-994d-2580339164f3 Sep 04 17:54:09 devstack sudo[93967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b81aa43d-990e-41f1-9b27-bb68e7fc76fd tempest-SnapshotsActionsTest-645252037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:09 devstack sudo[93972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0 Sep 04 17:54:09 devstack sudo[93972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:09 devstack sudo[93970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eeb1e1b9-f612-4acd-9439-6285840a52d1_g9mcg6v9 Sep 04 17:54:09 devstack sudo[93970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:09 devstack sudo[93972]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:09 devstack sudo[93967]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b81aa43d-990e-41f1-9b27-bb68e7fc76fd tempest-SnapshotsActionsTest-645252037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0" returned: 0 in 0.318s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:09 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b81aa43d-990e-41f1-9b27-bb68e7fc76fd tempest-SnapshotsActionsTest-645252037 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:54:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b81aa43d-990e-41f1-9b27-bb68e7fc76fd tempest-SnapshotsActionsTest-645252037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:54:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f7b828c4-58dd-4a81-8be0-1ca58065f654 tempest-TestImageHashVerification-872605357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-604382f0-69c8-415a-994d-2580339164f3" returned: 0 in 0.541s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f7b828c4-58dd-4a81-8be0-1ca58065f654 tempest-TestImageHashVerification-872605357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-604382f0-69c8-415a-994d-2580339164f3 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:09 devstack sudo[93970]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-25cc3905-aac7-424e-8c41-394a04fbce1e tempest-ServerActionsTestOtherA-1015930920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eeb1e1b9-f612-4acd-9439-6285840a52d1_g9mcg6v9" returned: 1 in 0.388s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-25cc3905-aac7-424e-8c41-394a04fbce1e tempest-ServerActionsTestOtherA-1015930920 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eeb1e1b9-f612-4acd-9439-6285840a52d1_g9mcg6v9' failed. Not Retrying. {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 17:54:09 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[aafa3142-124f-45e6-b79b-74dea44f87e8]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:54:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-25cc3905-aac7-424e-8c41-394a04fbce1e tempest-ServerActionsTestOtherA-1015930920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1_lqek71mwdevstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:09 devstack sudo[93981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-604382f0-69c8-415a-994d-2580339164f3 Sep 04 17:54:09 devstack sudo[93981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b81aa43d-990e-41f1-9b27-bb68e7fc76fd tempest-SnapshotsActionsTest-645252037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd46c6a9-a178-4449-8b85-81b8b8157f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-431da365-79df-4788-b7bb-e3118a36fca0', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:54:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b81aa43d-990e-41f1-9b27-bb68e7fc76fd tempest-SnapshotsActionsTest-645252037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6228fb39-744c-4dab-a6c2-c99ddf2d9585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:54:09 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-b81aa43d-990e-41f1-9b27-bb68e7fc76fd tempest-SnapshotsActionsTest-645252037 None] Volume volume-431da365-79df-4788-b7bb-e3118a36fca0 (431da365-79df-4788-b7bb-e3118a36fca0): created successfully Sep 04 17:54:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b81aa43d-990e-41f1-9b27-bb68e7fc76fd tempest-SnapshotsActionsTest-645252037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6228fb39-744c-4dab-a6c2-c99ddf2d9585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:54:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b81aa43d-990e-41f1-9b27-bb68e7fc76fd tempest-SnapshotsActionsTest-645252037 None] Flow 'volume_create_manager' (9dd9f7ee-8b3e-4899-ad24-3886c64dca24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:54:09 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-b81aa43d-990e-41f1-9b27-bb68e7fc76fd tempest-SnapshotsActionsTest-645252037 None] Created volume successfully. Sep 04 17:54:09 devstack sudo[93982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1_lqek71mwdevstack@QuobyteHD Sep 04 17:54:09 devstack sudo[93982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:10 devstack sudo[93981]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f7b828c4-58dd-4a81-8be0-1ca58065f654 tempest-TestImageHashVerification-872605357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-604382f0-69c8-415a-994d-2580339164f3" returned: 0 in 0.298s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:10 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f7b828c4-58dd-4a81-8be0-1ca58065f654 tempest-TestImageHashVerification-872605357 None] Lock "cinder-quobyte-604382f0-69c8-415a-994d-2580339164f3" released by "delete_volume" :: held 0.894s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:54:10 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-f7b828c4-58dd-4a81-8be0-1ca58065f654 tempest-TestImageHashVerification-872605357 None] Created reservations ['d396597b-cfdb-4ec6-b493-9f7db160c1eb', '329c7244-52f0-4a79-af28-886256c7e944', 'd5e7b1db-d77b-406f-a810-8a4c2bd76c1b', '9872e409-2dfa-4eb1-af57-d4a7091c6f52'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:54:10 devstack sudo[93982]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-25cc3905-aac7-424e-8c41-394a04fbce1e tempest-ServerActionsTestOtherA-1015930920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1_lqek71mwdevstack@QuobyteHD" returned: 0 in 0.389s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:10 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-25cc3905-aac7-424e-8c41-394a04fbce1e tempest-ServerActionsTestOtherA-1015930920 None] eeb1e1b9-f612-4acd-9439-6285840a52d1 was qcow2, converting to qcow2 {{(pid=87314) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 04 17:54:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-25cc3905-aac7-424e-8c41-394a04fbce1e tempest-ServerActionsTestOtherA-1015930920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1_lqek71mwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-fa30b325-b68f-453d-bc16-a72e3ad267cc {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:10 devstack sudo[93989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1_lqek71mwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-fa30b325-b68f-453d-bc16-a72e3ad267cc Sep 04 17:54:10 devstack sudo[93989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f7b828c4-58dd-4a81-8be0-1ca58065f654 tempest-TestImageHashVerification-872605357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:54:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f7b828c4-58dd-4a81-8be0-1ca58065f654 tempest-TestImageHashVerification-872605357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:54:10 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f7b828c4-58dd-4a81-8be0-1ca58065f654 tempest-TestImageHashVerification-872605357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:54:10 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f7b828c4-58dd-4a81-8be0-1ca58065f654 tempest-TestImageHashVerification-872605357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:54:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f7b828c4-58dd-4a81-8be0-1ca58065f654 tempest-TestImageHashVerification-872605357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:54:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f7b828c4-58dd-4a81-8be0-1ca58065f654 tempest-TestImageHashVerification-872605357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:10 devstack sudo[93991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:54:10 devstack sudo[93991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:10 devstack sudo[93991]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f7b828c4-58dd-4a81-8be0-1ca58065f654 tempest-TestImageHashVerification-872605357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.285s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:10 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-f7b828c4-58dd-4a81-8be0-1ca58065f654 tempest-TestImageHashVerification-872605357 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:54:10 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-f7b828c4-58dd-4a81-8be0-1ca58065f654 tempest-TestImageHashVerification-872605357 None] Deleted volume successfully. Sep 04 17:54:10 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f7b828c4-58dd-4a81-8be0-1ca58065f654 tempest-TestImageHashVerification-872605357 None] Lock "cinder-604382f0-69c8-415a-994d-2580339164f3-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:54:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-28794f19-6ca7-4dd4-82f8-33c3050e5873 tempest-SnapshotsActionsTest-645252037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:54:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-28794f19-6ca7-4dd4-82f8-33c3050e5873 tempest-SnapshotsActionsTest-645252037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:54:10 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-28794f19-6ca7-4dd4-82f8-33c3050e5873 tempest-SnapshotsActionsTest-645252037 None] Creating offline snapshot acaa2075-4547-4ff2-a1d5-af59083a521b of volume 431da365-79df-4788-b7bb-e3118a36fca0 {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 17:54:10 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0571b9-8510-48a9-955e-0bb71df38a1f]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:54:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-28794f19-6ca7-4dd4-82f8-33c3050e5873 tempest-SnapshotsActionsTest-645252037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:11 devstack sudo[93999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0 Sep 04 17:54:11 devstack sudo[93999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:11 devstack sudo[93999]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-28794f19-6ca7-4dd4-82f8-33c3050e5873 tempest-SnapshotsActionsTest-645252037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0" returned: 0 in 0.476s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-28794f19-6ca7-4dd4-82f8-33c3050e5873 tempest-SnapshotsActionsTest-645252037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:11 devstack sudo[94005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b 1G Sep 04 17:54:11 devstack sudo[94005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:11 devstack sudo[94005]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-28794f19-6ca7-4dd4-82f8-33c3050e5873 tempest-SnapshotsActionsTest-645252037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b 1G" returned: 0 in 0.577s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-28794f19-6ca7-4dd4-82f8-33c3050e5873 tempest-SnapshotsActionsTest-645252037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-431da365-79df-4788-b7bb-e3118a36fca0 -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:12 devstack sudo[94010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-431da365-79df-4788-b7bb-e3118a36fca0 -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b Sep 04 17:54:12 devstack sudo[94010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:12 devstack sudo[94010]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-28794f19-6ca7-4dd4-82f8-33c3050e5873 tempest-SnapshotsActionsTest-645252037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-431da365-79df-4788-b7bb-e3118a36fca0 -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b" returned: 0 in 0.482s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:12 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-28794f19-6ca7-4dd4-82f8-33c3050e5873 tempest-SnapshotsActionsTest-645252037 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b is being set with open permissions: ugo+rw Sep 04 17:54:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-28794f19-6ca7-4dd4-82f8-33c3050e5873 tempest-SnapshotsActionsTest-645252037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:12 devstack sudo[93989]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-25cc3905-aac7-424e-8c41-394a04fbce1e tempest-ServerActionsTestOtherA-1015930920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1_lqek71mwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-fa30b325-b68f-453d-bc16-a72e3ad267cc" returned: 0 in 2.250s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:12 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-25cc3905-aac7-424e-8c41-394a04fbce1e tempest-ServerActionsTestOtherA-1015930920 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1_lqek71mwdevstack@QuobyteHD, size 112.00 MB, duration 2.25 sec, destination /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-fa30b325-b68f-453d-bc16-a72e3ad267cc {{(pid=87314) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 17:54:12 devstack cinder-volume[87314]: INFO cinder.image.image_utils [None req-25cc3905-aac7-424e-8c41-394a04fbce1e tempest-ServerActionsTestOtherA-1015930920 None] Converted 112.00 MB image at 49.75 MB/s Sep 04 17:54:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-25cc3905-aac7-424e-8c41-394a04fbce1e tempest-ServerActionsTestOtherA-1015930920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-fa30b325-b68f-453d-bc16-a72e3ad267cc 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:12 devstack sudo[94018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b Sep 04 17:54:12 devstack sudo[94018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:12 devstack sudo[94019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-fa30b325-b68f-453d-bc16-a72e3ad267cc 1G Sep 04 17:54:12 devstack sudo[94019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:12 devstack sudo[94018]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-28794f19-6ca7-4dd4-82f8-33c3050e5873 tempest-SnapshotsActionsTest-645252037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b" returned: 0 in 0.324s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-28794f19-6ca7-4dd4-82f8-33c3050e5873 tempest-SnapshotsActionsTest-645252037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:12 devstack sudo[94019]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-25cc3905-aac7-424e-8c41-394a04fbce1e tempest-ServerActionsTestOtherA-1015930920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-fa30b325-b68f-453d-bc16-a72e3ad267cc 1G" returned: 0 in 0.354s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:12 devstack cinder-volume[87314]: DEBUG cinder.volume.volume_utils [None req-25cc3905-aac7-424e-8c41-394a04fbce1e tempest-ServerActionsTestOtherA-1015930920 None] Downloaded image eeb1e1b9-f612-4acd-9439-6285840a52d1 ((None, [{'url': 'file:///opt/stack/data/glance/images/eeb1e1b9-f612-4acd-9439-6285840a52d1', 'metadata': {}}])) to volume fa30b325-b68f-453d-bc16-a72e3ad267cc successfully. {{(pid=87314) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 04 17:54:12 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-25cc3905-aac7-424e-8c41-394a04fbce1e tempest-ServerActionsTestOtherA-1015930920 None] Temporary image eeb1e1b9-f612-4acd-9439-6285840a52d1 for user 93b6e3f4bd6b4ee7b9720be68f95a058 is deleted. {{(pid=87314) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 04 17:54:12 devstack cinder-volume[87314]: DEBUG cinder.volume.volume_utils [None req-25cc3905-aac7-424e-8c41-394a04fbce1e tempest-ServerActionsTestOtherA-1015930920 None] Marking volume fa30b325-b68f-453d-bc16-a72e3ad267cc as bootable. {{(pid=87314) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 04 17:54:12 devstack sudo[94027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.info Sep 04 17:54:12 devstack sudo[94027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:12 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-25cc3905-aac7-424e-8c41-394a04fbce1e tempest-ServerActionsTestOtherA-1015930920 None] Copying metadata from image eeb1e1b9-f612-4acd-9439-6285840a52d1 to fa30b325-b68f-453d-bc16-a72e3ad267cc. {{(pid=87314) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 04 17:54:12 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-25cc3905-aac7-424e-8c41-394a04fbce1e tempest-ServerActionsTestOtherA-1015930920 None] Creating volume glance metadata for volume fa30b325-b68f-453d-bc16-a72e3ad267cc backed by image eeb1e1b9-f612-4acd-9439-6285840a52d1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'eeb1e1b9-f612-4acd-9439-6285840a52d1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87314) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 04 17:54:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-25cc3905-aac7-424e-8c41-394a04fbce1e tempest-ServerActionsTestOtherA-1015930920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a71bbc8d-634b-467a-b1d9-2683001e9562) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa30b325-b68f-453d-bc16-a72e3ad267cc', 'volume_size': 1, 'image_id': 'eeb1e1b9-f612-4acd-9439-6285840a52d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eeb1e1b9-f612-4acd-9439-6285840a52d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'be7dacacfc0f482c9fff51cfcb1c78e5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eeb1e1b9-f612-4acd-9439-6285840a52d1', 'created_at': datetime.datetime(2026, 9, 4, 15, 43, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 15, 43, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eeb1e1b9-f612-4acd-9439-6285840a52d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:54:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-25cc3905-aac7-424e-8c41-394a04fbce1e tempest-ServerActionsTestOtherA-1015930920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11af03cf-5201-46cd-b8e7-e2af9ad3ba77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:54:13 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-25cc3905-aac7-424e-8c41-394a04fbce1e tempest-ServerActionsTestOtherA-1015930920 None] Volume volume-fa30b325-b68f-453d-bc16-a72e3ad267cc (fa30b325-b68f-453d-bc16-a72e3ad267cc): created successfully Sep 04 17:54:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-25cc3905-aac7-424e-8c41-394a04fbce1e tempest-ServerActionsTestOtherA-1015930920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11af03cf-5201-46cd-b8e7-e2af9ad3ba77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:54:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-25cc3905-aac7-424e-8c41-394a04fbce1e tempest-ServerActionsTestOtherA-1015930920 None] Flow 'volume_create_manager' (cf474096-6386-49e1-a8a4-04a3f52be174) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:54:13 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-25cc3905-aac7-424e-8c41-394a04fbce1e tempest-ServerActionsTestOtherA-1015930920 None] Created volume successfully. Sep 04 17:54:13 devstack sudo[94027]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-28794f19-6ca7-4dd4-82f8-33c3050e5873 tempest-SnapshotsActionsTest-645252037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.info" returned: 0 in 0.328s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:13 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-28794f19-6ca7-4dd4-82f8-33c3050e5873 tempest-SnapshotsActionsTest-645252037 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.info is being set with open permissions: ugo+rw Sep 04 17:54:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-28794f19-6ca7-4dd4-82f8-33c3050e5873 tempest-SnapshotsActionsTest-645252037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:13 devstack sudo[94031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.info Sep 04 17:54:13 devstack sudo[94031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:13 devstack sudo[94031]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-28794f19-6ca7-4dd4-82f8-33c3050e5873 tempest-SnapshotsActionsTest-645252037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.info" returned: 0 in 0.299s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-28794f19-6ca7-4dd4-82f8-33c3050e5873 tempest-SnapshotsActionsTest-645252037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.592s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:54:13 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-28794f19-6ca7-4dd4-82f8-33c3050e5873 tempest-SnapshotsActionsTest-645252037 None] Create snapshot completed successfully Sep 04 17:54:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-081d2c8a-adee-4344-82f0-edd49e22e661 tempest-SnapshotsActionsTest-645252037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:54:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-081d2c8a-adee-4344-82f0-edd49e22e661 tempest-SnapshotsActionsTest-645252037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:54:14 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-081d2c8a-adee-4344-82f0-edd49e22e661 tempest-SnapshotsActionsTest-645252037 None] Creating offline snapshot 0a7d8847-5bb9-4f6c-8080-500caaa57d64 of volume 431da365-79df-4788-b7bb-e3118a36fca0 {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 17:54:14 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1c50e9-d97e-4e51-b504-54fbac46f763]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:54:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-081d2c8a-adee-4344-82f0-edd49e22e661 tempest-SnapshotsActionsTest-645252037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:15 devstack sudo[94051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b Sep 04 17:54:15 devstack sudo[94051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:15 devstack sudo[94051]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-081d2c8a-adee-4344-82f0-edd49e22e661 tempest-SnapshotsActionsTest-645252037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b" returned: 0 in 0.481s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-081d2c8a-adee-4344-82f0-edd49e22e661 tempest-SnapshotsActionsTest-645252037 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-431da365-79df-4788-b7bb-e3118a36fca0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 17:54:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-081d2c8a-adee-4344-82f0-edd49e22e661 tempest-SnapshotsActionsTest-645252037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.0a7d8847-5bb9-4f6c-8080-500caaa57d64 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:15 devstack sudo[94059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.0a7d8847-5bb9-4f6c-8080-500caaa57d64 1G Sep 04 17:54:15 devstack sudo[94059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:15 devstack sudo[94059]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-081d2c8a-adee-4344-82f0-edd49e22e661 tempest-SnapshotsActionsTest-645252037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.0a7d8847-5bb9-4f6c-8080-500caaa57d64 1G" returned: 0 in 0.424s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-081d2c8a-adee-4344-82f0-edd49e22e661 tempest-SnapshotsActionsTest-645252037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.0a7d8847-5bb9-4f6c-8080-500caaa57d64 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:15 devstack sudo[94065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.0a7d8847-5bb9-4f6c-8080-500caaa57d64 Sep 04 17:54:15 devstack sudo[94065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:16 devstack sudo[94065]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-081d2c8a-adee-4344-82f0-edd49e22e661 tempest-SnapshotsActionsTest-645252037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.0a7d8847-5bb9-4f6c-8080-500caaa57d64" returned: 0 in 0.291s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:16 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-081d2c8a-adee-4344-82f0-edd49e22e661 tempest-SnapshotsActionsTest-645252037 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.0a7d8847-5bb9-4f6c-8080-500caaa57d64 is being set with open permissions: ugo+rw Sep 04 17:54:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-081d2c8a-adee-4344-82f0-edd49e22e661 tempest-SnapshotsActionsTest-645252037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.0a7d8847-5bb9-4f6c-8080-500caaa57d64 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:16 devstack sudo[94070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.0a7d8847-5bb9-4f6c-8080-500caaa57d64 Sep 04 17:54:16 devstack sudo[94070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:16 devstack sudo[94070]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-081d2c8a-adee-4344-82f0-edd49e22e661 tempest-SnapshotsActionsTest-645252037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.0a7d8847-5bb9-4f6c-8080-500caaa57d64" returned: 0 in 0.258s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-081d2c8a-adee-4344-82f0-edd49e22e661 tempest-SnapshotsActionsTest-645252037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.603s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:54:16 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-081d2c8a-adee-4344-82f0-edd49e22e661 tempest-SnapshotsActionsTest-645252037 None] Create snapshot completed successfully Sep 04 17:54:17 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f3e0d5ff-491d-4bc2-b1af-05a88bffdb06 tempest-SnapshotsActionsTest-179960074 None] Acquiring lock "cinder-0a7d8847-5bb9-4f6c-8080-500caaa57d64-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:54:17 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f3e0d5ff-491d-4bc2-b1af-05a88bffdb06 tempest-SnapshotsActionsTest-179960074 None] Lock "cinder-0a7d8847-5bb9-4f6c-8080-500caaa57d64-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:54:17 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f3e0d5ff-491d-4bc2-b1af-05a88bffdb06 tempest-SnapshotsActionsTest-179960074 None] Acquiring lock "cinder-quobyte-431da365-79df-4788-b7bb-e3118a36fca0" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:54:17 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f3e0d5ff-491d-4bc2-b1af-05a88bffdb06 tempest-SnapshotsActionsTest-179960074 None] Lock "cinder-quobyte-431da365-79df-4788-b7bb-e3118a36fca0" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:54:17 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f3e0d5ff-491d-4bc2-b1af-05a88bffdb06 tempest-SnapshotsActionsTest-179960074 None] Acquiring lock "cinder-quobyte-0a7d8847-5bb9-4f6c-8080-500caaa57d64" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:54:17 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f3e0d5ff-491d-4bc2-b1af-05a88bffdb06 tempest-SnapshotsActionsTest-179960074 None] Lock "cinder-quobyte-0a7d8847-5bb9-4f6c-8080-500caaa57d64" acquired by "_delete_snapshot" :: waited 0.080s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:54:17 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-f3e0d5ff-491d-4bc2-b1af-05a88bffdb06 tempest-SnapshotsActionsTest-179960074 None] Deleting offline snapshot 0a7d8847-5bb9-4f6c-8080-500caaa57d64 of volume 431da365-79df-4788-b7bb-e3118a36fca0 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 17:54:17 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-f3e0d5ff-491d-4bc2-b1af-05a88bffdb06 tempest-SnapshotsActionsTest-179960074 None] snapshot_file for this snap is: volume-431da365-79df-4788-b7bb-e3118a36fca0.0a7d8847-5bb9-4f6c-8080-500caaa57d64 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 17:54:17 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[2608018f-e28d-4621-8d92-7d08f1aed084]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:54:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f3e0d5ff-491d-4bc2-b1af-05a88bffdb06 tempest-SnapshotsActionsTest-179960074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.0a7d8847-5bb9-4f6c-8080-500caaa57d64 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:18 devstack sudo[94115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.0a7d8847-5bb9-4f6c-8080-500caaa57d64 Sep 04 17:54:18 devstack sudo[94115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:18 devstack sudo[94115]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f3e0d5ff-491d-4bc2-b1af-05a88bffdb06 tempest-SnapshotsActionsTest-179960074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.0a7d8847-5bb9-4f6c-8080-500caaa57d64" returned: 0 in 0.764s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:18 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-f3e0d5ff-491d-4bc2-b1af-05a88bffdb06 tempest-SnapshotsActionsTest-179960074 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-431da365-79df-4788-b7bb-e3118a36fca0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 17:54:18 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a1647c-96dc-4cf2-b9b4-4da2e24c756b]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:54:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f3e0d5ff-491d-4bc2-b1af-05a88bffdb06 tempest-SnapshotsActionsTest-179960074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:18 devstack sudo[94148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b Sep 04 17:54:18 devstack sudo[94148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:19 devstack sudo[94148]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f3e0d5ff-491d-4bc2-b1af-05a88bffdb06 tempest-SnapshotsActionsTest-179960074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b" returned: 0 in 0.576s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:19 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-f3e0d5ff-491d-4bc2-b1af-05a88bffdb06 tempest-SnapshotsActionsTest-179960074 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-431da365-79df-4788-b7bb-e3118a36fca0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 17:54:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f3e0d5ff-491d-4bc2-b1af-05a88bffdb06 tempest-SnapshotsActionsTest-179960074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.0a7d8847-5bb9-4f6c-8080-500caaa57d64 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:19 devstack sudo[94155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.0a7d8847-5bb9-4f6c-8080-500caaa57d64 Sep 04 17:54:19 devstack sudo[94155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:20 devstack sudo[94155]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f3e0d5ff-491d-4bc2-b1af-05a88bffdb06 tempest-SnapshotsActionsTest-179960074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.0a7d8847-5bb9-4f6c-8080-500caaa57d64" returned: 0 in 0.863s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f3e0d5ff-491d-4bc2-b1af-05a88bffdb06 tempest-SnapshotsActionsTest-179960074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.0a7d8847-5bb9-4f6c-8080-500caaa57d64 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:20 devstack sudo[94165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.0a7d8847-5bb9-4f6c-8080-500caaa57d64 Sep 04 17:54:20 devstack sudo[94165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:20 devstack sudo[94165]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f3e0d5ff-491d-4bc2-b1af-05a88bffdb06 tempest-SnapshotsActionsTest-179960074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.0a7d8847-5bb9-4f6c-8080-500caaa57d64" returned: 0 in 0.469s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:20 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f3e0d5ff-491d-4bc2-b1af-05a88bffdb06 tempest-SnapshotsActionsTest-179960074 None] Lock "cinder-quobyte-0a7d8847-5bb9-4f6c-8080-500caaa57d64" released by "_delete_snapshot" :: held 2.948s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:54:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-275b26f2-a834-409b-b66e-50e7abf365bb req-48a5ffda-12f2-41c8-9063-435af1e4011e tempest-ServerActionsTestOtherA-1015930920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:54:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-275b26f2-a834-409b-b66e-50e7abf365bb req-48a5ffda-12f2-41c8-9063-435af1e4011e tempest-ServerActionsTestOtherA-1015930920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:54:20 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f3e0d5ff-491d-4bc2-b1af-05a88bffdb06 tempest-SnapshotsActionsTest-179960074 None] Lock "cinder-quobyte-431da365-79df-4788-b7bb-e3118a36fca0" released by "delete_snapshot" :: held 3.047s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:54:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-275b26f2-a834-409b-b66e-50e7abf365bb req-48a5ffda-12f2-41c8-9063-435af1e4011e tempest-ServerActionsTestOtherA-1015930920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:54:20 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-275b26f2-a834-409b-b66e-50e7abf365bb req-48a5ffda-12f2-41c8-9063-435af1e4011e tempest-ServerActionsTestOtherA-1015930920 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a', 'name': 'volume-fa30b325-b68f-453d-bc16-a72e3ad267cc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '496f1c19-dde2-46e2-a808-ad3f9996233b', 'enforce_multipath': True} {{(pid=87314) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 17:54:20 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-f3e0d5ff-491d-4bc2-b1af-05a88bffdb06 tempest-SnapshotsActionsTest-179960074 None] Created reservations ['5e789c45-07cc-4356-82f4-28e4e6ddf28e', 'e856f710-34f9-4dff-800f-97bd9ec61bb5', '76b0e49f-4d53-4f04-8039-65c75ead2fff', '0aa84e76-fa97-4387-aff1-ce8bad4b0fb6'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:54:20 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-275b26f2-a834-409b-b66e-50e7abf365bb req-48a5ffda-12f2-41c8-9063-435af1e4011e tempest-ServerActionsTestOtherA-1015930920 None] attachment_update completed successfully. Sep 04 17:54:20 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-f3e0d5ff-491d-4bc2-b1af-05a88bffdb06 tempest-SnapshotsActionsTest-179960074 None] Delete snapshot completed successfully. Sep 04 17:54:20 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f3e0d5ff-491d-4bc2-b1af-05a88bffdb06 tempest-SnapshotsActionsTest-179960074 None] Lock "cinder-0a7d8847-5bb9-4f6c-8080-500caaa57d64-delete_snapshot" released by "delete_snapshot" :: held 3.337s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:54:21 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 17:54:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:54:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:54:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:54:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:54:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:54:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:21 devstack sudo[94174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:54:21 devstack sudo[94174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:21 devstack sudo[94174]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.327s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:21 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:54:21 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running periodic task VolumeManager._thread_info {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 17:54:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] thread count: 28 {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 17:54:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] thread info: [<_MainThread(MainThread, started 139900377723008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 17:54:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-75129e57-3bfc-4328-b2ea-0073b4a67ae2 tempest-SnapshotsActionsTest-645252037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:54:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-75129e57-3bfc-4328-b2ea-0073b4a67ae2 tempest-SnapshotsActionsTest-645252037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:54:22 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-75129e57-3bfc-4328-b2ea-0073b4a67ae2 tempest-SnapshotsActionsTest-645252037 None] Creating offline snapshot 106ada7b-7b95-41e0-a862-004921e80068 of volume 431da365-79df-4788-b7bb-e3118a36fca0 {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 17:54:22 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e1ee75-7575-4234-8bf9-b5d64a1502ed]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:54:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-75129e57-3bfc-4328-b2ea-0073b4a67ae2 tempest-SnapshotsActionsTest-645252037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:22 devstack sudo[94178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b Sep 04 17:54:22 devstack sudo[94178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:23 devstack sudo[94178]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-75129e57-3bfc-4328-b2ea-0073b4a67ae2 tempest-SnapshotsActionsTest-645252037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b" returned: 0 in 0.533s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:23 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-75129e57-3bfc-4328-b2ea-0073b4a67ae2 tempest-SnapshotsActionsTest-645252037 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-431da365-79df-4788-b7bb-e3118a36fca0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 17:54:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-75129e57-3bfc-4328-b2ea-0073b4a67ae2 tempest-SnapshotsActionsTest-645252037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.106ada7b-7b95-41e0-a862-004921e80068 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:23 devstack sudo[94185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.106ada7b-7b95-41e0-a862-004921e80068 1G Sep 04 17:54:23 devstack sudo[94185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:23 devstack sudo[94185]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-75129e57-3bfc-4328-b2ea-0073b4a67ae2 tempest-SnapshotsActionsTest-645252037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.106ada7b-7b95-41e0-a862-004921e80068 1G" returned: 0 in 0.589s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-75129e57-3bfc-4328-b2ea-0073b4a67ae2 tempest-SnapshotsActionsTest-645252037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.106ada7b-7b95-41e0-a862-004921e80068 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:23 devstack sudo[94191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.106ada7b-7b95-41e0-a862-004921e80068 Sep 04 17:54:23 devstack sudo[94191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:24 devstack sudo[94191]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-75129e57-3bfc-4328-b2ea-0073b4a67ae2 tempest-SnapshotsActionsTest-645252037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.106ada7b-7b95-41e0-a862-004921e80068" returned: 0 in 0.360s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:24 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-75129e57-3bfc-4328-b2ea-0073b4a67ae2 tempest-SnapshotsActionsTest-645252037 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.106ada7b-7b95-41e0-a862-004921e80068 is being set with open permissions: ugo+rw Sep 04 17:54:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-75129e57-3bfc-4328-b2ea-0073b4a67ae2 tempest-SnapshotsActionsTest-645252037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.106ada7b-7b95-41e0-a862-004921e80068 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:24 devstack sudo[94200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.106ada7b-7b95-41e0-a862-004921e80068 Sep 04 17:54:24 devstack sudo[94200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:24 devstack sudo[94200]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-75129e57-3bfc-4328-b2ea-0073b4a67ae2 tempest-SnapshotsActionsTest-645252037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.106ada7b-7b95-41e0-a862-004921e80068" returned: 0 in 0.438s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-75129e57-3bfc-4328-b2ea-0073b4a67ae2 tempest-SnapshotsActionsTest-645252037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.092s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:54:24 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-75129e57-3bfc-4328-b2ea-0073b4a67ae2 tempest-SnapshotsActionsTest-645252037 None] Create snapshot completed successfully Sep 04 17:54:25 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-041be5f3-a844-447f-a87c-163fa6b6e428 tempest-SnapshotsActionsTest-179960074 None] Acquiring lock "cinder-106ada7b-7b95-41e0-a862-004921e80068-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:54:25 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-041be5f3-a844-447f-a87c-163fa6b6e428 tempest-SnapshotsActionsTest-179960074 None] Lock "cinder-106ada7b-7b95-41e0-a862-004921e80068-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:54:25 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-041be5f3-a844-447f-a87c-163fa6b6e428 tempest-SnapshotsActionsTest-179960074 None] Acquiring lock "cinder-quobyte-431da365-79df-4788-b7bb-e3118a36fca0" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:54:25 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-041be5f3-a844-447f-a87c-163fa6b6e428 tempest-SnapshotsActionsTest-179960074 None] Lock "cinder-quobyte-431da365-79df-4788-b7bb-e3118a36fca0" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:54:25 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-041be5f3-a844-447f-a87c-163fa6b6e428 tempest-SnapshotsActionsTest-179960074 None] Acquiring lock "cinder-quobyte-106ada7b-7b95-41e0-a862-004921e80068" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:54:26 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-041be5f3-a844-447f-a87c-163fa6b6e428 tempest-SnapshotsActionsTest-179960074 None] Lock "cinder-quobyte-106ada7b-7b95-41e0-a862-004921e80068" acquired by "_delete_snapshot" :: waited 0.078s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:54:26 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-041be5f3-a844-447f-a87c-163fa6b6e428 tempest-SnapshotsActionsTest-179960074 None] Deleting offline snapshot 106ada7b-7b95-41e0-a862-004921e80068 of volume 431da365-79df-4788-b7bb-e3118a36fca0 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 17:54:26 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-041be5f3-a844-447f-a87c-163fa6b6e428 tempest-SnapshotsActionsTest-179960074 None] snapshot_file for this snap is: volume-431da365-79df-4788-b7bb-e3118a36fca0.106ada7b-7b95-41e0-a862-004921e80068 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 17:54:26 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b05d182-c158-48de-a000-6cc7c958b92c]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:54:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-041be5f3-a844-447f-a87c-163fa6b6e428 tempest-SnapshotsActionsTest-179960074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.106ada7b-7b95-41e0-a862-004921e80068 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:26 devstack sudo[94612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.106ada7b-7b95-41e0-a862-004921e80068 Sep 04 17:54:26 devstack sudo[94612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:26 devstack sudo[94612]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-041be5f3-a844-447f-a87c-163fa6b6e428 tempest-SnapshotsActionsTest-179960074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.106ada7b-7b95-41e0-a862-004921e80068" returned: 0 in 0.822s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:26 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-041be5f3-a844-447f-a87c-163fa6b6e428 tempest-SnapshotsActionsTest-179960074 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-431da365-79df-4788-b7bb-e3118a36fca0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 17:54:27 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[187d3313-f7d4-4a03-b852-fdb482eb2aae]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:54:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-041be5f3-a844-447f-a87c-163fa6b6e428 tempest-SnapshotsActionsTest-179960074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:27 devstack sudo[94628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b Sep 04 17:54:27 devstack sudo[94628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:27 devstack sudo[94628]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-041be5f3-a844-447f-a87c-163fa6b6e428 tempest-SnapshotsActionsTest-179960074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b" returned: 0 in 0.747s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:27 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-041be5f3-a844-447f-a87c-163fa6b6e428 tempest-SnapshotsActionsTest-179960074 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-431da365-79df-4788-b7bb-e3118a36fca0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 17:54:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-041be5f3-a844-447f-a87c-163fa6b6e428 tempest-SnapshotsActionsTest-179960074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.106ada7b-7b95-41e0-a862-004921e80068 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:27 devstack sudo[94634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.106ada7b-7b95-41e0-a862-004921e80068 Sep 04 17:54:27 devstack sudo[94634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:28 devstack sudo[94634]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-041be5f3-a844-447f-a87c-163fa6b6e428 tempest-SnapshotsActionsTest-179960074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.106ada7b-7b95-41e0-a862-004921e80068" returned: 0 in 0.883s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-041be5f3-a844-447f-a87c-163fa6b6e428 tempest-SnapshotsActionsTest-179960074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.106ada7b-7b95-41e0-a862-004921e80068 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:28 devstack sudo[94641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.106ada7b-7b95-41e0-a862-004921e80068 Sep 04 17:54:28 devstack sudo[94641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:28 devstack sudo[94641]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-041be5f3-a844-447f-a87c-163fa6b6e428 tempest-SnapshotsActionsTest-179960074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.106ada7b-7b95-41e0-a862-004921e80068" returned: 0 in 0.330s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:29 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-041be5f3-a844-447f-a87c-163fa6b6e428 tempest-SnapshotsActionsTest-179960074 None] Lock "cinder-quobyte-106ada7b-7b95-41e0-a862-004921e80068" released by "_delete_snapshot" :: held 2.988s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:54:29 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-041be5f3-a844-447f-a87c-163fa6b6e428 tempest-SnapshotsActionsTest-179960074 None] Lock "cinder-quobyte-431da365-79df-4788-b7bb-e3118a36fca0" released by "delete_snapshot" :: held 3.082s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:54:29 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-041be5f3-a844-447f-a87c-163fa6b6e428 tempest-SnapshotsActionsTest-179960074 None] Created reservations ['0c6f0729-26c6-4284-a5ec-2379dc457a70', '53f80fb5-8680-4e91-b0d7-1f4658d08315', '631fe029-9f18-4124-9e09-060462990668', '5a5a7b6c-6c13-496a-94af-d60291a3e1c3'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:54:29 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-041be5f3-a844-447f-a87c-163fa6b6e428 tempest-SnapshotsActionsTest-179960074 None] Delete snapshot completed successfully. Sep 04 17:54:29 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-041be5f3-a844-447f-a87c-163fa6b6e428 tempest-SnapshotsActionsTest-179960074 None] Lock "cinder-106ada7b-7b95-41e0-a862-004921e80068-delete_snapshot" released by "delete_snapshot" :: held 3.376s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:54:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6eaf5004-61e7-4d9b-b8df-944edbadf285 tempest-SnapshotsActionsTest-645252037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:54:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6eaf5004-61e7-4d9b-b8df-944edbadf285 tempest-SnapshotsActionsTest-645252037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:54:30 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-6eaf5004-61e7-4d9b-b8df-944edbadf285 tempest-SnapshotsActionsTest-645252037 None] Creating offline snapshot f91bf7cf-c6ea-4cb2-ad3c-0c54f66a0bb7 of volume 431da365-79df-4788-b7bb-e3118a36fca0 {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 17:54:30 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5dc762-afe9-49ed-9e80-559ed8eb4a67]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:54:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6eaf5004-61e7-4d9b-b8df-944edbadf285 tempest-SnapshotsActionsTest-645252037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:30 devstack sudo[94644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b Sep 04 17:54:30 devstack sudo[94644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:30 devstack sudo[94644]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6eaf5004-61e7-4d9b-b8df-944edbadf285 tempest-SnapshotsActionsTest-645252037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b" returned: 0 in 0.629s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:30 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-6eaf5004-61e7-4d9b-b8df-944edbadf285 tempest-SnapshotsActionsTest-645252037 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-431da365-79df-4788-b7bb-e3118a36fca0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 17:54:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6eaf5004-61e7-4d9b-b8df-944edbadf285 tempest-SnapshotsActionsTest-645252037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.f91bf7cf-c6ea-4cb2-ad3c-0c54f66a0bb7 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:30 devstack sudo[94649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.f91bf7cf-c6ea-4cb2-ad3c-0c54f66a0bb7 1G Sep 04 17:54:30 devstack sudo[94649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:31 devstack sudo[94649]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6eaf5004-61e7-4d9b-b8df-944edbadf285 tempest-SnapshotsActionsTest-645252037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.f91bf7cf-c6ea-4cb2-ad3c-0c54f66a0bb7 1G" returned: 0 in 0.970s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6eaf5004-61e7-4d9b-b8df-944edbadf285 tempest-SnapshotsActionsTest-645252037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.f91bf7cf-c6ea-4cb2-ad3c-0c54f66a0bb7 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:31 devstack sudo[94656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.f91bf7cf-c6ea-4cb2-ad3c-0c54f66a0bb7 Sep 04 17:54:31 devstack sudo[94656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:32 devstack sudo[94656]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6eaf5004-61e7-4d9b-b8df-944edbadf285 tempest-SnapshotsActionsTest-645252037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.f91bf7cf-c6ea-4cb2-ad3c-0c54f66a0bb7" returned: 0 in 0.661s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:32 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-6eaf5004-61e7-4d9b-b8df-944edbadf285 tempest-SnapshotsActionsTest-645252037 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.f91bf7cf-c6ea-4cb2-ad3c-0c54f66a0bb7 is being set with open permissions: ugo+rw Sep 04 17:54:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6eaf5004-61e7-4d9b-b8df-944edbadf285 tempest-SnapshotsActionsTest-645252037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.f91bf7cf-c6ea-4cb2-ad3c-0c54f66a0bb7 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:32 devstack sudo[94663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.f91bf7cf-c6ea-4cb2-ad3c-0c54f66a0bb7 Sep 04 17:54:32 devstack sudo[94663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:32 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b5d2fa3-5d0e-4f7a-9275-71aa455b6296 tempest-CreateVolumesFromImageTest-1932203306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:54:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8b5d2fa3-5d0e-4f7a-9275-71aa455b6296 tempest-CreateVolumesFromImageTest-1932203306 None] Flow 'volume_create_manager' (e98d6296-0956-4d7c-8a68-a6b58bcf1847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:54:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8b5d2fa3-5d0e-4f7a-9275-71aa455b6296 tempest-CreateVolumesFromImageTest-1932203306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72a858cb-1457-455d-8e8b-06a3563258a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:54:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8b5d2fa3-5d0e-4f7a-9275-71aa455b6296 tempest-CreateVolumesFromImageTest-1932203306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72a858cb-1457-455d-8e8b-06a3563258a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2057957898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12b089b9-81ea-4ec8-9aa7-43be2f0f818e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f3f764797524e3baea80bff110319d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:54:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:54:33Z,use_quota=True,user_id='a848aac763514f6dbe909c5f2b12bba9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:54:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8b5d2fa3-5d0e-4f7a-9275-71aa455b6296 tempest-CreateVolumesFromImageTest-1932203306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2b60eee-8a84-4255-9ac6-b4065067b50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:54:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8b5d2fa3-5d0e-4f7a-9275-71aa455b6296 tempest-CreateVolumesFromImageTest-1932203306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2b60eee-8a84-4255-9ac6-b4065067b50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:54:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8b5d2fa3-5d0e-4f7a-9275-71aa455b6296 tempest-CreateVolumesFromImageTest-1932203306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (691a2276-07c4-4329-8600-61d25839cbe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:54:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8b5d2fa3-5d0e-4f7a-9275-71aa455b6296 tempest-CreateVolumesFromImageTest-1932203306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (691a2276-07c4-4329-8600-61d25839cbe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12b089b9-81ea-4ec8-9aa7-43be2f0f818e', 'volume_name': 'volume-12b089b9-81ea-4ec8-9aa7-43be2f0f818e', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:54:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8b5d2fa3-5d0e-4f7a-9275-71aa455b6296 tempest-CreateVolumesFromImageTest-1932203306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5105fe7b-92f9-45ea-adbb-49262cc62dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:54:33 devstack sudo[94663]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8b5d2fa3-5d0e-4f7a-9275-71aa455b6296 tempest-CreateVolumesFromImageTest-1932203306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5105fe7b-92f9-45ea-adbb-49262cc62dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:54:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8b5d2fa3-5d0e-4f7a-9275-71aa455b6296 tempest-CreateVolumesFromImageTest-1932203306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6400c0f-2969-4833-afff-837e26aa7ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:54:33 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-8b5d2fa3-5d0e-4f7a-9275-71aa455b6296 tempest-CreateVolumesFromImageTest-1932203306 None] Volume 12b089b9-81ea-4ec8-9aa7-43be2f0f818e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12b089b9-81ea-4ec8-9aa7-43be2f0f818e', 'volume_size': 1} Sep 04 17:54:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8b5d2fa3-5d0e-4f7a-9275-71aa455b6296 tempest-CreateVolumesFromImageTest-1932203306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:54:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6eaf5004-61e7-4d9b-b8df-944edbadf285 tempest-SnapshotsActionsTest-645252037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.f91bf7cf-c6ea-4cb2-ad3c-0c54f66a0bb7" returned: 0 in 0.759s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6eaf5004-61e7-4d9b-b8df-944edbadf285 tempest-SnapshotsActionsTest-645252037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.231s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:54:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8b5d2fa3-5d0e-4f7a-9275-71aa455b6296 tempest-CreateVolumesFromImageTest-1932203306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.109s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:54:33 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8b5d2fa3-5d0e-4f7a-9275-71aa455b6296 tempest-CreateVolumesFromImageTest-1932203306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2057957898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12b089b9-81ea-4ec8-9aa7-43be2f0f818e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f3f764797524e3baea80bff110319d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:54:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:54:33Z,use_quota=True,user_id='a848aac763514f6dbe909c5f2b12bba9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:54:33 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-8b5d2fa3-5d0e-4f7a-9275-71aa455b6296 tempest-CreateVolumesFromImageTest-1932203306 None] Creating volume 12b089b9-81ea-4ec8-9aa7-43be2f0f818e {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:54:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8b5d2fa3-5d0e-4f7a-9275-71aa455b6296 tempest-CreateVolumesFromImageTest-1932203306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:54:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8b5d2fa3-5d0e-4f7a-9275-71aa455b6296 tempest-CreateVolumesFromImageTest-1932203306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:54:33 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8b5d2fa3-5d0e-4f7a-9275-71aa455b6296 tempest-CreateVolumesFromImageTest-1932203306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:54:33 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8b5d2fa3-5d0e-4f7a-9275-71aa455b6296 tempest-CreateVolumesFromImageTest-1932203306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:54:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8b5d2fa3-5d0e-4f7a-9275-71aa455b6296 tempest-CreateVolumesFromImageTest-1932203306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:54:33 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8b5d2fa3-5d0e-4f7a-9275-71aa455b6296 tempest-CreateVolumesFromImageTest-1932203306 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:54:33 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-8b5d2fa3-5d0e-4f7a-9275-71aa455b6296 tempest-CreateVolumesFromImageTest-1932203306 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:54:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8b5d2fa3-5d0e-4f7a-9275-71aa455b6296 tempest-CreateVolumesFromImageTest-1932203306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-12b089b9-81ea-4ec8-9aa7-43be2f0f818e 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:33 devstack sudo[94685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-12b089b9-81ea-4ec8-9aa7-43be2f0f818e 1073741824 Sep 04 17:54:33 devstack sudo[94685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:33 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-6eaf5004-61e7-4d9b-b8df-944edbadf285 tempest-SnapshotsActionsTest-645252037 None] Create snapshot completed successfully Sep 04 17:54:33 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-97ad9634-ec82-4743-be92-de9f62520891 tempest-CreateVolumesFromImageTest-1932203306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:54:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-97ad9634-ec82-4743-be92-de9f62520891 tempest-CreateVolumesFromImageTest-1932203306 None] Flow 'volume_create_manager' (7b8f2198-7e6b-4686-8fc5-eb5cea3099d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:54:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-97ad9634-ec82-4743-be92-de9f62520891 tempest-CreateVolumesFromImageTest-1932203306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8a6d782-bcae-4c9f-9fe4-71f09caa32b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:54:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-97ad9634-ec82-4743-be92-de9f62520891 tempest-CreateVolumesFromImageTest-1932203306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8a6d782-bcae-4c9f-9fe4-71f09caa32b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:54:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-204723164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0d4bc4a-a49a-47f1-9f48-9ae5ec2a8962,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f3f764797524e3baea80bff110319d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:54:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:54:34Z,use_quota=True,user_id='a848aac763514f6dbe909c5f2b12bba9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:54:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-97ad9634-ec82-4743-be92-de9f62520891 tempest-CreateVolumesFromImageTest-1932203306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc3183d7-f203-4d06-bd4b-e42627999b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:54:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-97ad9634-ec82-4743-be92-de9f62520891 tempest-CreateVolumesFromImageTest-1932203306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc3183d7-f203-4d06-bd4b-e42627999b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:54:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-97ad9634-ec82-4743-be92-de9f62520891 tempest-CreateVolumesFromImageTest-1932203306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba00d3f9-a81d-498d-99a2-d9dee51d92e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:54:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-97ad9634-ec82-4743-be92-de9f62520891 tempest-CreateVolumesFromImageTest-1932203306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba00d3f9-a81d-498d-99a2-d9dee51d92e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0d4bc4a-a49a-47f1-9f48-9ae5ec2a8962', 'volume_name': 'volume-f0d4bc4a-a49a-47f1-9f48-9ae5ec2a8962', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:54:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-97ad9634-ec82-4743-be92-de9f62520891 tempest-CreateVolumesFromImageTest-1932203306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c47ee9a-a198-458f-a73d-aa3f7c45d6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:54:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-97ad9634-ec82-4743-be92-de9f62520891 tempest-CreateVolumesFromImageTest-1932203306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c47ee9a-a198-458f-a73d-aa3f7c45d6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:54:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-97ad9634-ec82-4743-be92-de9f62520891 tempest-CreateVolumesFromImageTest-1932203306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43e33f88-924b-4511-95d9-48b0512f4733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:54:34 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-97ad9634-ec82-4743-be92-de9f62520891 tempest-CreateVolumesFromImageTest-1932203306 None] Volume f0d4bc4a-a49a-47f1-9f48-9ae5ec2a8962: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0d4bc4a-a49a-47f1-9f48-9ae5ec2a8962', 'volume_size': 1} Sep 04 17:54:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-97ad9634-ec82-4743-be92-de9f62520891 tempest-CreateVolumesFromImageTest-1932203306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:54:34 devstack sudo[94685]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8b5d2fa3-5d0e-4f7a-9275-71aa455b6296 tempest-CreateVolumesFromImageTest-1932203306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-12b089b9-81ea-4ec8-9aa7-43be2f0f818e 1073741824" returned: 0 in 1.066s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8b5d2fa3-5d0e-4f7a-9275-71aa455b6296 tempest-CreateVolumesFromImageTest-1932203306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-12b089b9-81ea-4ec8-9aa7-43be2f0f818e {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:34 devstack sudo[94691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-12b089b9-81ea-4ec8-9aa7-43be2f0f818e Sep 04 17:54:34 devstack sudo[94691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:34 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdbe2409-dd36-4b52-8cb1-eaa9833fa2f5 tempest-CreateVolumesFromImageTest-1932203306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:54:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fdbe2409-dd36-4b52-8cb1-eaa9833fa2f5 tempest-CreateVolumesFromImageTest-1932203306 None] Flow 'volume_create_manager' (b35365af-8ce0-436b-89b1-cbfe35766bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:54:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fdbe2409-dd36-4b52-8cb1-eaa9833fa2f5 tempest-CreateVolumesFromImageTest-1932203306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08663aae-ad73-4153-acf2-9cd1a1506aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:54:34 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f477c0ee-b484-4567-b49b-eab963b06108 tempest-SnapshotsActionsTest-179960074 None] Acquiring lock "cinder-f91bf7cf-c6ea-4cb2-ad3c-0c54f66a0bb7-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:54:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fdbe2409-dd36-4b52-8cb1-eaa9833fa2f5 tempest-CreateVolumesFromImageTest-1932203306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08663aae-ad73-4153-acf2-9cd1a1506aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-954998219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16b84453-778f-4261-ac6e-09a834513afe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f3f764797524e3baea80bff110319d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:54:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:54:34Z,use_quota=True,user_id='a848aac763514f6dbe909c5f2b12bba9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:54:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fdbe2409-dd36-4b52-8cb1-eaa9833fa2f5 tempest-CreateVolumesFromImageTest-1932203306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f98cd2e-3e8d-4ce0-9c8f-f972661b4fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:54:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fdbe2409-dd36-4b52-8cb1-eaa9833fa2f5 tempest-CreateVolumesFromImageTest-1932203306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f98cd2e-3e8d-4ce0-9c8f-f972661b4fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:54:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fdbe2409-dd36-4b52-8cb1-eaa9833fa2f5 tempest-CreateVolumesFromImageTest-1932203306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8beec270-75c4-4c48-a25e-dddfe0051057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:54:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fdbe2409-dd36-4b52-8cb1-eaa9833fa2f5 tempest-CreateVolumesFromImageTest-1932203306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8beec270-75c4-4c48-a25e-dddfe0051057) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16b84453-778f-4261-ac6e-09a834513afe', 'volume_name': 'volume-16b84453-778f-4261-ac6e-09a834513afe', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:54:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fdbe2409-dd36-4b52-8cb1-eaa9833fa2f5 tempest-CreateVolumesFromImageTest-1932203306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76e79278-d576-43a1-86ef-167f6ce98d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:54:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fdbe2409-dd36-4b52-8cb1-eaa9833fa2f5 tempest-CreateVolumesFromImageTest-1932203306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76e79278-d576-43a1-86ef-167f6ce98d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:54:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fdbe2409-dd36-4b52-8cb1-eaa9833fa2f5 tempest-CreateVolumesFromImageTest-1932203306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (404ecf7c-a07b-4224-99e0-fcd1aabdc288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:54:34 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-fdbe2409-dd36-4b52-8cb1-eaa9833fa2f5 tempest-CreateVolumesFromImageTest-1932203306 None] Volume 16b84453-778f-4261-ac6e-09a834513afe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16b84453-778f-4261-ac6e-09a834513afe', 'volume_size': 1} Sep 04 17:54:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fdbe2409-dd36-4b52-8cb1-eaa9833fa2f5 tempest-CreateVolumesFromImageTest-1932203306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:54:34 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f477c0ee-b484-4567-b49b-eab963b06108 tempest-SnapshotsActionsTest-179960074 None] Lock "cinder-f91bf7cf-c6ea-4cb2-ad3c-0c54f66a0bb7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.182s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:54:34 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f477c0ee-b484-4567-b49b-eab963b06108 tempest-SnapshotsActionsTest-179960074 None] Acquiring lock "cinder-quobyte-431da365-79df-4788-b7bb-e3118a36fca0" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:54:34 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f477c0ee-b484-4567-b49b-eab963b06108 tempest-SnapshotsActionsTest-179960074 None] Lock "cinder-quobyte-431da365-79df-4788-b7bb-e3118a36fca0" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:54:34 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f477c0ee-b484-4567-b49b-eab963b06108 tempest-SnapshotsActionsTest-179960074 None] Acquiring lock "cinder-quobyte-f91bf7cf-c6ea-4cb2-ad3c-0c54f66a0bb7" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:54:34 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f477c0ee-b484-4567-b49b-eab963b06108 tempest-SnapshotsActionsTest-179960074 None] Lock "cinder-quobyte-f91bf7cf-c6ea-4cb2-ad3c-0c54f66a0bb7" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:54:34 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-f477c0ee-b484-4567-b49b-eab963b06108 tempest-SnapshotsActionsTest-179960074 None] Deleting offline snapshot f91bf7cf-c6ea-4cb2-ad3c-0c54f66a0bb7 of volume 431da365-79df-4788-b7bb-e3118a36fca0 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 17:54:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-f477c0ee-b484-4567-b49b-eab963b06108 tempest-SnapshotsActionsTest-179960074 None] snapshot_file for this snap is: volume-431da365-79df-4788-b7bb-e3118a36fca0.f91bf7cf-c6ea-4cb2-ad3c-0c54f66a0bb7 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 17:54:35 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[06cc63d5-cb72-4ae5-9347-c1bf965683cb]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:54:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f477c0ee-b484-4567-b49b-eab963b06108 tempest-SnapshotsActionsTest-179960074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.f91bf7cf-c6ea-4cb2-ad3c-0c54f66a0bb7 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:35 devstack sudo[94691]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8b5d2fa3-5d0e-4f7a-9275-71aa455b6296 tempest-CreateVolumesFromImageTest-1932203306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-12b089b9-81ea-4ec8-9aa7-43be2f0f818e" returned: 0 in 0.744s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8b5d2fa3-5d0e-4f7a-9275-71aa455b6296 tempest-CreateVolumesFromImageTest-1932203306 None] <== create_volume: return (1940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:54:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8b5d2fa3-5d0e-4f7a-9275-71aa455b6296 tempest-CreateVolumesFromImageTest-1932203306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.946s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:54:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-97ad9634-ec82-4743-be92-de9f62520891 tempest-CreateVolumesFromImageTest-1932203306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.096s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:54:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-97ad9634-ec82-4743-be92-de9f62520891 tempest-CreateVolumesFromImageTest-1932203306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:54:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-204723164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0d4bc4a-a49a-47f1-9f48-9ae5ec2a8962,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f3f764797524e3baea80bff110319d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:54:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:54:34Z,use_quota=True,user_id='a848aac763514f6dbe909c5f2b12bba9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:54:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-97ad9634-ec82-4743-be92-de9f62520891 tempest-CreateVolumesFromImageTest-1932203306 None] Creating volume f0d4bc4a-a49a-47f1-9f48-9ae5ec2a8962 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:54:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-97ad9634-ec82-4743-be92-de9f62520891 tempest-CreateVolumesFromImageTest-1932203306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:54:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-97ad9634-ec82-4743-be92-de9f62520891 tempest-CreateVolumesFromImageTest-1932203306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:54:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-97ad9634-ec82-4743-be92-de9f62520891 tempest-CreateVolumesFromImageTest-1932203306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:54:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-97ad9634-ec82-4743-be92-de9f62520891 tempest-CreateVolumesFromImageTest-1932203306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:54:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-97ad9634-ec82-4743-be92-de9f62520891 tempest-CreateVolumesFromImageTest-1932203306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:54:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-97ad9634-ec82-4743-be92-de9f62520891 tempest-CreateVolumesFromImageTest-1932203306 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:54:35 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-97ad9634-ec82-4743-be92-de9f62520891 tempest-CreateVolumesFromImageTest-1932203306 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:54:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-97ad9634-ec82-4743-be92-de9f62520891 tempest-CreateVolumesFromImageTest-1932203306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f0d4bc4a-a49a-47f1-9f48-9ae5ec2a8962 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:35 devstack sudo[94696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f0d4bc4a-a49a-47f1-9f48-9ae5ec2a8962 1073741824 Sep 04 17:54:35 devstack sudo[94696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8b5d2fa3-5d0e-4f7a-9275-71aa455b6296 tempest-CreateVolumesFromImageTest-1932203306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6400c0f-2969-4833-afff-837e26aa7ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12b089b9-81ea-4ec8-9aa7-43be2f0f818e', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:54:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8b5d2fa3-5d0e-4f7a-9275-71aa455b6296 tempest-CreateVolumesFromImageTest-1932203306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4694aeed-c689-45f5-bd75-beccdc856ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:54:35 devstack sudo[94695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.f91bf7cf-c6ea-4cb2-ad3c-0c54f66a0bb7 Sep 04 17:54:35 devstack sudo[94695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:35 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec227d1c-07b6-4f6f-a46e-78a272b71080 tempest-CreateVolumesFromImageTest-1932203306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:54:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ec227d1c-07b6-4f6f-a46e-78a272b71080 tempest-CreateVolumesFromImageTest-1932203306 None] Flow 'volume_create_manager' (a674e58d-cc0e-4545-a704-b0c918b77e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:54:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ec227d1c-07b6-4f6f-a46e-78a272b71080 tempest-CreateVolumesFromImageTest-1932203306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7af3b33d-352d-4247-a44d-5294b29590ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:54:35 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-8b5d2fa3-5d0e-4f7a-9275-71aa455b6296 tempest-CreateVolumesFromImageTest-1932203306 None] Volume volume-12b089b9-81ea-4ec8-9aa7-43be2f0f818e (12b089b9-81ea-4ec8-9aa7-43be2f0f818e): created successfully Sep 04 17:54:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8b5d2fa3-5d0e-4f7a-9275-71aa455b6296 tempest-CreateVolumesFromImageTest-1932203306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4694aeed-c689-45f5-bd75-beccdc856ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:54:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8b5d2fa3-5d0e-4f7a-9275-71aa455b6296 tempest-CreateVolumesFromImageTest-1932203306 None] Flow 'volume_create_manager' (e98d6296-0956-4d7c-8a68-a6b58bcf1847) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:54:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ec227d1c-07b6-4f6f-a46e-78a272b71080 tempest-CreateVolumesFromImageTest-1932203306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7af3b33d-352d-4247-a44d-5294b29590ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-57129242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfa3b013-d9f8-4a8e-8650-3f196651e3d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f3f764797524e3baea80bff110319d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:54:35Z,use_quota=True,user_id='a848aac763514f6dbe909c5f2b12bba9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:54:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ec227d1c-07b6-4f6f-a46e-78a272b71080 tempest-CreateVolumesFromImageTest-1932203306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ff6c7df-38a9-4718-9050-889f73719d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:54:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ec227d1c-07b6-4f6f-a46e-78a272b71080 tempest-CreateVolumesFromImageTest-1932203306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ff6c7df-38a9-4718-9050-889f73719d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:54:35 devstack sudo[94695]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ec227d1c-07b6-4f6f-a46e-78a272b71080 tempest-CreateVolumesFromImageTest-1932203306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f8d4bcf-e599-4b71-85fc-c936e31fd050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:54:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ec227d1c-07b6-4f6f-a46e-78a272b71080 tempest-CreateVolumesFromImageTest-1932203306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f8d4bcf-e599-4b71-85fc-c936e31fd050) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfa3b013-d9f8-4a8e-8650-3f196651e3d3', 'volume_name': 'volume-cfa3b013-d9f8-4a8e-8650-3f196651e3d3', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:54:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ec227d1c-07b6-4f6f-a46e-78a272b71080 tempest-CreateVolumesFromImageTest-1932203306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2fe253e-86bc-42e6-9bdd-8d9eaf3bbc49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:54:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ec227d1c-07b6-4f6f-a46e-78a272b71080 tempest-CreateVolumesFromImageTest-1932203306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2fe253e-86bc-42e6-9bdd-8d9eaf3bbc49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:54:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ec227d1c-07b6-4f6f-a46e-78a272b71080 tempest-CreateVolumesFromImageTest-1932203306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8e8eb8d-b555-418d-a204-4f3f6f6f78de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:54:35 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-ec227d1c-07b6-4f6f-a46e-78a272b71080 tempest-CreateVolumesFromImageTest-1932203306 None] Volume cfa3b013-d9f8-4a8e-8650-3f196651e3d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfa3b013-d9f8-4a8e-8650-3f196651e3d3', 'volume_size': 1} Sep 04 17:54:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ec227d1c-07b6-4f6f-a46e-78a272b71080 tempest-CreateVolumesFromImageTest-1932203306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:54:35 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-8b5d2fa3-5d0e-4f7a-9275-71aa455b6296 tempest-CreateVolumesFromImageTest-1932203306 None] Created volume successfully. Sep 04 17:54:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f477c0ee-b484-4567-b49b-eab963b06108 tempest-SnapshotsActionsTest-179960074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.f91bf7cf-c6ea-4cb2-ad3c-0c54f66a0bb7" returned: 0 in 0.805s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-f477c0ee-b484-4567-b49b-eab963b06108 tempest-SnapshotsActionsTest-179960074 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-431da365-79df-4788-b7bb-e3118a36fca0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 17:54:35 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ad65d2-8edc-464d-a562-2382631aa40d]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:54:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f477c0ee-b484-4567-b49b-eab963b06108 tempest-SnapshotsActionsTest-179960074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:36 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-6881c83e-b387-4524-ba93-8c30d3f197ae tempest-CreateVolumesFromImageTest-1932203306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:54:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6881c83e-b387-4524-ba93-8c30d3f197ae tempest-CreateVolumesFromImageTest-1932203306 None] Flow 'volume_create_manager' (b1446fe4-c001-433d-a7e6-318b9f44a798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:54:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6881c83e-b387-4524-ba93-8c30d3f197ae tempest-CreateVolumesFromImageTest-1932203306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6ddfbba-7aaf-46fe-9b87-62d152f2bde0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:54:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6881c83e-b387-4524-ba93-8c30d3f197ae tempest-CreateVolumesFromImageTest-1932203306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6ddfbba-7aaf-46fe-9b87-62d152f2bde0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-370917615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d0c62bb-e2d1-4402-8373-5eb6cbd5017f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f3f764797524e3baea80bff110319d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:54:36Z,use_quota=True,user_id='a848aac763514f6dbe909c5f2b12bba9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:54:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6881c83e-b387-4524-ba93-8c30d3f197ae tempest-CreateVolumesFromImageTest-1932203306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1043bb82-fbc7-483b-944a-5b242eacddec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:54:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6881c83e-b387-4524-ba93-8c30d3f197ae tempest-CreateVolumesFromImageTest-1932203306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1043bb82-fbc7-483b-944a-5b242eacddec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:54:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6881c83e-b387-4524-ba93-8c30d3f197ae tempest-CreateVolumesFromImageTest-1932203306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a37e5d3c-e126-4c9a-8a90-d73506b690e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:54:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6881c83e-b387-4524-ba93-8c30d3f197ae tempest-CreateVolumesFromImageTest-1932203306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a37e5d3c-e126-4c9a-8a90-d73506b690e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d0c62bb-e2d1-4402-8373-5eb6cbd5017f', 'volume_name': 'volume-6d0c62bb-e2d1-4402-8373-5eb6cbd5017f', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:54:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6881c83e-b387-4524-ba93-8c30d3f197ae tempest-CreateVolumesFromImageTest-1932203306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11068033-952f-407f-bbd0-3173825038bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:54:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6881c83e-b387-4524-ba93-8c30d3f197ae tempest-CreateVolumesFromImageTest-1932203306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11068033-952f-407f-bbd0-3173825038bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:54:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6881c83e-b387-4524-ba93-8c30d3f197ae tempest-CreateVolumesFromImageTest-1932203306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (055821a4-32f3-4c20-b37b-1d995439782f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:54:36 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-6881c83e-b387-4524-ba93-8c30d3f197ae tempest-CreateVolumesFromImageTest-1932203306 None] Volume 6d0c62bb-e2d1-4402-8373-5eb6cbd5017f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d0c62bb-e2d1-4402-8373-5eb6cbd5017f', 'volume_size': 1} Sep 04 17:54:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6881c83e-b387-4524-ba93-8c30d3f197ae tempest-CreateVolumesFromImageTest-1932203306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:54:36 devstack sudo[94703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b Sep 04 17:54:36 devstack sudo[94703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:36 devstack sudo[94696]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-97ad9634-ec82-4743-be92-de9f62520891 tempest-CreateVolumesFromImageTest-1932203306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f0d4bc4a-a49a-47f1-9f48-9ae5ec2a8962 1073741824" returned: 0 in 1.232s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-97ad9634-ec82-4743-be92-de9f62520891 tempest-CreateVolumesFromImageTest-1932203306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f0d4bc4a-a49a-47f1-9f48-9ae5ec2a8962 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:36 devstack sudo[94703]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:36 devstack sudo[94745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f0d4bc4a-a49a-47f1-9f48-9ae5ec2a8962 Sep 04 17:54:36 devstack sudo[94745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f477c0ee-b484-4567-b49b-eab963b06108 tempest-SnapshotsActionsTest-179960074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b" returned: 0 in 0.685s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-f477c0ee-b484-4567-b49b-eab963b06108 tempest-SnapshotsActionsTest-179960074 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-431da365-79df-4788-b7bb-e3118a36fca0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 17:54:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f477c0ee-b484-4567-b49b-eab963b06108 tempest-SnapshotsActionsTest-179960074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.f91bf7cf-c6ea-4cb2-ad3c-0c54f66a0bb7 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:36 devstack sudo[94747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.f91bf7cf-c6ea-4cb2-ad3c-0c54f66a0bb7 Sep 04 17:54:36 devstack sudo[94747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:36 devstack sudo[94745]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-97ad9634-ec82-4743-be92-de9f62520891 tempest-CreateVolumesFromImageTest-1932203306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f0d4bc4a-a49a-47f1-9f48-9ae5ec2a8962" returned: 0 in 0.375s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-97ad9634-ec82-4743-be92-de9f62520891 tempest-CreateVolumesFromImageTest-1932203306 None] <== create_volume: return (1683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:54:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-97ad9634-ec82-4743-be92-de9f62520891 tempest-CreateVolumesFromImageTest-1932203306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.700s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:54:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fdbe2409-dd36-4b52-8cb1-eaa9833fa2f5 tempest-CreateVolumesFromImageTest-1932203306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.112s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:54:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-fdbe2409-dd36-4b52-8cb1-eaa9833fa2f5 tempest-CreateVolumesFromImageTest-1932203306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-954998219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16b84453-778f-4261-ac6e-09a834513afe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f3f764797524e3baea80bff110319d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:54:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:54:34Z,use_quota=True,user_id='a848aac763514f6dbe909c5f2b12bba9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:54:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-fdbe2409-dd36-4b52-8cb1-eaa9833fa2f5 tempest-CreateVolumesFromImageTest-1932203306 None] Creating volume 16b84453-778f-4261-ac6e-09a834513afe {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:54:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fdbe2409-dd36-4b52-8cb1-eaa9833fa2f5 tempest-CreateVolumesFromImageTest-1932203306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:54:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fdbe2409-dd36-4b52-8cb1-eaa9833fa2f5 tempest-CreateVolumesFromImageTest-1932203306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:54:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-fdbe2409-dd36-4b52-8cb1-eaa9833fa2f5 tempest-CreateVolumesFromImageTest-1932203306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:54:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-fdbe2409-dd36-4b52-8cb1-eaa9833fa2f5 tempest-CreateVolumesFromImageTest-1932203306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:54:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fdbe2409-dd36-4b52-8cb1-eaa9833fa2f5 tempest-CreateVolumesFromImageTest-1932203306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:54:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-fdbe2409-dd36-4b52-8cb1-eaa9833fa2f5 tempest-CreateVolumesFromImageTest-1932203306 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:54:36 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-fdbe2409-dd36-4b52-8cb1-eaa9833fa2f5 tempest-CreateVolumesFromImageTest-1932203306 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:54:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fdbe2409-dd36-4b52-8cb1-eaa9833fa2f5 tempest-CreateVolumesFromImageTest-1932203306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-16b84453-778f-4261-ac6e-09a834513afe 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:37 devstack sudo[94755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-16b84453-778f-4261-ac6e-09a834513afe 1073741824 Sep 04 17:54:37 devstack sudo[94755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:37 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-97ad9634-ec82-4743-be92-de9f62520891 tempest-CreateVolumesFromImageTest-1932203306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43e33f88-924b-4511-95d9-48b0512f4733) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0d4bc4a-a49a-47f1-9f48-9ae5ec2a8962', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:54:37 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-97ad9634-ec82-4743-be92-de9f62520891 tempest-CreateVolumesFromImageTest-1932203306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c90d95d-e477-487a-b01d-27d2b14e0917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:54:37 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-97ad9634-ec82-4743-be92-de9f62520891 tempest-CreateVolumesFromImageTest-1932203306 None] Volume volume-f0d4bc4a-a49a-47f1-9f48-9ae5ec2a8962 (f0d4bc4a-a49a-47f1-9f48-9ae5ec2a8962): created successfully Sep 04 17:54:37 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-97ad9634-ec82-4743-be92-de9f62520891 tempest-CreateVolumesFromImageTest-1932203306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c90d95d-e477-487a-b01d-27d2b14e0917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:54:37 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-97ad9634-ec82-4743-be92-de9f62520891 tempest-CreateVolumesFromImageTest-1932203306 None] Flow 'volume_create_manager' (7b8f2198-7e6b-4686-8fc5-eb5cea3099d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:54:37 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-97ad9634-ec82-4743-be92-de9f62520891 tempest-CreateVolumesFromImageTest-1932203306 None] Created volume successfully. Sep 04 17:54:37 devstack sudo[94747]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f477c0ee-b484-4567-b49b-eab963b06108 tempest-SnapshotsActionsTest-179960074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.f91bf7cf-c6ea-4cb2-ad3c-0c54f66a0bb7" returned: 0 in 0.568s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f477c0ee-b484-4567-b49b-eab963b06108 tempest-SnapshotsActionsTest-179960074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.f91bf7cf-c6ea-4cb2-ad3c-0c54f66a0bb7 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:37 devstack sudo[94759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.f91bf7cf-c6ea-4cb2-ad3c-0c54f66a0bb7 Sep 04 17:54:37 devstack sudo[94759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:37 devstack sudo[94759]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f477c0ee-b484-4567-b49b-eab963b06108 tempest-SnapshotsActionsTest-179960074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.f91bf7cf-c6ea-4cb2-ad3c-0c54f66a0bb7" returned: 0 in 0.402s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f477c0ee-b484-4567-b49b-eab963b06108 tempest-SnapshotsActionsTest-179960074 None] Lock "cinder-quobyte-f91bf7cf-c6ea-4cb2-ad3c-0c54f66a0bb7" released by "_delete_snapshot" :: held 2.672s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:54:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f477c0ee-b484-4567-b49b-eab963b06108 tempest-SnapshotsActionsTest-179960074 None] Lock "cinder-quobyte-431da365-79df-4788-b7bb-e3118a36fca0" released by "delete_snapshot" :: held 2.732s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:54:37 devstack sudo[94755]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fdbe2409-dd36-4b52-8cb1-eaa9833fa2f5 tempest-CreateVolumesFromImageTest-1932203306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-16b84453-778f-4261-ac6e-09a834513afe 1073741824" returned: 0 in 0.682s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fdbe2409-dd36-4b52-8cb1-eaa9833fa2f5 tempest-CreateVolumesFromImageTest-1932203306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-16b84453-778f-4261-ac6e-09a834513afe {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:37 devstack sudo[94767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-16b84453-778f-4261-ac6e-09a834513afe Sep 04 17:54:37 devstack sudo[94767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:37 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-f477c0ee-b484-4567-b49b-eab963b06108 tempest-SnapshotsActionsTest-179960074 None] Created reservations ['ff1d239b-d0a0-4490-a30c-a9195f6edd3c', 'c6e922d3-cb1d-4dfe-aed0-1029eb9b4d7d', 'c60fb622-684f-4479-be13-ce5ceda4c4a7', '8a6a1d88-6fef-4f2e-a641-5d61fb138fbc'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:54:37 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-f477c0ee-b484-4567-b49b-eab963b06108 tempest-SnapshotsActionsTest-179960074 None] Delete snapshot completed successfully. Sep 04 17:54:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f477c0ee-b484-4567-b49b-eab963b06108 tempest-SnapshotsActionsTest-179960074 None] Lock "cinder-f91bf7cf-c6ea-4cb2-ad3c-0c54f66a0bb7-delete_snapshot" released by "delete_snapshot" :: held 2.970s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:54:38 devstack sudo[94767]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fdbe2409-dd36-4b52-8cb1-eaa9833fa2f5 tempest-CreateVolumesFromImageTest-1932203306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-16b84453-778f-4261-ac6e-09a834513afe" returned: 0 in 0.378s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:38 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-fdbe2409-dd36-4b52-8cb1-eaa9833fa2f5 tempest-CreateVolumesFromImageTest-1932203306 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:54:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fdbe2409-dd36-4b52-8cb1-eaa9833fa2f5 tempest-CreateVolumesFromImageTest-1932203306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:54:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ec227d1c-07b6-4f6f-a46e-78a272b71080 tempest-CreateVolumesFromImageTest-1932203306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.252s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:54:38 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ec227d1c-07b6-4f6f-a46e-78a272b71080 tempest-CreateVolumesFromImageTest-1932203306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-57129242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfa3b013-d9f8-4a8e-8650-3f196651e3d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f3f764797524e3baea80bff110319d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:54:35Z,use_quota=True,user_id='a848aac763514f6dbe909c5f2b12bba9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:54:38 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-ec227d1c-07b6-4f6f-a46e-78a272b71080 tempest-CreateVolumesFromImageTest-1932203306 None] Creating volume cfa3b013-d9f8-4a8e-8650-3f196651e3d3 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:54:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ec227d1c-07b6-4f6f-a46e-78a272b71080 tempest-CreateVolumesFromImageTest-1932203306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:54:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ec227d1c-07b6-4f6f-a46e-78a272b71080 tempest-CreateVolumesFromImageTest-1932203306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:54:38 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ec227d1c-07b6-4f6f-a46e-78a272b71080 tempest-CreateVolumesFromImageTest-1932203306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:54:38 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ec227d1c-07b6-4f6f-a46e-78a272b71080 tempest-CreateVolumesFromImageTest-1932203306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:54:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ec227d1c-07b6-4f6f-a46e-78a272b71080 tempest-CreateVolumesFromImageTest-1932203306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:54:38 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ec227d1c-07b6-4f6f-a46e-78a272b71080 tempest-CreateVolumesFromImageTest-1932203306 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:54:38 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-ec227d1c-07b6-4f6f-a46e-78a272b71080 tempest-CreateVolumesFromImageTest-1932203306 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:54:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ec227d1c-07b6-4f6f-a46e-78a272b71080 tempest-CreateVolumesFromImageTest-1932203306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cfa3b013-d9f8-4a8e-8650-3f196651e3d3 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fdbe2409-dd36-4b52-8cb1-eaa9833fa2f5 tempest-CreateVolumesFromImageTest-1932203306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (404ecf7c-a07b-4224-99e0-fcd1aabdc288) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16b84453-778f-4261-ac6e-09a834513afe', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:54:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fdbe2409-dd36-4b52-8cb1-eaa9833fa2f5 tempest-CreateVolumesFromImageTest-1932203306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98cbc80b-be9e-4fab-9aa6-8f0c98e6e93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:54:38 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-fdbe2409-dd36-4b52-8cb1-eaa9833fa2f5 tempest-CreateVolumesFromImageTest-1932203306 None] Volume volume-16b84453-778f-4261-ac6e-09a834513afe (16b84453-778f-4261-ac6e-09a834513afe): created successfully Sep 04 17:54:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fdbe2409-dd36-4b52-8cb1-eaa9833fa2f5 tempest-CreateVolumesFromImageTest-1932203306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98cbc80b-be9e-4fab-9aa6-8f0c98e6e93e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:54:38 devstack sudo[94770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cfa3b013-d9f8-4a8e-8650-3f196651e3d3 1073741824 Sep 04 17:54:38 devstack sudo[94770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fdbe2409-dd36-4b52-8cb1-eaa9833fa2f5 tempest-CreateVolumesFromImageTest-1932203306 None] Flow 'volume_create_manager' (b35365af-8ce0-436b-89b1-cbfe35766bfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:54:38 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-fdbe2409-dd36-4b52-8cb1-eaa9833fa2f5 tempest-CreateVolumesFromImageTest-1932203306 None] Created volume successfully. Sep 04 17:54:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a51527df-1d8d-438f-b9fb-0a24840920a1 tempest-SnapshotsActionsTest-645252037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:54:38 devstack sudo[94770]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ec227d1c-07b6-4f6f-a46e-78a272b71080 tempest-CreateVolumesFromImageTest-1932203306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cfa3b013-d9f8-4a8e-8650-3f196651e3d3 1073741824" returned: 0 in 0.768s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ec227d1c-07b6-4f6f-a46e-78a272b71080 tempest-CreateVolumesFromImageTest-1932203306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cfa3b013-d9f8-4a8e-8650-3f196651e3d3 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:38 devstack sudo[94776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cfa3b013-d9f8-4a8e-8650-3f196651e3d3 Sep 04 17:54:38 devstack sudo[94776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:39 devstack sudo[94776]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ec227d1c-07b6-4f6f-a46e-78a272b71080 tempest-CreateVolumesFromImageTest-1932203306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cfa3b013-d9f8-4a8e-8650-3f196651e3d3" returned: 0 in 0.289s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ec227d1c-07b6-4f6f-a46e-78a272b71080 tempest-CreateVolumesFromImageTest-1932203306 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:54:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ec227d1c-07b6-4f6f-a46e-78a272b71080 tempest-CreateVolumesFromImageTest-1932203306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:54:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6881c83e-b387-4524-ba93-8c30d3f197ae tempest-CreateVolumesFromImageTest-1932203306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.044s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:54:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-6881c83e-b387-4524-ba93-8c30d3f197ae tempest-CreateVolumesFromImageTest-1932203306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-370917615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d0c62bb-e2d1-4402-8373-5eb6cbd5017f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f3f764797524e3baea80bff110319d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:54:36Z,use_quota=True,user_id='a848aac763514f6dbe909c5f2b12bba9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:54:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-6881c83e-b387-4524-ba93-8c30d3f197ae tempest-CreateVolumesFromImageTest-1932203306 None] Creating volume 6d0c62bb-e2d1-4402-8373-5eb6cbd5017f {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:54:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6881c83e-b387-4524-ba93-8c30d3f197ae tempest-CreateVolumesFromImageTest-1932203306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:54:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6881c83e-b387-4524-ba93-8c30d3f197ae tempest-CreateVolumesFromImageTest-1932203306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:54:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-6881c83e-b387-4524-ba93-8c30d3f197ae tempest-CreateVolumesFromImageTest-1932203306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:54:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-6881c83e-b387-4524-ba93-8c30d3f197ae tempest-CreateVolumesFromImageTest-1932203306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:54:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6881c83e-b387-4524-ba93-8c30d3f197ae tempest-CreateVolumesFromImageTest-1932203306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:54:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-6881c83e-b387-4524-ba93-8c30d3f197ae tempest-CreateVolumesFromImageTest-1932203306 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:54:39 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-6881c83e-b387-4524-ba93-8c30d3f197ae tempest-CreateVolumesFromImageTest-1932203306 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:54:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6881c83e-b387-4524-ba93-8c30d3f197ae tempest-CreateVolumesFromImageTest-1932203306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6d0c62bb-e2d1-4402-8373-5eb6cbd5017f 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ec227d1c-07b6-4f6f-a46e-78a272b71080 tempest-CreateVolumesFromImageTest-1932203306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8e8eb8d-b555-418d-a204-4f3f6f6f78de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfa3b013-d9f8-4a8e-8650-3f196651e3d3', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:54:39 devstack sudo[94779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6d0c62bb-e2d1-4402-8373-5eb6cbd5017f 1073741824 Sep 04 17:54:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ec227d1c-07b6-4f6f-a46e-78a272b71080 tempest-CreateVolumesFromImageTest-1932203306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2431155-aff4-46f3-81f5-cadabef4abbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:54:39 devstack sudo[94779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:39 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-ec227d1c-07b6-4f6f-a46e-78a272b71080 tempest-CreateVolumesFromImageTest-1932203306 None] Volume volume-cfa3b013-d9f8-4a8e-8650-3f196651e3d3 (cfa3b013-d9f8-4a8e-8650-3f196651e3d3): created successfully Sep 04 17:54:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ec227d1c-07b6-4f6f-a46e-78a272b71080 tempest-CreateVolumesFromImageTest-1932203306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2431155-aff4-46f3-81f5-cadabef4abbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:54:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ec227d1c-07b6-4f6f-a46e-78a272b71080 tempest-CreateVolumesFromImageTest-1932203306 None] Flow 'volume_create_manager' (a674e58d-cc0e-4545-a704-b0c918b77e20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:54:39 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-ec227d1c-07b6-4f6f-a46e-78a272b71080 tempest-CreateVolumesFromImageTest-1932203306 None] Created volume successfully. Sep 04 17:54:39 devstack sudo[94779]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6881c83e-b387-4524-ba93-8c30d3f197ae tempest-CreateVolumesFromImageTest-1932203306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6d0c62bb-e2d1-4402-8373-5eb6cbd5017f 1073741824" returned: 0 in 0.519s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6881c83e-b387-4524-ba93-8c30d3f197ae tempest-CreateVolumesFromImageTest-1932203306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6d0c62bb-e2d1-4402-8373-5eb6cbd5017f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:39 devstack sudo[94796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6d0c62bb-e2d1-4402-8373-5eb6cbd5017f Sep 04 17:54:39 devstack sudo[94796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:40 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-221c0475-89c7-4741-9bad-4499702c3398 req-2f6f546f-7286-4176-8d61-4339963695f7 tempest-ServerActionsTestOtherA-1015930920 None] Terminate volume connection completed successfully. Sep 04 17:54:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-221c0475-89c7-4741-9bad-4499702c3398 req-2f6f546f-7286-4176-8d61-4339963695f7 tempest-ServerActionsTestOtherA-1015930920 None] Deleting attachment 496f1c19-dde2-46e2-a808-ad3f9996233b. {{(pid=87314) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 17:54:40 devstack sudo[94796]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6881c83e-b387-4524-ba93-8c30d3f197ae tempest-CreateVolumesFromImageTest-1932203306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6d0c62bb-e2d1-4402-8373-5eb6cbd5017f" returned: 0 in 0.415s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-6881c83e-b387-4524-ba93-8c30d3f197ae tempest-CreateVolumesFromImageTest-1932203306 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:54:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6881c83e-b387-4524-ba93-8c30d3f197ae tempest-CreateVolumesFromImageTest-1932203306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:54:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a51527df-1d8d-438f-b9fb-0a24840920a1 tempest-SnapshotsActionsTest-645252037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.692s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:54:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6881c83e-b387-4524-ba93-8c30d3f197ae tempest-CreateVolumesFromImageTest-1932203306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (055821a4-32f3-4c20-b37b-1d995439782f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d0c62bb-e2d1-4402-8373-5eb6cbd5017f', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:54:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6881c83e-b387-4524-ba93-8c30d3f197ae tempest-CreateVolumesFromImageTest-1932203306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0438923a-adfd-438a-ae76-97b0c2001622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:54:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-a51527df-1d8d-438f-b9fb-0a24840920a1 tempest-SnapshotsActionsTest-645252037 None] Creating offline snapshot 267895a1-04df-4ed7-89b2-2c4c9f439d2d of volume 431da365-79df-4788-b7bb-e3118a36fca0 {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 17:54:40 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-6881c83e-b387-4524-ba93-8c30d3f197ae tempest-CreateVolumesFromImageTest-1932203306 None] Volume volume-6d0c62bb-e2d1-4402-8373-5eb6cbd5017f (6d0c62bb-e2d1-4402-8373-5eb6cbd5017f): created successfully Sep 04 17:54:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6881c83e-b387-4524-ba93-8c30d3f197ae tempest-CreateVolumesFromImageTest-1932203306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0438923a-adfd-438a-ae76-97b0c2001622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:54:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6881c83e-b387-4524-ba93-8c30d3f197ae tempest-CreateVolumesFromImageTest-1932203306 None] Flow 'volume_create_manager' (b1446fe4-c001-433d-a7e6-318b9f44a798) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:54:40 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb521db9-31d6-42e7-9963-cc82be078293]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:54:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a51527df-1d8d-438f-b9fb-0a24840920a1 tempest-SnapshotsActionsTest-645252037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:40 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-6881c83e-b387-4524-ba93-8c30d3f197ae tempest-CreateVolumesFromImageTest-1932203306 None] Created volume successfully. Sep 04 17:54:40 devstack sudo[94835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b Sep 04 17:54:40 devstack sudo[94835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:40 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-059b0e28-238a-4960-9086-da89a53bbd09 tempest-CreateVolumesFromImageTest-1932203306 None] Acquiring lock "cinder-6d0c62bb-e2d1-4402-8373-5eb6cbd5017f-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:54:40 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-059b0e28-238a-4960-9086-da89a53bbd09 tempest-CreateVolumesFromImageTest-1932203306 None] Lock "cinder-6d0c62bb-e2d1-4402-8373-5eb6cbd5017f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:54:40 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-059b0e28-238a-4960-9086-da89a53bbd09 tempest-CreateVolumesFromImageTest-1932203306 None] Acquiring lock "cinder-quobyte-6d0c62bb-e2d1-4402-8373-5eb6cbd5017f" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:54:40 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-059b0e28-238a-4960-9086-da89a53bbd09 tempest-CreateVolumesFromImageTest-1932203306 None] Lock "cinder-quobyte-6d0c62bb-e2d1-4402-8373-5eb6cbd5017f" acquired by "delete_volume" :: waited 0.033s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:54:40 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[4313d77b-9eb3-4cd4-8fef-63e6398dbf4e]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:54:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-059b0e28-238a-4960-9086-da89a53bbd09 tempest-CreateVolumesFromImageTest-1932203306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6d0c62bb-e2d1-4402-8373-5eb6cbd5017f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:40 devstack sudo[94837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6d0c62bb-e2d1-4402-8373-5eb6cbd5017f Sep 04 17:54:40 devstack sudo[94837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:41 devstack sudo[94835]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a51527df-1d8d-438f-b9fb-0a24840920a1 tempest-SnapshotsActionsTest-645252037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b" returned: 0 in 0.671s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:41 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-a51527df-1d8d-438f-b9fb-0a24840920a1 tempest-SnapshotsActionsTest-645252037 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-431da365-79df-4788-b7bb-e3118a36fca0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 17:54:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a51527df-1d8d-438f-b9fb-0a24840920a1 tempest-SnapshotsActionsTest-645252037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.267895a1-04df-4ed7-89b2-2c4c9f439d2d 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:41 devstack sudo[94844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.267895a1-04df-4ed7-89b2-2c4c9f439d2d 1G Sep 04 17:54:41 devstack sudo[94844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:41 devstack sudo[94837]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-059b0e28-238a-4960-9086-da89a53bbd09 tempest-CreateVolumesFromImageTest-1932203306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6d0c62bb-e2d1-4402-8373-5eb6cbd5017f" returned: 0 in 0.479s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-059b0e28-238a-4960-9086-da89a53bbd09 tempest-CreateVolumesFromImageTest-1932203306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6d0c62bb-e2d1-4402-8373-5eb6cbd5017f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:41 devstack sudo[94849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6d0c62bb-e2d1-4402-8373-5eb6cbd5017f Sep 04 17:54:41 devstack sudo[94849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:41 devstack sudo[94849]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-059b0e28-238a-4960-9086-da89a53bbd09 tempest-CreateVolumesFromImageTest-1932203306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6d0c62bb-e2d1-4402-8373-5eb6cbd5017f" returned: 0 in 0.349s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:41 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-059b0e28-238a-4960-9086-da89a53bbd09 tempest-CreateVolumesFromImageTest-1932203306 None] Lock "cinder-quobyte-6d0c62bb-e2d1-4402-8373-5eb6cbd5017f" released by "delete_volume" :: held 0.889s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:54:41 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-059b0e28-238a-4960-9086-da89a53bbd09 tempest-CreateVolumesFromImageTest-1932203306 None] Created reservations ['e3751e07-40d5-490c-a589-0e13764f481f', '1bd55cf3-32b1-4972-bdb1-17c29b2a1505', '1b6442bc-e1a1-4bb1-bf1b-e8fc06b5b5b7', '441cd02a-f52a-4496-80f9-efbc88a1be10'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:54:41 devstack sudo[94844]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a51527df-1d8d-438f-b9fb-0a24840920a1 tempest-SnapshotsActionsTest-645252037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.267895a1-04df-4ed7-89b2-2c4c9f439d2d 1G" returned: 0 in 0.697s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a51527df-1d8d-438f-b9fb-0a24840920a1 tempest-SnapshotsActionsTest-645252037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.267895a1-04df-4ed7-89b2-2c4c9f439d2d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:41 devstack sudo[94856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.267895a1-04df-4ed7-89b2-2c4c9f439d2d Sep 04 17:54:41 devstack sudo[94856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-059b0e28-238a-4960-9086-da89a53bbd09 tempest-CreateVolumesFromImageTest-1932203306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:54:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-059b0e28-238a-4960-9086-da89a53bbd09 tempest-CreateVolumesFromImageTest-1932203306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:54:41 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-059b0e28-238a-4960-9086-da89a53bbd09 tempest-CreateVolumesFromImageTest-1932203306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:54:41 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-059b0e28-238a-4960-9086-da89a53bbd09 tempest-CreateVolumesFromImageTest-1932203306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:54:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-059b0e28-238a-4960-9086-da89a53bbd09 tempest-CreateVolumesFromImageTest-1932203306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:54:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-059b0e28-238a-4960-9086-da89a53bbd09 tempest-CreateVolumesFromImageTest-1932203306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:41 devstack sudo[94858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:54:41 devstack sudo[94858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:41 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0f84ac64-b536-4f22-b87c-ba60e4fde554 tempest-CreateVolumesFromImageTest-1932203306 None] Acquiring lock "cinder-cfa3b013-d9f8-4a8e-8650-3f196651e3d3-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:54:41 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0f84ac64-b536-4f22-b87c-ba60e4fde554 tempest-CreateVolumesFromImageTest-1932203306 None] Lock "cinder-cfa3b013-d9f8-4a8e-8650-3f196651e3d3-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:54:42 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0f84ac64-b536-4f22-b87c-ba60e4fde554 tempest-CreateVolumesFromImageTest-1932203306 None] Acquiring lock "cinder-quobyte-cfa3b013-d9f8-4a8e-8650-3f196651e3d3" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:54:42 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0f84ac64-b536-4f22-b87c-ba60e4fde554 tempest-CreateVolumesFromImageTest-1932203306 None] Lock "cinder-quobyte-cfa3b013-d9f8-4a8e-8650-3f196651e3d3" acquired by "delete_volume" :: waited 0.022s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:54:42 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffed5e28-3eed-48be-a8d4-ca52d0f636e5]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:54:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0f84ac64-b536-4f22-b87c-ba60e4fde554 tempest-CreateVolumesFromImageTest-1932203306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cfa3b013-d9f8-4a8e-8650-3f196651e3d3 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:42 devstack sudo[94856]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a51527df-1d8d-438f-b9fb-0a24840920a1 tempest-SnapshotsActionsTest-645252037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.267895a1-04df-4ed7-89b2-2c4c9f439d2d" returned: 0 in 0.399s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:42 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-a51527df-1d8d-438f-b9fb-0a24840920a1 tempest-SnapshotsActionsTest-645252037 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.267895a1-04df-4ed7-89b2-2c4c9f439d2d is being set with open permissions: ugo+rw Sep 04 17:54:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a51527df-1d8d-438f-b9fb-0a24840920a1 tempest-SnapshotsActionsTest-645252037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.267895a1-04df-4ed7-89b2-2c4c9f439d2d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:42 devstack sudo[94864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.267895a1-04df-4ed7-89b2-2c4c9f439d2d Sep 04 17:54:42 devstack sudo[94864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:42 devstack sudo[94858]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-059b0e28-238a-4960-9086-da89a53bbd09 tempest-CreateVolumesFromImageTest-1932203306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.428s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:42 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-059b0e28-238a-4960-9086-da89a53bbd09 tempest-CreateVolumesFromImageTest-1932203306 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:54:42 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-059b0e28-238a-4960-9086-da89a53bbd09 tempest-CreateVolumesFromImageTest-1932203306 None] Deleted volume successfully. Sep 04 17:54:42 devstack sudo[94863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cfa3b013-d9f8-4a8e-8650-3f196651e3d3 Sep 04 17:54:42 devstack sudo[94863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:42 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-059b0e28-238a-4960-9086-da89a53bbd09 tempest-CreateVolumesFromImageTest-1932203306 None] Lock "cinder-6d0c62bb-e2d1-4402-8373-5eb6cbd5017f-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:54:42 devstack sudo[94864]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a51527df-1d8d-438f-b9fb-0a24840920a1 tempest-SnapshotsActionsTest-645252037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.267895a1-04df-4ed7-89b2-2c4c9f439d2d" returned: 0 in 0.395s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-221c0475-89c7-4741-9bad-4499702c3398 req-3ecfad7e-f975-4fae-bc5f-a7d7bd201350 tempest-ServerActionsTestOtherA-1015930920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:54:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a51527df-1d8d-438f-b9fb-0a24840920a1 tempest-SnapshotsActionsTest-645252037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.320s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:54:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-221c0475-89c7-4741-9bad-4499702c3398 req-3ecfad7e-f975-4fae-bc5f-a7d7bd201350 tempest-ServerActionsTestOtherA-1015930920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.028s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:54:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-221c0475-89c7-4741-9bad-4499702c3398 req-3ecfad7e-f975-4fae-bc5f-a7d7bd201350 tempest-ServerActionsTestOtherA-1015930920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:54:42 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-a51527df-1d8d-438f-b9fb-0a24840920a1 tempest-SnapshotsActionsTest-645252037 None] Create snapshot completed successfully Sep 04 17:54:42 devstack sudo[94863]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:42 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-221c0475-89c7-4741-9bad-4499702c3398 req-3ecfad7e-f975-4fae-bc5f-a7d7bd201350 tempest-ServerActionsTestOtherA-1015930920 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a', 'name': 'volume-fa30b325-b68f-453d-bc16-a72e3ad267cc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7bd550bc-6c61-4c57-aebd-5cb79198b0d0', 'enforce_multipath': True} {{(pid=87314) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 17:54:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0f84ac64-b536-4f22-b87c-ba60e4fde554 tempest-CreateVolumesFromImageTest-1932203306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cfa3b013-d9f8-4a8e-8650-3f196651e3d3" returned: 0 in 0.519s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0f84ac64-b536-4f22-b87c-ba60e4fde554 tempest-CreateVolumesFromImageTest-1932203306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cfa3b013-d9f8-4a8e-8650-3f196651e3d3 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:42 devstack sudo[94881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cfa3b013-d9f8-4a8e-8650-3f196651e3d3 Sep 04 17:54:42 devstack sudo[94881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:42 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-221c0475-89c7-4741-9bad-4499702c3398 req-3ecfad7e-f975-4fae-bc5f-a7d7bd201350 tempest-ServerActionsTestOtherA-1015930920 None] attachment_update completed successfully. Sep 04 17:54:42 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2e9ba38e-30cd-4a4e-b413-e88738caa2c0 tempest-SnapshotsActionsTest-179960074 None] Acquiring lock "cinder-267895a1-04df-4ed7-89b2-2c4c9f439d2d-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:54:42 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2e9ba38e-30cd-4a4e-b413-e88738caa2c0 tempest-SnapshotsActionsTest-179960074 None] Lock "cinder-267895a1-04df-4ed7-89b2-2c4c9f439d2d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:54:42 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2e9ba38e-30cd-4a4e-b413-e88738caa2c0 tempest-SnapshotsActionsTest-179960074 None] Acquiring lock "cinder-quobyte-431da365-79df-4788-b7bb-e3118a36fca0" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:54:42 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2e9ba38e-30cd-4a4e-b413-e88738caa2c0 tempest-SnapshotsActionsTest-179960074 None] Lock "cinder-quobyte-431da365-79df-4788-b7bb-e3118a36fca0" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:54:42 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2e9ba38e-30cd-4a4e-b413-e88738caa2c0 tempest-SnapshotsActionsTest-179960074 None] Acquiring lock "cinder-quobyte-267895a1-04df-4ed7-89b2-2c4c9f439d2d" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:54:42 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2e9ba38e-30cd-4a4e-b413-e88738caa2c0 tempest-SnapshotsActionsTest-179960074 None] Lock "cinder-quobyte-267895a1-04df-4ed7-89b2-2c4c9f439d2d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:54:42 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-2e9ba38e-30cd-4a4e-b413-e88738caa2c0 tempest-SnapshotsActionsTest-179960074 None] Deleting offline snapshot 267895a1-04df-4ed7-89b2-2c4c9f439d2d of volume 431da365-79df-4788-b7bb-e3118a36fca0 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 17:54:43 devstack sudo[94881]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:43 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-2e9ba38e-30cd-4a4e-b413-e88738caa2c0 tempest-SnapshotsActionsTest-179960074 None] snapshot_file for this snap is: volume-431da365-79df-4788-b7bb-e3118a36fca0.267895a1-04df-4ed7-89b2-2c4c9f439d2d {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 17:54:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0f84ac64-b536-4f22-b87c-ba60e4fde554 tempest-CreateVolumesFromImageTest-1932203306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cfa3b013-d9f8-4a8e-8650-3f196651e3d3" returned: 0 in 0.395s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:43 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[809dd7ab-d1f4-4b3d-9afa-f24024523a4a]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:54:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2e9ba38e-30cd-4a4e-b413-e88738caa2c0 tempest-SnapshotsActionsTest-179960074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.267895a1-04df-4ed7-89b2-2c4c9f439d2d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:43 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0f84ac64-b536-4f22-b87c-ba60e4fde554 tempest-CreateVolumesFromImageTest-1932203306 None] Lock "cinder-quobyte-cfa3b013-d9f8-4a8e-8650-3f196651e3d3" released by "delete_volume" :: held 0.982s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:54:43 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-0f84ac64-b536-4f22-b87c-ba60e4fde554 tempest-CreateVolumesFromImageTest-1932203306 None] Created reservations ['771e1dcd-6dba-440c-bbd4-725d49a4b89f', '65dc1b50-3bf2-4f70-9a1c-32b3c4fd7033', '11dcfc03-fb82-4b0b-b61c-4745d1e98b18', '68ef100e-8408-4875-9785-8d2286b98bee'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:54:43 devstack sudo[94885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.267895a1-04df-4ed7-89b2-2c4c9f439d2d Sep 04 17:54:43 devstack sudo[94885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0f84ac64-b536-4f22-b87c-ba60e4fde554 tempest-CreateVolumesFromImageTest-1932203306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:54:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0f84ac64-b536-4f22-b87c-ba60e4fde554 tempest-CreateVolumesFromImageTest-1932203306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:54:43 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0f84ac64-b536-4f22-b87c-ba60e4fde554 tempest-CreateVolumesFromImageTest-1932203306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:54:43 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0f84ac64-b536-4f22-b87c-ba60e4fde554 tempest-CreateVolumesFromImageTest-1932203306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:54:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0f84ac64-b536-4f22-b87c-ba60e4fde554 tempest-CreateVolumesFromImageTest-1932203306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:54:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0f84ac64-b536-4f22-b87c-ba60e4fde554 tempest-CreateVolumesFromImageTest-1932203306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:43 devstack sudo[94954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:54:43 devstack sudo[94954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:43 devstack sudo[94885]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2e9ba38e-30cd-4a4e-b413-e88738caa2c0 tempest-SnapshotsActionsTest-179960074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.267895a1-04df-4ed7-89b2-2c4c9f439d2d" returned: 0 in 0.543s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:43 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-2e9ba38e-30cd-4a4e-b413-e88738caa2c0 tempest-SnapshotsActionsTest-179960074 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-431da365-79df-4788-b7bb-e3118a36fca0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 17:54:43 devstack sudo[94954]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0f84ac64-b536-4f22-b87c-ba60e4fde554 tempest-CreateVolumesFromImageTest-1932203306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.402s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:43 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-0f84ac64-b536-4f22-b87c-ba60e4fde554 tempest-CreateVolumesFromImageTest-1932203306 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:54:43 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-0f84ac64-b536-4f22-b87c-ba60e4fde554 tempest-CreateVolumesFromImageTest-1932203306 None] Deleted volume successfully. Sep 04 17:54:43 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46df644-0948-470a-870d-3a1fb3faf062]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:54:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2e9ba38e-30cd-4a4e-b413-e88738caa2c0 tempest-SnapshotsActionsTest-179960074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:43 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0f84ac64-b536-4f22-b87c-ba60e4fde554 tempest-CreateVolumesFromImageTest-1932203306 None] Lock "cinder-cfa3b013-d9f8-4a8e-8650-3f196651e3d3-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:54:43 devstack sudo[95297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b Sep 04 17:54:43 devstack sudo[95297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:44 devstack sudo[95297]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2e9ba38e-30cd-4a4e-b413-e88738caa2c0 tempest-SnapshotsActionsTest-179960074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b" returned: 0 in 0.538s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:44 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-2e9ba38e-30cd-4a4e-b413-e88738caa2c0 tempest-SnapshotsActionsTest-179960074 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-431da365-79df-4788-b7bb-e3118a36fca0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 17:54:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2e9ba38e-30cd-4a4e-b413-e88738caa2c0 tempest-SnapshotsActionsTest-179960074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.267895a1-04df-4ed7-89b2-2c4c9f439d2d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:44 devstack sudo[95319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.267895a1-04df-4ed7-89b2-2c4c9f439d2d Sep 04 17:54:44 devstack sudo[95319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:44 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-48c4b06b-93f2-4723-9001-da0cea1060f9 tempest-CreateVolumesFromImageTest-1932203306 None] Acquiring lock "cinder-16b84453-778f-4261-ac6e-09a834513afe-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:54:44 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-48c4b06b-93f2-4723-9001-da0cea1060f9 tempest-CreateVolumesFromImageTest-1932203306 None] Lock "cinder-16b84453-778f-4261-ac6e-09a834513afe-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:54:44 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-48c4b06b-93f2-4723-9001-da0cea1060f9 tempest-CreateVolumesFromImageTest-1932203306 None] Acquiring lock "cinder-quobyte-16b84453-778f-4261-ac6e-09a834513afe" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:54:44 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-48c4b06b-93f2-4723-9001-da0cea1060f9 tempest-CreateVolumesFromImageTest-1932203306 None] Lock "cinder-quobyte-16b84453-778f-4261-ac6e-09a834513afe" acquired by "delete_volume" :: waited 0.039s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:54:44 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97d45b7-2878-4546-8335-99b37875cb1a]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:54:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-48c4b06b-93f2-4723-9001-da0cea1060f9 tempest-CreateVolumesFromImageTest-1932203306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-16b84453-778f-4261-ac6e-09a834513afe {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:44 devstack sudo[95325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-16b84453-778f-4261-ac6e-09a834513afe Sep 04 17:54:44 devstack sudo[95325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:44 devstack sudo[95319]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2e9ba38e-30cd-4a4e-b413-e88738caa2c0 tempest-SnapshotsActionsTest-179960074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.267895a1-04df-4ed7-89b2-2c4c9f439d2d" returned: 0 in 0.550s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2e9ba38e-30cd-4a4e-b413-e88738caa2c0 tempest-SnapshotsActionsTest-179960074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.267895a1-04df-4ed7-89b2-2c4c9f439d2d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:44 devstack sudo[95327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.267895a1-04df-4ed7-89b2-2c4c9f439d2d Sep 04 17:54:44 devstack sudo[95327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:44 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-02f2773d-41e8-4fa6-b98f-32d476bd0f13 tempest-AttachVolumeNegativeTest-221345582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:54:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-02f2773d-41e8-4fa6-b98f-32d476bd0f13 tempest-AttachVolumeNegativeTest-221345582 None] Flow 'volume_create_manager' (bd9832d0-133d-4d42-b9aa-fe8a20cd8fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:54:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-02f2773d-41e8-4fa6-b98f-32d476bd0f13 tempest-AttachVolumeNegativeTest-221345582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fd43459-92d1-4caf-ada2-7bdc71e0c2a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:54:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-02f2773d-41e8-4fa6-b98f-32d476bd0f13 tempest-AttachVolumeNegativeTest-221345582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fd43459-92d1-4caf-ada2-7bdc71e0c2a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:54:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-481776612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc9723cf-6972-4a43-a1d5-fb327158319b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cb92ac13b534f169ec45e07b30f7478',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:54:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:54:45Z,use_quota=True,user_id='059c6c050db2446f85a498a65fe5bd6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:54:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-02f2773d-41e8-4fa6-b98f-32d476bd0f13 tempest-AttachVolumeNegativeTest-221345582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ba7fa93-f55c-46e0-8991-934d30943dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:54:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-02f2773d-41e8-4fa6-b98f-32d476bd0f13 tempest-AttachVolumeNegativeTest-221345582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ba7fa93-f55c-46e0-8991-934d30943dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:54:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-02f2773d-41e8-4fa6-b98f-32d476bd0f13 tempest-AttachVolumeNegativeTest-221345582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5443dec-9477-4f01-a2df-d15a12f37c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:54:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-02f2773d-41e8-4fa6-b98f-32d476bd0f13 tempest-AttachVolumeNegativeTest-221345582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5443dec-9477-4f01-a2df-d15a12f37c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc9723cf-6972-4a43-a1d5-fb327158319b', 'volume_name': 'volume-cc9723cf-6972-4a43-a1d5-fb327158319b', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:54:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-02f2773d-41e8-4fa6-b98f-32d476bd0f13 tempest-AttachVolumeNegativeTest-221345582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (327ca48e-b0aa-4e8d-92d5-dfbc2d54fc40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:54:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-02f2773d-41e8-4fa6-b98f-32d476bd0f13 tempest-AttachVolumeNegativeTest-221345582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (327ca48e-b0aa-4e8d-92d5-dfbc2d54fc40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:54:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-02f2773d-41e8-4fa6-b98f-32d476bd0f13 tempest-AttachVolumeNegativeTest-221345582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e38cbc4b-989e-48d5-9d94-85b06a11b74d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:54:44 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-02f2773d-41e8-4fa6-b98f-32d476bd0f13 tempest-AttachVolumeNegativeTest-221345582 None] Volume cc9723cf-6972-4a43-a1d5-fb327158319b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc9723cf-6972-4a43-a1d5-fb327158319b', 'volume_size': 1} Sep 04 17:54:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-02f2773d-41e8-4fa6-b98f-32d476bd0f13 tempest-AttachVolumeNegativeTest-221345582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:54:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-02f2773d-41e8-4fa6-b98f-32d476bd0f13 tempest-AttachVolumeNegativeTest-221345582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:54:44 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-02f2773d-41e8-4fa6-b98f-32d476bd0f13 tempest-AttachVolumeNegativeTest-221345582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:54:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-481776612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc9723cf-6972-4a43-a1d5-fb327158319b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cb92ac13b534f169ec45e07b30f7478',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:54:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:54:45Z,use_quota=True,user_id='059c6c050db2446f85a498a65fe5bd6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:54:44 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-02f2773d-41e8-4fa6-b98f-32d476bd0f13 tempest-AttachVolumeNegativeTest-221345582 None] Creating volume cc9723cf-6972-4a43-a1d5-fb327158319b {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:54:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-02f2773d-41e8-4fa6-b98f-32d476bd0f13 tempest-AttachVolumeNegativeTest-221345582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:54:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-02f2773d-41e8-4fa6-b98f-32d476bd0f13 tempest-AttachVolumeNegativeTest-221345582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:54:44 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-02f2773d-41e8-4fa6-b98f-32d476bd0f13 tempest-AttachVolumeNegativeTest-221345582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:54:44 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-02f2773d-41e8-4fa6-b98f-32d476bd0f13 tempest-AttachVolumeNegativeTest-221345582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:54:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-02f2773d-41e8-4fa6-b98f-32d476bd0f13 tempest-AttachVolumeNegativeTest-221345582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:54:44 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-02f2773d-41e8-4fa6-b98f-32d476bd0f13 tempest-AttachVolumeNegativeTest-221345582 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:54:44 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-02f2773d-41e8-4fa6-b98f-32d476bd0f13 tempest-AttachVolumeNegativeTest-221345582 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:54:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-02f2773d-41e8-4fa6-b98f-32d476bd0f13 tempest-AttachVolumeNegativeTest-221345582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cc9723cf-6972-4a43-a1d5-fb327158319b 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:44 devstack sudo[95329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cc9723cf-6972-4a43-a1d5-fb327158319b 1073741824 Sep 04 17:54:44 devstack sudo[95329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:45 devstack sudo[95327]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2e9ba38e-30cd-4a4e-b413-e88738caa2c0 tempest-SnapshotsActionsTest-179960074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.267895a1-04df-4ed7-89b2-2c4c9f439d2d" returned: 0 in 0.293s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:45 devstack sudo[95325]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-48c4b06b-93f2-4723-9001-da0cea1060f9 tempest-CreateVolumesFromImageTest-1932203306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-16b84453-778f-4261-ac6e-09a834513afe" returned: 0 in 0.570s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-48c4b06b-93f2-4723-9001-da0cea1060f9 tempest-CreateVolumesFromImageTest-1932203306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-16b84453-778f-4261-ac6e-09a834513afe {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:45 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2e9ba38e-30cd-4a4e-b413-e88738caa2c0 tempest-SnapshotsActionsTest-179960074 None] Lock "cinder-quobyte-267895a1-04df-4ed7-89b2-2c4c9f439d2d" released by "_delete_snapshot" :: held 2.113s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:54:45 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2e9ba38e-30cd-4a4e-b413-e88738caa2c0 tempest-SnapshotsActionsTest-179960074 None] Lock "cinder-quobyte-431da365-79df-4788-b7bb-e3118a36fca0" released by "delete_snapshot" :: held 2.144s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:54:45 devstack sudo[95336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-16b84453-778f-4261-ac6e-09a834513afe Sep 04 17:54:45 devstack sudo[95336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:45 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-2e9ba38e-30cd-4a4e-b413-e88738caa2c0 tempest-SnapshotsActionsTest-179960074 None] Created reservations ['cc99f333-f4dd-4b9d-af8f-dd2c51eb20ee', 'a5750ed3-5016-430a-af16-d628395eac6e', '2b2c7cf8-a941-4a73-a6d8-7a71687d57a4', 'dfd64d7b-890c-4f6c-b3f2-a6deebab7cda'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:54:45 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-2e9ba38e-30cd-4a4e-b413-e88738caa2c0 tempest-SnapshotsActionsTest-179960074 None] Delete snapshot completed successfully. Sep 04 17:54:45 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2e9ba38e-30cd-4a4e-b413-e88738caa2c0 tempest-SnapshotsActionsTest-179960074 None] Lock "cinder-267895a1-04df-4ed7-89b2-2c4c9f439d2d-delete_snapshot" released by "delete_snapshot" :: held 2.366s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:54:45 devstack sudo[95336]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-48c4b06b-93f2-4723-9001-da0cea1060f9 tempest-CreateVolumesFromImageTest-1932203306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-16b84453-778f-4261-ac6e-09a834513afe" returned: 0 in 0.417s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:45 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-48c4b06b-93f2-4723-9001-da0cea1060f9 tempest-CreateVolumesFromImageTest-1932203306 None] Lock "cinder-quobyte-16b84453-778f-4261-ac6e-09a834513afe" released by "delete_volume" :: held 1.055s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:54:45 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-48c4b06b-93f2-4723-9001-da0cea1060f9 tempest-CreateVolumesFromImageTest-1932203306 None] Created reservations ['d02c2ea5-1f50-4bc4-b607-cd38cf7a8d3e', 'e87d51cd-b6b5-40fa-b2d0-c6d1f0c4c594', '80ede2ab-a88f-41d2-bc14-0dede783df15', '6a4cb33a-e8d3-431a-b7af-9e209612b064'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:54:45 devstack sudo[95329]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-02f2773d-41e8-4fa6-b98f-32d476bd0f13 tempest-AttachVolumeNegativeTest-221345582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cc9723cf-6972-4a43-a1d5-fb327158319b 1073741824" returned: 0 in 0.650s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-02f2773d-41e8-4fa6-b98f-32d476bd0f13 tempest-AttachVolumeNegativeTest-221345582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cc9723cf-6972-4a43-a1d5-fb327158319b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-48c4b06b-93f2-4723-9001-da0cea1060f9 tempest-CreateVolumesFromImageTest-1932203306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:54:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-48c4b06b-93f2-4723-9001-da0cea1060f9 tempest-CreateVolumesFromImageTest-1932203306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:54:45 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-48c4b06b-93f2-4723-9001-da0cea1060f9 tempest-CreateVolumesFromImageTest-1932203306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:54:45 devstack sudo[95345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cc9723cf-6972-4a43-a1d5-fb327158319b Sep 04 17:54:45 devstack sudo[95345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:45 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-48c4b06b-93f2-4723-9001-da0cea1060f9 tempest-CreateVolumesFromImageTest-1932203306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:54:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-48c4b06b-93f2-4723-9001-da0cea1060f9 tempest-CreateVolumesFromImageTest-1932203306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:54:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-48c4b06b-93f2-4723-9001-da0cea1060f9 tempest-CreateVolumesFromImageTest-1932203306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:45 devstack sudo[95347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:54:45 devstack sudo[95347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:45 devstack sudo[95345]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-02f2773d-41e8-4fa6-b98f-32d476bd0f13 tempest-AttachVolumeNegativeTest-221345582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cc9723cf-6972-4a43-a1d5-fb327158319b" returned: 0 in 0.302s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:45 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-02f2773d-41e8-4fa6-b98f-32d476bd0f13 tempest-AttachVolumeNegativeTest-221345582 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:54:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-02f2773d-41e8-4fa6-b98f-32d476bd0f13 tempest-AttachVolumeNegativeTest-221345582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:54:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-02f2773d-41e8-4fa6-b98f-32d476bd0f13 tempest-AttachVolumeNegativeTest-221345582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e38cbc4b-989e-48d5-9d94-85b06a11b74d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc9723cf-6972-4a43-a1d5-fb327158319b', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:54:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-02f2773d-41e8-4fa6-b98f-32d476bd0f13 tempest-AttachVolumeNegativeTest-221345582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2daab6a9-a5ef-4f62-bbae-9cdd30c51e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:54:45 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-02f2773d-41e8-4fa6-b98f-32d476bd0f13 tempest-AttachVolumeNegativeTest-221345582 None] Volume volume-cc9723cf-6972-4a43-a1d5-fb327158319b (cc9723cf-6972-4a43-a1d5-fb327158319b): created successfully Sep 04 17:54:46 devstack sudo[95347]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-02f2773d-41e8-4fa6-b98f-32d476bd0f13 tempest-AttachVolumeNegativeTest-221345582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2daab6a9-a5ef-4f62-bbae-9cdd30c51e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:54:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-02f2773d-41e8-4fa6-b98f-32d476bd0f13 tempest-AttachVolumeNegativeTest-221345582 None] Flow 'volume_create_manager' (bd9832d0-133d-4d42-b9aa-fe8a20cd8fb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:54:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-48c4b06b-93f2-4723-9001-da0cea1060f9 tempest-CreateVolumesFromImageTest-1932203306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.336s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:46 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-48c4b06b-93f2-4723-9001-da0cea1060f9 tempest-CreateVolumesFromImageTest-1932203306 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:54:46 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-48c4b06b-93f2-4723-9001-da0cea1060f9 tempest-CreateVolumesFromImageTest-1932203306 None] Deleted volume successfully. Sep 04 17:54:46 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-02f2773d-41e8-4fa6-b98f-32d476bd0f13 tempest-AttachVolumeNegativeTest-221345582 None] Created volume successfully. Sep 04 17:54:46 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-48c4b06b-93f2-4723-9001-da0cea1060f9 tempest-CreateVolumesFromImageTest-1932203306 None] Lock "cinder-16b84453-778f-4261-ac6e-09a834513afe-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:54:46 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7efebea0-4f8d-406a-adb2-b46cb77a568c tempest-CreateVolumesFromImageTest-1932203306 None] Acquiring lock "cinder-f0d4bc4a-a49a-47f1-9f48-9ae5ec2a8962-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:54:46 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7efebea0-4f8d-406a-adb2-b46cb77a568c tempest-CreateVolumesFromImageTest-1932203306 None] Lock "cinder-f0d4bc4a-a49a-47f1-9f48-9ae5ec2a8962-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:54:46 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-27566031-4129-4b24-9d95-d5141fcc0295 tempest-SnapshotsActionsTest-645252037 None] Acquiring lock "cinder-acaa2075-4547-4ff2-a1d5-af59083a521b-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:54:46 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7efebea0-4f8d-406a-adb2-b46cb77a568c tempest-CreateVolumesFromImageTest-1932203306 None] Acquiring lock "cinder-quobyte-f0d4bc4a-a49a-47f1-9f48-9ae5ec2a8962" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:54:46 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-27566031-4129-4b24-9d95-d5141fcc0295 tempest-SnapshotsActionsTest-645252037 None] Lock "cinder-acaa2075-4547-4ff2-a1d5-af59083a521b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.060s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:54:46 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-27566031-4129-4b24-9d95-d5141fcc0295 tempest-SnapshotsActionsTest-645252037 None] Acquiring lock "cinder-quobyte-431da365-79df-4788-b7bb-e3118a36fca0" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:54:46 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-27566031-4129-4b24-9d95-d5141fcc0295 tempest-SnapshotsActionsTest-645252037 None] Lock "cinder-quobyte-431da365-79df-4788-b7bb-e3118a36fca0" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:54:46 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-27566031-4129-4b24-9d95-d5141fcc0295 tempest-SnapshotsActionsTest-645252037 None] Acquiring lock "cinder-quobyte-acaa2075-4547-4ff2-a1d5-af59083a521b" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:54:46 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7efebea0-4f8d-406a-adb2-b46cb77a568c tempest-CreateVolumesFromImageTest-1932203306 None] Lock "cinder-quobyte-f0d4bc4a-a49a-47f1-9f48-9ae5ec2a8962" acquired by "delete_volume" :: waited 0.048s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:54:46 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-27566031-4129-4b24-9d95-d5141fcc0295 tempest-SnapshotsActionsTest-645252037 None] Lock "cinder-quobyte-acaa2075-4547-4ff2-a1d5-af59083a521b" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:54:46 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-27566031-4129-4b24-9d95-d5141fcc0295 tempest-SnapshotsActionsTest-645252037 None] Deleting offline snapshot acaa2075-4547-4ff2-a1d5-af59083a521b of volume 431da365-79df-4788-b7bb-e3118a36fca0 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 17:54:46 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-27566031-4129-4b24-9d95-d5141fcc0295 tempest-SnapshotsActionsTest-645252037 None] snapshot_file for this snap is: volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 17:54:46 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[307881f7-883f-4941-97cb-b75296f9d692]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:54:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7efebea0-4f8d-406a-adb2-b46cb77a568c tempest-CreateVolumesFromImageTest-1932203306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f0d4bc4a-a49a-47f1-9f48-9ae5ec2a8962 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:46 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3c3ab3-30c0-4f9d-a9c7-3f1d84e209de]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:54:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-27566031-4129-4b24-9d95-d5141fcc0295 tempest-SnapshotsActionsTest-645252037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:47 devstack sudo[95352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f0d4bc4a-a49a-47f1-9f48-9ae5ec2a8962 Sep 04 17:54:47 devstack sudo[95352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:47 devstack sudo[95353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b Sep 04 17:54:47 devstack sudo[95353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:47 devstack sudo[95352]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7efebea0-4f8d-406a-adb2-b46cb77a568c tempest-CreateVolumesFromImageTest-1932203306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f0d4bc4a-a49a-47f1-9f48-9ae5ec2a8962" returned: 0 in 0.716s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7efebea0-4f8d-406a-adb2-b46cb77a568c tempest-CreateVolumesFromImageTest-1932203306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f0d4bc4a-a49a-47f1-9f48-9ae5ec2a8962 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:47 devstack sudo[95353]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-27566031-4129-4b24-9d95-d5141fcc0295 tempest-SnapshotsActionsTest-645252037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b" returned: 0 in 0.732s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:47 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-27566031-4129-4b24-9d95-d5141fcc0295 tempest-SnapshotsActionsTest-645252037 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-431da365-79df-4788-b7bb-e3118a36fca0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 17:54:47 devstack sudo[95368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f0d4bc4a-a49a-47f1-9f48-9ae5ec2a8962 Sep 04 17:54:47 devstack sudo[95368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:47 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a650128-8a77-44cb-8f48-6fe2895bb1b9]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:54:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-27566031-4129-4b24-9d95-d5141fcc0295 tempest-SnapshotsActionsTest-645252037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:48 devstack sudo[95370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0 Sep 04 17:54:48 devstack sudo[95370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:48 devstack sudo[95368]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7efebea0-4f8d-406a-adb2-b46cb77a568c tempest-CreateVolumesFromImageTest-1932203306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f0d4bc4a-a49a-47f1-9f48-9ae5ec2a8962" returned: 0 in 0.657s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:48 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7efebea0-4f8d-406a-adb2-b46cb77a568c tempest-CreateVolumesFromImageTest-1932203306 None] Lock "cinder-quobyte-f0d4bc4a-a49a-47f1-9f48-9ae5ec2a8962" released by "delete_volume" :: held 1.461s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:54:48 devstack sudo[95370]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-27566031-4129-4b24-9d95-d5141fcc0295 tempest-SnapshotsActionsTest-645252037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0" returned: 0 in 0.631s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-27566031-4129-4b24-9d95-d5141fcc0295 tempest-SnapshotsActionsTest-645252037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:48 devstack sudo[95387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b Sep 04 17:54:48 devstack sudo[95387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:48 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-7efebea0-4f8d-406a-adb2-b46cb77a568c tempest-CreateVolumesFromImageTest-1932203306 None] Created reservations ['b9af18e3-16eb-4654-bb42-36b5f8f8a2dd', 'da1c3400-4e40-4986-95d5-110ba90be87c', '1133ae89-4861-42c5-b6f3-da40816fac1d', 'a7808ee5-37ed-4eef-9d48-dd11f57d6078'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:54:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-39bb44ec-7a0d-4128-946e-48f5e6173a56 req-79109572-dbb4-49e9-a217-4d0f5b539079 tempest-AttachVolumeNegativeTest-221345582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:54:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-39bb44ec-7a0d-4128-946e-48f5e6173a56 req-79109572-dbb4-49e9-a217-4d0f5b539079 tempest-AttachVolumeNegativeTest-221345582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:54:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-39bb44ec-7a0d-4128-946e-48f5e6173a56 req-79109572-dbb4-49e9-a217-4d0f5b539079 tempest-AttachVolumeNegativeTest-221345582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:54:48 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-39bb44ec-7a0d-4128-946e-48f5e6173a56 req-79109572-dbb4-49e9-a217-4d0f5b539079 tempest-AttachVolumeNegativeTest-221345582 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a', 'name': 'volume-cc9723cf-6972-4a43-a1d5-fb327158319b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5d92f025-fe69-4acf-a8be-32a920c88dcf', 'enforce_multipath': True} {{(pid=87314) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 17:54:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7efebea0-4f8d-406a-adb2-b46cb77a568c tempest-CreateVolumesFromImageTest-1932203306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:54:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7efebea0-4f8d-406a-adb2-b46cb77a568c tempest-CreateVolumesFromImageTest-1932203306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:54:48 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7efebea0-4f8d-406a-adb2-b46cb77a568c tempest-CreateVolumesFromImageTest-1932203306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:54:48 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7efebea0-4f8d-406a-adb2-b46cb77a568c tempest-CreateVolumesFromImageTest-1932203306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:54:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7efebea0-4f8d-406a-adb2-b46cb77a568c tempest-CreateVolumesFromImageTest-1932203306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:54:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7efebea0-4f8d-406a-adb2-b46cb77a568c tempest-CreateVolumesFromImageTest-1932203306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:48 devstack sudo[95391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:54:48 devstack sudo[95391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:48 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-39bb44ec-7a0d-4128-946e-48f5e6173a56 req-79109572-dbb4-49e9-a217-4d0f5b539079 tempest-AttachVolumeNegativeTest-221345582 None] attachment_update completed successfully. Sep 04 17:54:48 devstack sudo[95387]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-27566031-4129-4b24-9d95-d5141fcc0295 tempest-SnapshotsActionsTest-645252037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b" returned: 0 in 0.520s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-27566031-4129-4b24-9d95-d5141fcc0295 tempest-SnapshotsActionsTest-645252037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:48 devstack sudo[95397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b Sep 04 17:54:48 devstack sudo[95397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:49 devstack sudo[95391]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7efebea0-4f8d-406a-adb2-b46cb77a568c tempest-CreateVolumesFromImageTest-1932203306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.386s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:49 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-7efebea0-4f8d-406a-adb2-b46cb77a568c tempest-CreateVolumesFromImageTest-1932203306 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:54:49 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-7efebea0-4f8d-406a-adb2-b46cb77a568c tempest-CreateVolumesFromImageTest-1932203306 None] Deleted volume successfully. Sep 04 17:54:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7efebea0-4f8d-406a-adb2-b46cb77a568c tempest-CreateVolumesFromImageTest-1932203306 None] Lock "cinder-f0d4bc4a-a49a-47f1-9f48-9ae5ec2a8962-delete_volume" released by "delete_volume" :: held 2.516s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:54:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-97e5e8bb-abfc-43ae-a536-1bbb5bbef668 tempest-CreateVolumesFromImageTest-1932203306 None] Acquiring lock "cinder-12b089b9-81ea-4ec8-9aa7-43be2f0f818e-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:54:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-97e5e8bb-abfc-43ae-a536-1bbb5bbef668 tempest-CreateVolumesFromImageTest-1932203306 None] Lock "cinder-12b089b9-81ea-4ec8-9aa7-43be2f0f818e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:54:49 devstack sudo[95397]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-27566031-4129-4b24-9d95-d5141fcc0295 tempest-SnapshotsActionsTest-645252037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0.acaa2075-4547-4ff2-a1d5-af59083a521b" returned: 0 in 0.551s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-27566031-4129-4b24-9d95-d5141fcc0295 tempest-SnapshotsActionsTest-645252037 None] Lock "cinder-quobyte-acaa2075-4547-4ff2-a1d5-af59083a521b" released by "_delete_snapshot" :: held 2.700s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:54:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-27566031-4129-4b24-9d95-d5141fcc0295 tempest-SnapshotsActionsTest-645252037 None] Lock "cinder-quobyte-431da365-79df-4788-b7bb-e3118a36fca0" released by "delete_snapshot" :: held 2.771s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:54:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-97e5e8bb-abfc-43ae-a536-1bbb5bbef668 tempest-CreateVolumesFromImageTest-1932203306 None] Acquiring lock "cinder-quobyte-12b089b9-81ea-4ec8-9aa7-43be2f0f818e" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:54:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-97e5e8bb-abfc-43ae-a536-1bbb5bbef668 tempest-CreateVolumesFromImageTest-1932203306 None] Lock "cinder-quobyte-12b089b9-81ea-4ec8-9aa7-43be2f0f818e" acquired by "delete_volume" :: waited 0.033s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:54:49 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee3a337-831a-41ab-9856-aab577ca1a24]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:54:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-97e5e8bb-abfc-43ae-a536-1bbb5bbef668 tempest-CreateVolumesFromImageTest-1932203306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-12b089b9-81ea-4ec8-9aa7-43be2f0f818e {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:49 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-27566031-4129-4b24-9d95-d5141fcc0295 tempest-SnapshotsActionsTest-645252037 None] Created reservations ['de7f8073-a7b3-4837-a7c7-932f189816a6', '36e9fcf3-c166-4120-b6ca-cc78002c00e5', 'e7064cb8-f646-460a-b513-ad9a79437890', '700fcb4e-526e-466e-8620-f034e4dd4743'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:54:49 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-27566031-4129-4b24-9d95-d5141fcc0295 tempest-SnapshotsActionsTest-645252037 None] Delete snapshot completed successfully. Sep 04 17:54:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-27566031-4129-4b24-9d95-d5141fcc0295 tempest-SnapshotsActionsTest-645252037 None] Lock "cinder-acaa2075-4547-4ff2-a1d5-af59083a521b-delete_snapshot" released by "delete_snapshot" :: held 3.072s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:54:49 devstack sudo[95401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-12b089b9-81ea-4ec8-9aa7-43be2f0f818e Sep 04 17:54:49 devstack sudo[95401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:50 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a8e894df-4abe-4681-94be-d8d37ac7446d tempest-SnapshotsActionsTest-645252037 None] Acquiring lock "cinder-431da365-79df-4788-b7bb-e3118a36fca0-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:54:50 devstack sudo[95401]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-97e5e8bb-abfc-43ae-a536-1bbb5bbef668 tempest-CreateVolumesFromImageTest-1932203306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-12b089b9-81ea-4ec8-9aa7-43be2f0f818e" returned: 0 in 0.504s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-97e5e8bb-abfc-43ae-a536-1bbb5bbef668 tempest-CreateVolumesFromImageTest-1932203306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-12b089b9-81ea-4ec8-9aa7-43be2f0f818e {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:50 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a8e894df-4abe-4681-94be-d8d37ac7446d tempest-SnapshotsActionsTest-645252037 None] Lock "cinder-431da365-79df-4788-b7bb-e3118a36fca0-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:54:50 devstack sudo[95407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-12b089b9-81ea-4ec8-9aa7-43be2f0f818e Sep 04 17:54:50 devstack sudo[95407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:50 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a8e894df-4abe-4681-94be-d8d37ac7446d tempest-SnapshotsActionsTest-645252037 None] Acquiring lock "cinder-quobyte-431da365-79df-4788-b7bb-e3118a36fca0" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:54:50 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a8e894df-4abe-4681-94be-d8d37ac7446d tempest-SnapshotsActionsTest-645252037 None] Lock "cinder-quobyte-431da365-79df-4788-b7bb-e3118a36fca0" acquired by "delete_volume" :: waited 0.021s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:54:50 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0a1290-3285-43da-9af3-ddb67f7e24aa]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:54:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a8e894df-4abe-4681-94be-d8d37ac7446d tempest-SnapshotsActionsTest-645252037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:50 devstack sudo[95409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0 Sep 04 17:54:50 devstack sudo[95409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:50 devstack sudo[95407]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-97e5e8bb-abfc-43ae-a536-1bbb5bbef668 tempest-CreateVolumesFromImageTest-1932203306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-12b089b9-81ea-4ec8-9aa7-43be2f0f818e" returned: 0 in 0.351s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:50 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-97e5e8bb-abfc-43ae-a536-1bbb5bbef668 tempest-CreateVolumesFromImageTest-1932203306 None] Lock "cinder-quobyte-12b089b9-81ea-4ec8-9aa7-43be2f0f818e" released by "delete_volume" :: held 0.949s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:54:50 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-97e5e8bb-abfc-43ae-a536-1bbb5bbef668 tempest-CreateVolumesFromImageTest-1932203306 None] Created reservations ['9f0f256d-da3e-4537-8995-2bbbe821b419', 'b7784d78-3f26-460f-bd42-06547d59cf7e', '788ef741-cedb-4b1d-a167-01f1b6d32a22', '315f4ca7-a440-45c1-851b-fa178bf34c99'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:54:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-97e5e8bb-abfc-43ae-a536-1bbb5bbef668 tempest-CreateVolumesFromImageTest-1932203306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:54:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-97e5e8bb-abfc-43ae-a536-1bbb5bbef668 tempest-CreateVolumesFromImageTest-1932203306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:54:50 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-97e5e8bb-abfc-43ae-a536-1bbb5bbef668 tempest-CreateVolumesFromImageTest-1932203306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:54:50 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-97e5e8bb-abfc-43ae-a536-1bbb5bbef668 tempest-CreateVolumesFromImageTest-1932203306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:54:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-97e5e8bb-abfc-43ae-a536-1bbb5bbef668 tempest-CreateVolumesFromImageTest-1932203306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:54:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-97e5e8bb-abfc-43ae-a536-1bbb5bbef668 tempest-CreateVolumesFromImageTest-1932203306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:50 devstack sudo[95414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:54:50 devstack sudo[95414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:50 devstack sudo[95409]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a8e894df-4abe-4681-94be-d8d37ac7446d tempest-SnapshotsActionsTest-645252037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0" returned: 0 in 0.553s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a8e894df-4abe-4681-94be-d8d37ac7446d tempest-SnapshotsActionsTest-645252037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:51 devstack sudo[95417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0 Sep 04 17:54:51 devstack sudo[95417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:51 devstack sudo[95414]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-97e5e8bb-abfc-43ae-a536-1bbb5bbef668 tempest-CreateVolumesFromImageTest-1932203306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.396s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:51 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-97e5e8bb-abfc-43ae-a536-1bbb5bbef668 tempest-CreateVolumesFromImageTest-1932203306 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:54:51 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-97e5e8bb-abfc-43ae-a536-1bbb5bbef668 tempest-CreateVolumesFromImageTest-1932203306 None] Deleted volume successfully. Sep 04 17:54:51 devstack sudo[95417]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a8e894df-4abe-4681-94be-d8d37ac7446d tempest-SnapshotsActionsTest-645252037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-431da365-79df-4788-b7bb-e3118a36fca0" returned: 0 in 0.351s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:51 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a8e894df-4abe-4681-94be-d8d37ac7446d tempest-SnapshotsActionsTest-645252037 None] Lock "cinder-quobyte-431da365-79df-4788-b7bb-e3118a36fca0" released by "delete_volume" :: held 0.998s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:54:51 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-97e5e8bb-abfc-43ae-a536-1bbb5bbef668 tempest-CreateVolumesFromImageTest-1932203306 None] Lock "cinder-12b089b9-81ea-4ec8-9aa7-43be2f0f818e-delete_volume" released by "delete_volume" :: held 1.912s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:54:51 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-a8e894df-4abe-4681-94be-d8d37ac7446d tempest-SnapshotsActionsTest-645252037 None] Created reservations ['a1f858d1-eb9f-406c-8ead-1ac616f21691', 'ea4b964d-1538-4556-a9a4-6bf7a4673040', '3c68a34f-60ec-46b1-8759-dc53deb43327', 'ee2ea9bc-4416-4a47-b566-c24ccc3d6455'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:54:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a8e894df-4abe-4681-94be-d8d37ac7446d tempest-SnapshotsActionsTest-645252037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:54:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a8e894df-4abe-4681-94be-d8d37ac7446d tempest-SnapshotsActionsTest-645252037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:54:51 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a8e894df-4abe-4681-94be-d8d37ac7446d tempest-SnapshotsActionsTest-645252037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:54:51 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a8e894df-4abe-4681-94be-d8d37ac7446d tempest-SnapshotsActionsTest-645252037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:54:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a8e894df-4abe-4681-94be-d8d37ac7446d tempest-SnapshotsActionsTest-645252037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:54:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a8e894df-4abe-4681-94be-d8d37ac7446d tempest-SnapshotsActionsTest-645252037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:51 devstack sudo[95422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:54:51 devstack sudo[95422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:51 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-06a34976-c4ae-4261-92aa-f734bf5e5a95 req-ac1d3955-573c-4dd4-a419-23dbf029ad5a tempest-AttachVolumeNegativeTest-221345582 None] Terminate volume connection completed successfully. Sep 04 17:54:51 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-06a34976-c4ae-4261-92aa-f734bf5e5a95 req-ac1d3955-573c-4dd4-a419-23dbf029ad5a tempest-AttachVolumeNegativeTest-221345582 None] Deleting attachment 5d92f025-fe69-4acf-a8be-32a920c88dcf. {{(pid=87314) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 17:54:51 devstack sudo[95422]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a8e894df-4abe-4681-94be-d8d37ac7446d tempest-SnapshotsActionsTest-645252037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.289s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:51 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-a8e894df-4abe-4681-94be-d8d37ac7446d tempest-SnapshotsActionsTest-645252037 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:54:51 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-a8e894df-4abe-4681-94be-d8d37ac7446d tempest-SnapshotsActionsTest-645252037 None] Deleted volume successfully. Sep 04 17:54:51 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a8e894df-4abe-4681-94be-d8d37ac7446d tempest-SnapshotsActionsTest-645252037 None] Lock "cinder-431da365-79df-4788-b7bb-e3118a36fca0-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:54:56 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c3ef70b-3a7e-4218-bde0-a41afa7c1cd4 tempest-CreateVolumesFromSnapshotTest-225056910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:54:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8c3ef70b-3a7e-4218-bde0-a41afa7c1cd4 tempest-CreateVolumesFromSnapshotTest-225056910 None] Flow 'volume_create_manager' (706d5a7e-a454-4cdc-9fae-04419f72b684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:54:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8c3ef70b-3a7e-4218-bde0-a41afa7c1cd4 tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21896b5e-c49b-46ec-80d9-cd78aed9ebdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:54:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8c3ef70b-3a7e-4218-bde0-a41afa7c1cd4 tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21896b5e-c49b-46ec-80d9-cd78aed9ebdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:54:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1710696779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=192fd796-9cb5-4d20-9904-face2ab24f31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43a680c9ea5943a6a3bb25763828a556',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:54:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:54:56Z,use_quota=True,user_id='10e8b5f4d6f44b2ca2dfdb9a746c541d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:54:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8c3ef70b-3a7e-4218-bde0-a41afa7c1cd4 tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a6b4aa5-56ba-49f1-9235-d4bdc56be53d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:54:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8c3ef70b-3a7e-4218-bde0-a41afa7c1cd4 tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a6b4aa5-56ba-49f1-9235-d4bdc56be53d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:54:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8c3ef70b-3a7e-4218-bde0-a41afa7c1cd4 tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98d70567-f42b-4116-9d96-9aa9024838cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:54:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8c3ef70b-3a7e-4218-bde0-a41afa7c1cd4 tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98d70567-f42b-4116-9d96-9aa9024838cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '192fd796-9cb5-4d20-9904-face2ab24f31', 'volume_name': 'volume-192fd796-9cb5-4d20-9904-face2ab24f31', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:54:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8c3ef70b-3a7e-4218-bde0-a41afa7c1cd4 tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7302650-e4d0-409c-b4fd-f66474c3cf21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:54:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8c3ef70b-3a7e-4218-bde0-a41afa7c1cd4 tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7302650-e4d0-409c-b4fd-f66474c3cf21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:54:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8c3ef70b-3a7e-4218-bde0-a41afa7c1cd4 tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55f3b272-1197-4d37-b59e-6719359e1b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:54:56 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-8c3ef70b-3a7e-4218-bde0-a41afa7c1cd4 tempest-CreateVolumesFromSnapshotTest-225056910 None] Volume 192fd796-9cb5-4d20-9904-face2ab24f31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-192fd796-9cb5-4d20-9904-face2ab24f31', 'volume_size': 1} Sep 04 17:54:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8c3ef70b-3a7e-4218-bde0-a41afa7c1cd4 tempest-CreateVolumesFromSnapshotTest-225056910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:54:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8c3ef70b-3a7e-4218-bde0-a41afa7c1cd4 tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:54:56 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8c3ef70b-3a7e-4218-bde0-a41afa7c1cd4 tempest-CreateVolumesFromSnapshotTest-225056910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:54:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1710696779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=192fd796-9cb5-4d20-9904-face2ab24f31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43a680c9ea5943a6a3bb25763828a556',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:54:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:54:56Z,use_quota=True,user_id='10e8b5f4d6f44b2ca2dfdb9a746c541d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:54:56 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-8c3ef70b-3a7e-4218-bde0-a41afa7c1cd4 tempest-CreateVolumesFromSnapshotTest-225056910 None] Creating volume 192fd796-9cb5-4d20-9904-face2ab24f31 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:54:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8c3ef70b-3a7e-4218-bde0-a41afa7c1cd4 tempest-CreateVolumesFromSnapshotTest-225056910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:54:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8c3ef70b-3a7e-4218-bde0-a41afa7c1cd4 tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:54:56 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8c3ef70b-3a7e-4218-bde0-a41afa7c1cd4 tempest-CreateVolumesFromSnapshotTest-225056910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:54:56 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8c3ef70b-3a7e-4218-bde0-a41afa7c1cd4 tempest-CreateVolumesFromSnapshotTest-225056910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:54:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8c3ef70b-3a7e-4218-bde0-a41afa7c1cd4 tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:54:56 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8c3ef70b-3a7e-4218-bde0-a41afa7c1cd4 tempest-CreateVolumesFromSnapshotTest-225056910 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:54:56 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-8c3ef70b-3a7e-4218-bde0-a41afa7c1cd4 tempest-CreateVolumesFromSnapshotTest-225056910 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:54:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8c3ef70b-3a7e-4218-bde0-a41afa7c1cd4 tempest-CreateVolumesFromSnapshotTest-225056910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-192fd796-9cb5-4d20-9904-face2ab24f31 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:56 devstack sudo[95454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-192fd796-9cb5-4d20-9904-face2ab24f31 1073741824 Sep 04 17:54:56 devstack sudo[95454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:57 devstack sudo[95454]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8c3ef70b-3a7e-4218-bde0-a41afa7c1cd4 tempest-CreateVolumesFromSnapshotTest-225056910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-192fd796-9cb5-4d20-9904-face2ab24f31 1073741824" returned: 0 in 0.603s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:57 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:UPDATE=123,cinder:SELECT=114,cinder:DELETE=9,cinder:INSERT=33 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 17:54:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8c3ef70b-3a7e-4218-bde0-a41afa7c1cd4 tempest-CreateVolumesFromSnapshotTest-225056910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-192fd796-9cb5-4d20-9904-face2ab24f31 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:57 devstack sudo[95460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-192fd796-9cb5-4d20-9904-face2ab24f31 Sep 04 17:54:57 devstack sudo[95460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:57 devstack sudo[95460]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8c3ef70b-3a7e-4218-bde0-a41afa7c1cd4 tempest-CreateVolumesFromSnapshotTest-225056910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-192fd796-9cb5-4d20-9904-face2ab24f31" returned: 0 in 0.385s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:57 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8c3ef70b-3a7e-4218-bde0-a41afa7c1cd4 tempest-CreateVolumesFromSnapshotTest-225056910 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:54:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8c3ef70b-3a7e-4218-bde0-a41afa7c1cd4 tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:54:57 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=122,cinder:UPDATE=119,cinder:INSERT=37,cinder:DELETE=11 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 17:54:57 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8c3ef70b-3a7e-4218-bde0-a41afa7c1cd4 tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55f3b272-1197-4d37-b59e-6719359e1b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-192fd796-9cb5-4d20-9904-face2ab24f31', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:54:57 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8c3ef70b-3a7e-4218-bde0-a41afa7c1cd4 tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a37657ba-497a-460e-91cf-367bb82d51aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:54:57 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-8c3ef70b-3a7e-4218-bde0-a41afa7c1cd4 tempest-CreateVolumesFromSnapshotTest-225056910 None] Volume volume-192fd796-9cb5-4d20-9904-face2ab24f31 (192fd796-9cb5-4d20-9904-face2ab24f31): created successfully Sep 04 17:54:57 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8c3ef70b-3a7e-4218-bde0-a41afa7c1cd4 tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a37657ba-497a-460e-91cf-367bb82d51aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:54:57 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8c3ef70b-3a7e-4218-bde0-a41afa7c1cd4 tempest-CreateVolumesFromSnapshotTest-225056910 None] Flow 'volume_create_manager' (706d5a7e-a454-4cdc-9fae-04419f72b684) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:54:57 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-8c3ef70b-3a7e-4218-bde0-a41afa7c1cd4 tempest-CreateVolumesFromSnapshotTest-225056910 None] Created volume successfully. Sep 04 17:54:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4d3fb62e-5c28-4cff-893c-622df2fe9233 tempest-CreateVolumesFromSnapshotTest-225056910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:54:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4d3fb62e-5c28-4cff-893c-622df2fe9233 tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:54:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-4d3fb62e-5c28-4cff-893c-622df2fe9233 tempest-CreateVolumesFromSnapshotTest-225056910 None] Creating offline snapshot 4026e17c-5eec-4562-adf3-96a3dae56039 of volume 192fd796-9cb5-4d20-9904-face2ab24f31 {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 17:54:58 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa463ae-5402-4b2d-bda4-00cfddee593a]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:54:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4d3fb62e-5c28-4cff-893c-622df2fe9233 tempest-CreateVolumesFromSnapshotTest-225056910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-192fd796-9cb5-4d20-9904-face2ab24f31 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:59 devstack sudo[95463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-192fd796-9cb5-4d20-9904-face2ab24f31 Sep 04 17:54:59 devstack sudo[95463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:59 devstack sudo[95463]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4d3fb62e-5c28-4cff-893c-622df2fe9233 tempest-CreateVolumesFromSnapshotTest-225056910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-192fd796-9cb5-4d20-9904-face2ab24f31" returned: 0 in 0.461s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4d3fb62e-5c28-4cff-893c-622df2fe9233 tempest-CreateVolumesFromSnapshotTest-225056910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-192fd796-9cb5-4d20-9904-face2ab24f31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-192fd796-9cb5-4d20-9904-face2ab24f31.4026e17c-5eec-4562-adf3-96a3dae56039 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:59 devstack sudo[95468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-192fd796-9cb5-4d20-9904-face2ab24f31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-192fd796-9cb5-4d20-9904-face2ab24f31.4026e17c-5eec-4562-adf3-96a3dae56039 1G Sep 04 17:54:59 devstack sudo[95468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:54:59 devstack sudo[95468]: pam_unix(sudo:session): session closed for user root Sep 04 17:54:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4d3fb62e-5c28-4cff-893c-622df2fe9233 tempest-CreateVolumesFromSnapshotTest-225056910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-192fd796-9cb5-4d20-9904-face2ab24f31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-192fd796-9cb5-4d20-9904-face2ab24f31.4026e17c-5eec-4562-adf3-96a3dae56039 1G" returned: 0 in 0.523s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:54:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4d3fb62e-5c28-4cff-893c-622df2fe9233 tempest-CreateVolumesFromSnapshotTest-225056910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-192fd796-9cb5-4d20-9904-face2ab24f31 -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-192fd796-9cb5-4d20-9904-face2ab24f31.4026e17c-5eec-4562-adf3-96a3dae56039 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:54:59 devstack sudo[95480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-192fd796-9cb5-4d20-9904-face2ab24f31 -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-192fd796-9cb5-4d20-9904-face2ab24f31.4026e17c-5eec-4562-adf3-96a3dae56039 Sep 04 17:54:59 devstack sudo[95480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:00 devstack sudo[95480]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4d3fb62e-5c28-4cff-893c-622df2fe9233 tempest-CreateVolumesFromSnapshotTest-225056910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-192fd796-9cb5-4d20-9904-face2ab24f31 -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-192fd796-9cb5-4d20-9904-face2ab24f31.4026e17c-5eec-4562-adf3-96a3dae56039" returned: 0 in 0.430s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:00 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-4d3fb62e-5c28-4cff-893c-622df2fe9233 tempest-CreateVolumesFromSnapshotTest-225056910 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-192fd796-9cb5-4d20-9904-face2ab24f31.4026e17c-5eec-4562-adf3-96a3dae56039 is being set with open permissions: ugo+rw Sep 04 17:55:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4d3fb62e-5c28-4cff-893c-622df2fe9233 tempest-CreateVolumesFromSnapshotTest-225056910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-192fd796-9cb5-4d20-9904-face2ab24f31.4026e17c-5eec-4562-adf3-96a3dae56039 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:00 devstack sudo[95487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-192fd796-9cb5-4d20-9904-face2ab24f31.4026e17c-5eec-4562-adf3-96a3dae56039 Sep 04 17:55:00 devstack sudo[95487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:00 devstack sudo[95487]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4d3fb62e-5c28-4cff-893c-622df2fe9233 tempest-CreateVolumesFromSnapshotTest-225056910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-192fd796-9cb5-4d20-9904-face2ab24f31.4026e17c-5eec-4562-adf3-96a3dae56039" returned: 0 in 0.291s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4d3fb62e-5c28-4cff-893c-622df2fe9233 tempest-CreateVolumesFromSnapshotTest-225056910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-192fd796-9cb5-4d20-9904-face2ab24f31.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:00 devstack sudo[95490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-192fd796-9cb5-4d20-9904-face2ab24f31.info Sep 04 17:55:00 devstack sudo[95490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:00 devstack sudo[95490]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4d3fb62e-5c28-4cff-893c-622df2fe9233 tempest-CreateVolumesFromSnapshotTest-225056910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-192fd796-9cb5-4d20-9904-face2ab24f31.info" returned: 0 in 0.299s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:00 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-4d3fb62e-5c28-4cff-893c-622df2fe9233 tempest-CreateVolumesFromSnapshotTest-225056910 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-192fd796-9cb5-4d20-9904-face2ab24f31.info is being set with open permissions: ugo+rw Sep 04 17:55:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4d3fb62e-5c28-4cff-893c-622df2fe9233 tempest-CreateVolumesFromSnapshotTest-225056910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-192fd796-9cb5-4d20-9904-face2ab24f31.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:01 devstack sudo[95493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-192fd796-9cb5-4d20-9904-face2ab24f31.info Sep 04 17:55:01 devstack sudo[95493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:01 devstack sudo[95493]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4d3fb62e-5c28-4cff-893c-622df2fe9233 tempest-CreateVolumesFromSnapshotTest-225056910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-192fd796-9cb5-4d20-9904-face2ab24f31.info" returned: 0 in 0.436s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4d3fb62e-5c28-4cff-893c-622df2fe9233 tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.588s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:55:01 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-4d3fb62e-5c28-4cff-893c-622df2fe9233 tempest-CreateVolumesFromSnapshotTest-225056910 None] Create snapshot completed successfully Sep 04 17:55:02 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3c63fc5-cd3a-4705-af37-f1250eadc877 tempest-CreateVolumesFromSnapshotTest-225056910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:55:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a3c63fc5-cd3a-4705-af37-f1250eadc877 tempest-CreateVolumesFromSnapshotTest-225056910 None] Flow 'volume_create_manager' (cb8c2c1d-c06a-456c-a75b-1c8e0d1aff33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:55:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a3c63fc5-cd3a-4705-af37-f1250eadc877 tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46e01d0c-57a0-4247-bd5d-9032b3a25746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:55:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a3c63fc5-cd3a-4705-af37-f1250eadc877 tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46e01d0c-57a0-4247-bd5d-9032b3a25746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:55:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-703871581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=808a549e-0d43-4e01-a6f8-8e1b420ec0fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43a680c9ea5943a6a3bb25763828a556',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:55:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:55:03Z,use_quota=True,user_id='10e8b5f4d6f44b2ca2dfdb9a746c541d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:55:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a3c63fc5-cd3a-4705-af37-f1250eadc877 tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (642e7ce4-3675-49dc-88b1-e56c2e89067d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:55:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a3c63fc5-cd3a-4705-af37-f1250eadc877 tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (642e7ce4-3675-49dc-88b1-e56c2e89067d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:55:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a3c63fc5-cd3a-4705-af37-f1250eadc877 tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff2b4121-2701-46e9-a5c9-3d86fbc75f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:55:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a3c63fc5-cd3a-4705-af37-f1250eadc877 tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff2b4121-2701-46e9-a5c9-3d86fbc75f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '808a549e-0d43-4e01-a6f8-8e1b420ec0fa', 'volume_name': 'volume-808a549e-0d43-4e01-a6f8-8e1b420ec0fa', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:55:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a3c63fc5-cd3a-4705-af37-f1250eadc877 tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c183a0b4-ddb2-44ac-b4db-5b11445505fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:55:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a3c63fc5-cd3a-4705-af37-f1250eadc877 tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c183a0b4-ddb2-44ac-b4db-5b11445505fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:55:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a3c63fc5-cd3a-4705-af37-f1250eadc877 tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e025e69c-e7f3-40ba-80ab-87e0e61df940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:55:03 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-a3c63fc5-cd3a-4705-af37-f1250eadc877 tempest-CreateVolumesFromSnapshotTest-225056910 None] Volume 808a549e-0d43-4e01-a6f8-8e1b420ec0fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-808a549e-0d43-4e01-a6f8-8e1b420ec0fa', 'volume_size': 1} Sep 04 17:55:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a3c63fc5-cd3a-4705-af37-f1250eadc877 tempest-CreateVolumesFromSnapshotTest-225056910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:55:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a3c63fc5-cd3a-4705-af37-f1250eadc877 tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:55:03 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a3c63fc5-cd3a-4705-af37-f1250eadc877 tempest-CreateVolumesFromSnapshotTest-225056910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:55:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-703871581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=808a549e-0d43-4e01-a6f8-8e1b420ec0fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43a680c9ea5943a6a3bb25763828a556',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:55:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:55:03Z,use_quota=True,user_id='10e8b5f4d6f44b2ca2dfdb9a746c541d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:55:03 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-a3c63fc5-cd3a-4705-af37-f1250eadc877 tempest-CreateVolumesFromSnapshotTest-225056910 None] Creating volume 808a549e-0d43-4e01-a6f8-8e1b420ec0fa {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:55:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a3c63fc5-cd3a-4705-af37-f1250eadc877 tempest-CreateVolumesFromSnapshotTest-225056910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:55:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a3c63fc5-cd3a-4705-af37-f1250eadc877 tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:55:03 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a3c63fc5-cd3a-4705-af37-f1250eadc877 tempest-CreateVolumesFromSnapshotTest-225056910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:55:03 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a3c63fc5-cd3a-4705-af37-f1250eadc877 tempest-CreateVolumesFromSnapshotTest-225056910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:55:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a3c63fc5-cd3a-4705-af37-f1250eadc877 tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:55:03 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a3c63fc5-cd3a-4705-af37-f1250eadc877 tempest-CreateVolumesFromSnapshotTest-225056910 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:55:03 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-a3c63fc5-cd3a-4705-af37-f1250eadc877 tempest-CreateVolumesFromSnapshotTest-225056910 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:55:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a3c63fc5-cd3a-4705-af37-f1250eadc877 tempest-CreateVolumesFromSnapshotTest-225056910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-808a549e-0d43-4e01-a6f8-8e1b420ec0fa 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:03 devstack sudo[95872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-808a549e-0d43-4e01-a6f8-8e1b420ec0fa 1073741824 Sep 04 17:55:03 devstack sudo[95872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:03 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-59053a52-3fa4-448a-a69a-5826c40785f2 tempest-CreateVolumesFromSnapshotTest-225056910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:55:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-59053a52-3fa4-448a-a69a-5826c40785f2 tempest-CreateVolumesFromSnapshotTest-225056910 None] Flow 'volume_create_manager' (8f6e93fe-613c-4c33-9b1a-6b10f4937de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:55:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-59053a52-3fa4-448a-a69a-5826c40785f2 tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54a0a989-bb07-4186-9a57-904a83b9b9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:55:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-59053a52-3fa4-448a-a69a-5826c40785f2 tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54a0a989-bb07-4186-9a57-904a83b9b9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:55:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1318094570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdd614eb-9ce1-40bf-9881-84de420069a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43a680c9ea5943a6a3bb25763828a556',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:55:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:55:04Z,use_quota=True,user_id='10e8b5f4d6f44b2ca2dfdb9a746c541d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:55:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-59053a52-3fa4-448a-a69a-5826c40785f2 tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60e9e041-acf7-48f3-ae6c-79639ec8be5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:55:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-59053a52-3fa4-448a-a69a-5826c40785f2 tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60e9e041-acf7-48f3-ae6c-79639ec8be5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:55:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-59053a52-3fa4-448a-a69a-5826c40785f2 tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a10b8498-4833-4f68-ac9e-2743cd543f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:55:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-59053a52-3fa4-448a-a69a-5826c40785f2 tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a10b8498-4833-4f68-ac9e-2743cd543f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdd614eb-9ce1-40bf-9881-84de420069a6', 'volume_name': 'volume-cdd614eb-9ce1-40bf-9881-84de420069a6', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:55:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-59053a52-3fa4-448a-a69a-5826c40785f2 tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0167aa1b-e068-4574-ae20-a31a02e23a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:55:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-59053a52-3fa4-448a-a69a-5826c40785f2 tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0167aa1b-e068-4574-ae20-a31a02e23a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:55:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-59053a52-3fa4-448a-a69a-5826c40785f2 tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25edefc1-578c-4c56-9fee-5d81c258b110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:55:03 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-59053a52-3fa4-448a-a69a-5826c40785f2 tempest-CreateVolumesFromSnapshotTest-225056910 None] Volume cdd614eb-9ce1-40bf-9881-84de420069a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdd614eb-9ce1-40bf-9881-84de420069a6', 'volume_size': 1} Sep 04 17:55:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-59053a52-3fa4-448a-a69a-5826c40785f2 tempest-CreateVolumesFromSnapshotTest-225056910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:55:04 devstack sudo[95872]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a3c63fc5-cd3a-4705-af37-f1250eadc877 tempest-CreateVolumesFromSnapshotTest-225056910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-808a549e-0d43-4e01-a6f8-8e1b420ec0fa 1073741824" returned: 0 in 1.074s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a3c63fc5-cd3a-4705-af37-f1250eadc877 tempest-CreateVolumesFromSnapshotTest-225056910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-808a549e-0d43-4e01-a6f8-8e1b420ec0fa {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:04 devstack sudo[95885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-808a549e-0d43-4e01-a6f8-8e1b420ec0fa Sep 04 17:55:04 devstack sudo[95885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:04 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f322374-924e-45fb-b5d8-044c4f54ecea tempest-CreateVolumesFromSnapshotTest-225056910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:55:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7f322374-924e-45fb-b5d8-044c4f54ecea tempest-CreateVolumesFromSnapshotTest-225056910 None] Flow 'volume_create_manager' (febc39d7-379d-4d20-acf3-d35e7f55aa0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:55:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7f322374-924e-45fb-b5d8-044c4f54ecea tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a8d2ede-f516-4576-aceb-175509f39e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:55:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7f322374-924e-45fb-b5d8-044c4f54ecea tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a8d2ede-f516-4576-aceb-175509f39e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-810771962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b87c651-25f4-4fca-a7d1-87147c3ed05c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43a680c9ea5943a6a3bb25763828a556',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:55:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:55:04Z,use_quota=True,user_id='10e8b5f4d6f44b2ca2dfdb9a746c541d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:55:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7f322374-924e-45fb-b5d8-044c4f54ecea tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9760bd77-1930-4689-a758-d2c9c5f59bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:55:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7f322374-924e-45fb-b5d8-044c4f54ecea tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9760bd77-1930-4689-a758-d2c9c5f59bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:55:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7f322374-924e-45fb-b5d8-044c4f54ecea tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ab07104-d8a8-4a96-bb71-f778a11d735a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:55:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7f322374-924e-45fb-b5d8-044c4f54ecea tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ab07104-d8a8-4a96-bb71-f778a11d735a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b87c651-25f4-4fca-a7d1-87147c3ed05c', 'volume_name': 'volume-0b87c651-25f4-4fca-a7d1-87147c3ed05c', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:55:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7f322374-924e-45fb-b5d8-044c4f54ecea tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5028819-4737-46c7-9166-8bbcad652bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:55:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7f322374-924e-45fb-b5d8-044c4f54ecea tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5028819-4737-46c7-9166-8bbcad652bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:55:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7f322374-924e-45fb-b5d8-044c4f54ecea tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25699af2-0bdc-4dd8-9fe7-4425cca029f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:55:04 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-7f322374-924e-45fb-b5d8-044c4f54ecea tempest-CreateVolumesFromSnapshotTest-225056910 None] Volume 0b87c651-25f4-4fca-a7d1-87147c3ed05c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b87c651-25f4-4fca-a7d1-87147c3ed05c', 'volume_size': 1} Sep 04 17:55:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7f322374-924e-45fb-b5d8-044c4f54ecea tempest-CreateVolumesFromSnapshotTest-225056910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:55:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a3c63fc5-cd3a-4705-af37-f1250eadc877 tempest-CreateVolumesFromSnapshotTest-225056910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-808a549e-0d43-4e01-a6f8-8e1b420ec0fa" returned: 0 in 0.562s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:04 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a3c63fc5-cd3a-4705-af37-f1250eadc877 tempest-CreateVolumesFromSnapshotTest-225056910 None] <== create_volume: return (1731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:55:04 devstack sudo[95885]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a3c63fc5-cd3a-4705-af37-f1250eadc877 tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.738s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:55:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-59053a52-3fa4-448a-a69a-5826c40785f2 tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.981s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:55:04 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-59053a52-3fa4-448a-a69a-5826c40785f2 tempest-CreateVolumesFromSnapshotTest-225056910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:55:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1318094570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdd614eb-9ce1-40bf-9881-84de420069a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43a680c9ea5943a6a3bb25763828a556',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:55:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:55:04Z,use_quota=True,user_id='10e8b5f4d6f44b2ca2dfdb9a746c541d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:55:04 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-59053a52-3fa4-448a-a69a-5826c40785f2 tempest-CreateVolumesFromSnapshotTest-225056910 None] Creating volume cdd614eb-9ce1-40bf-9881-84de420069a6 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:55:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-59053a52-3fa4-448a-a69a-5826c40785f2 tempest-CreateVolumesFromSnapshotTest-225056910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:55:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-59053a52-3fa4-448a-a69a-5826c40785f2 tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:55:04 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-59053a52-3fa4-448a-a69a-5826c40785f2 tempest-CreateVolumesFromSnapshotTest-225056910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:55:04 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-59053a52-3fa4-448a-a69a-5826c40785f2 tempest-CreateVolumesFromSnapshotTest-225056910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:55:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-59053a52-3fa4-448a-a69a-5826c40785f2 tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:55:04 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-59053a52-3fa4-448a-a69a-5826c40785f2 tempest-CreateVolumesFromSnapshotTest-225056910 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:55:04 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-59053a52-3fa4-448a-a69a-5826c40785f2 tempest-CreateVolumesFromSnapshotTest-225056910 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:55:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-59053a52-3fa4-448a-a69a-5826c40785f2 tempest-CreateVolumesFromSnapshotTest-225056910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cdd614eb-9ce1-40bf-9881-84de420069a6 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a3c63fc5-cd3a-4705-af37-f1250eadc877 tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e025e69c-e7f3-40ba-80ab-87e0e61df940) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-808a549e-0d43-4e01-a6f8-8e1b420ec0fa', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:55:04 devstack sudo[95892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cdd614eb-9ce1-40bf-9881-84de420069a6 1073741824 Sep 04 17:55:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a3c63fc5-cd3a-4705-af37-f1250eadc877 tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b44aad44-cd3e-419a-a58a-30250fb856bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:55:04 devstack sudo[95892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:04 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-a3c63fc5-cd3a-4705-af37-f1250eadc877 tempest-CreateVolumesFromSnapshotTest-225056910 None] Volume volume-808a549e-0d43-4e01-a6f8-8e1b420ec0fa (808a549e-0d43-4e01-a6f8-8e1b420ec0fa): created successfully Sep 04 17:55:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a3c63fc5-cd3a-4705-af37-f1250eadc877 tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b44aad44-cd3e-419a-a58a-30250fb856bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:55:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a3c63fc5-cd3a-4705-af37-f1250eadc877 tempest-CreateVolumesFromSnapshotTest-225056910 None] Flow 'volume_create_manager' (cb8c2c1d-c06a-456c-a75b-1c8e0d1aff33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:55:04 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-a3c63fc5-cd3a-4705-af37-f1250eadc877 tempest-CreateVolumesFromSnapshotTest-225056910 None] Created volume successfully. Sep 04 17:55:05 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcc76428-5bcd-43c7-b404-04d93f46c26e tempest-CreateVolumesFromSnapshotTest-225056910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:55:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dcc76428-5bcd-43c7-b404-04d93f46c26e tempest-CreateVolumesFromSnapshotTest-225056910 None] Flow 'volume_create_manager' (2e742dec-470d-4a41-8a65-042eff88a640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:55:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dcc76428-5bcd-43c7-b404-04d93f46c26e tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45777deb-3f38-4734-a3e6-ca68f2291144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:55:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dcc76428-5bcd-43c7-b404-04d93f46c26e tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45777deb-3f38-4734-a3e6-ca68f2291144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-684507639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef09a055-dcda-48a6-8d28-6894b3e1ab39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43a680c9ea5943a6a3bb25763828a556',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:55:05Z,use_quota=True,user_id='10e8b5f4d6f44b2ca2dfdb9a746c541d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:55:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dcc76428-5bcd-43c7-b404-04d93f46c26e tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34eb5611-b0ab-44a6-bdaa-f5e96ff8b8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:55:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dcc76428-5bcd-43c7-b404-04d93f46c26e tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34eb5611-b0ab-44a6-bdaa-f5e96ff8b8a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:55:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dcc76428-5bcd-43c7-b404-04d93f46c26e tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (160f0f43-2825-4e0a-807e-49cecbd29725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:55:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dcc76428-5bcd-43c7-b404-04d93f46c26e tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (160f0f43-2825-4e0a-807e-49cecbd29725) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef09a055-dcda-48a6-8d28-6894b3e1ab39', 'volume_name': 'volume-ef09a055-dcda-48a6-8d28-6894b3e1ab39', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:55:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dcc76428-5bcd-43c7-b404-04d93f46c26e tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a9f79a9-a82b-49a5-8ed0-cd5f5be637fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:55:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dcc76428-5bcd-43c7-b404-04d93f46c26e tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a9f79a9-a82b-49a5-8ed0-cd5f5be637fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:55:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dcc76428-5bcd-43c7-b404-04d93f46c26e tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87091459-fa60-45a0-a274-ca71f574653c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:55:05 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-dcc76428-5bcd-43c7-b404-04d93f46c26e tempest-CreateVolumesFromSnapshotTest-225056910 None] Volume ef09a055-dcda-48a6-8d28-6894b3e1ab39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef09a055-dcda-48a6-8d28-6894b3e1ab39', 'volume_size': 1} Sep 04 17:55:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-dcc76428-5bcd-43c7-b404-04d93f46c26e tempest-CreateVolumesFromSnapshotTest-225056910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:55:05 devstack sudo[95892]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-59053a52-3fa4-448a-a69a-5826c40785f2 tempest-CreateVolumesFromSnapshotTest-225056910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cdd614eb-9ce1-40bf-9881-84de420069a6 1073741824" returned: 0 in 0.764s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:05 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-579267c9-5f6e-4cc8-b1e4-76086dfda8cf tempest-CreateVolumesFromSnapshotTest-225056910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:55:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-579267c9-5f6e-4cc8-b1e4-76086dfda8cf tempest-CreateVolumesFromSnapshotTest-225056910 None] Flow 'volume_create_manager' (167e65ad-78f0-434b-9139-b616d5cfcc54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:55:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-579267c9-5f6e-4cc8-b1e4-76086dfda8cf tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfe51e54-25e6-4ff5-afe5-44270f99878f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:55:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-59053a52-3fa4-448a-a69a-5826c40785f2 tempest-CreateVolumesFromSnapshotTest-225056910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cdd614eb-9ce1-40bf-9881-84de420069a6 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-579267c9-5f6e-4cc8-b1e4-76086dfda8cf tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfe51e54-25e6-4ff5-afe5-44270f99878f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2147326868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95a55544-7da4-4aff-b592-beef9d542e7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43a680c9ea5943a6a3bb25763828a556',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:55:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:55:06Z,use_quota=True,user_id='10e8b5f4d6f44b2ca2dfdb9a746c541d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:55:05 devstack sudo[95911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cdd614eb-9ce1-40bf-9881-84de420069a6 Sep 04 17:55:05 devstack sudo[95911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-579267c9-5f6e-4cc8-b1e4-76086dfda8cf tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (836a1450-84fa-4489-98e5-331820f0423c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:55:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-579267c9-5f6e-4cc8-b1e4-76086dfda8cf tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (836a1450-84fa-4489-98e5-331820f0423c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:55:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-579267c9-5f6e-4cc8-b1e4-76086dfda8cf tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62c7c5b4-3c88-4df4-b5b0-010110422af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:55:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-579267c9-5f6e-4cc8-b1e4-76086dfda8cf tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62c7c5b4-3c88-4df4-b5b0-010110422af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95a55544-7da4-4aff-b592-beef9d542e7b', 'volume_name': 'volume-95a55544-7da4-4aff-b592-beef9d542e7b', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:55:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-579267c9-5f6e-4cc8-b1e4-76086dfda8cf tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71942ccc-7dbb-43e6-ad25-eeba5903a46a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:55:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-579267c9-5f6e-4cc8-b1e4-76086dfda8cf tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71942ccc-7dbb-43e6-ad25-eeba5903a46a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:55:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-579267c9-5f6e-4cc8-b1e4-76086dfda8cf tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07dc258a-b6b3-479a-983f-4bd83e73508e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:55:05 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-579267c9-5f6e-4cc8-b1e4-76086dfda8cf tempest-CreateVolumesFromSnapshotTest-225056910 None] Volume 95a55544-7da4-4aff-b592-beef9d542e7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95a55544-7da4-4aff-b592-beef9d542e7b', 'volume_size': 1} Sep 04 17:55:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-579267c9-5f6e-4cc8-b1e4-76086dfda8cf tempest-CreateVolumesFromSnapshotTest-225056910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:55:06 devstack sudo[95911]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-59053a52-3fa4-448a-a69a-5826c40785f2 tempest-CreateVolumesFromSnapshotTest-225056910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cdd614eb-9ce1-40bf-9881-84de420069a6" returned: 0 in 0.330s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:06 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-59053a52-3fa4-448a-a69a-5826c40785f2 tempest-CreateVolumesFromSnapshotTest-225056910 None] <== create_volume: return (1216ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:55:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-59053a52-3fa4-448a-a69a-5826c40785f2 tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.221s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:55:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7f322374-924e-45fb-b5d8-044c4f54ecea tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.463s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:55:06 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7f322374-924e-45fb-b5d8-044c4f54ecea tempest-CreateVolumesFromSnapshotTest-225056910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-810771962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b87c651-25f4-4fca-a7d1-87147c3ed05c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43a680c9ea5943a6a3bb25763828a556',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:55:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:55:04Z,use_quota=True,user_id='10e8b5f4d6f44b2ca2dfdb9a746c541d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:55:06 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-7f322374-924e-45fb-b5d8-044c4f54ecea tempest-CreateVolumesFromSnapshotTest-225056910 None] Creating volume 0b87c651-25f4-4fca-a7d1-87147c3ed05c {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:55:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7f322374-924e-45fb-b5d8-044c4f54ecea tempest-CreateVolumesFromSnapshotTest-225056910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:55:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7f322374-924e-45fb-b5d8-044c4f54ecea tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:55:06 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7f322374-924e-45fb-b5d8-044c4f54ecea tempest-CreateVolumesFromSnapshotTest-225056910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:55:06 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7f322374-924e-45fb-b5d8-044c4f54ecea tempest-CreateVolumesFromSnapshotTest-225056910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:55:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7f322374-924e-45fb-b5d8-044c4f54ecea tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:55:06 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7f322374-924e-45fb-b5d8-044c4f54ecea tempest-CreateVolumesFromSnapshotTest-225056910 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:55:06 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-7f322374-924e-45fb-b5d8-044c4f54ecea tempest-CreateVolumesFromSnapshotTest-225056910 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:55:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7f322374-924e-45fb-b5d8-044c4f54ecea tempest-CreateVolumesFromSnapshotTest-225056910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0b87c651-25f4-4fca-a7d1-87147c3ed05c 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-59053a52-3fa4-448a-a69a-5826c40785f2 tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25edefc1-578c-4c56-9fee-5d81c258b110) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdd614eb-9ce1-40bf-9881-84de420069a6', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:55:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-59053a52-3fa4-448a-a69a-5826c40785f2 tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81a7d0ba-9aee-4d91-9b7b-30650b0ec58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:55:06 devstack sudo[95914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0b87c651-25f4-4fca-a7d1-87147c3ed05c 1073741824 Sep 04 17:55:06 devstack sudo[95914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:06 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-59053a52-3fa4-448a-a69a-5826c40785f2 tempest-CreateVolumesFromSnapshotTest-225056910 None] Volume volume-cdd614eb-9ce1-40bf-9881-84de420069a6 (cdd614eb-9ce1-40bf-9881-84de420069a6): created successfully Sep 04 17:55:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-59053a52-3fa4-448a-a69a-5826c40785f2 tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81a7d0ba-9aee-4d91-9b7b-30650b0ec58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:55:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-59053a52-3fa4-448a-a69a-5826c40785f2 tempest-CreateVolumesFromSnapshotTest-225056910 None] Flow 'volume_create_manager' (8f6e93fe-613c-4c33-9b1a-6b10f4937de1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:55:06 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-59053a52-3fa4-448a-a69a-5826c40785f2 tempest-CreateVolumesFromSnapshotTest-225056910 None] Created volume successfully. Sep 04 17:55:06 devstack sudo[95914]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7f322374-924e-45fb-b5d8-044c4f54ecea tempest-CreateVolumesFromSnapshotTest-225056910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0b87c651-25f4-4fca-a7d1-87147c3ed05c 1073741824" returned: 0 in 0.512s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7f322374-924e-45fb-b5d8-044c4f54ecea tempest-CreateVolumesFromSnapshotTest-225056910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0b87c651-25f4-4fca-a7d1-87147c3ed05c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:06 devstack sudo[95920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0b87c651-25f4-4fca-a7d1-87147c3ed05c Sep 04 17:55:06 devstack sudo[95920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:06 devstack sudo[95920]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7f322374-924e-45fb-b5d8-044c4f54ecea tempest-CreateVolumesFromSnapshotTest-225056910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0b87c651-25f4-4fca-a7d1-87147c3ed05c" returned: 0 in 0.256s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:06 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7f322374-924e-45fb-b5d8-044c4f54ecea tempest-CreateVolumesFromSnapshotTest-225056910 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:55:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7f322374-924e-45fb-b5d8-044c4f54ecea tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:55:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-dcc76428-5bcd-43c7-b404-04d93f46c26e tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.535s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:55:06 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-dcc76428-5bcd-43c7-b404-04d93f46c26e tempest-CreateVolumesFromSnapshotTest-225056910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-684507639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef09a055-dcda-48a6-8d28-6894b3e1ab39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43a680c9ea5943a6a3bb25763828a556',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:55:05Z,use_quota=True,user_id='10e8b5f4d6f44b2ca2dfdb9a746c541d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:55:06 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-dcc76428-5bcd-43c7-b404-04d93f46c26e tempest-CreateVolumesFromSnapshotTest-225056910 None] Creating volume ef09a055-dcda-48a6-8d28-6894b3e1ab39 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:55:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-dcc76428-5bcd-43c7-b404-04d93f46c26e tempest-CreateVolumesFromSnapshotTest-225056910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:55:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-dcc76428-5bcd-43c7-b404-04d93f46c26e tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:55:06 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-dcc76428-5bcd-43c7-b404-04d93f46c26e tempest-CreateVolumesFromSnapshotTest-225056910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:55:06 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-dcc76428-5bcd-43c7-b404-04d93f46c26e tempest-CreateVolumesFromSnapshotTest-225056910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:55:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-dcc76428-5bcd-43c7-b404-04d93f46c26e tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:55:06 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-dcc76428-5bcd-43c7-b404-04d93f46c26e tempest-CreateVolumesFromSnapshotTest-225056910 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:55:06 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-dcc76428-5bcd-43c7-b404-04d93f46c26e tempest-CreateVolumesFromSnapshotTest-225056910 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:55:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dcc76428-5bcd-43c7-b404-04d93f46c26e tempest-CreateVolumesFromSnapshotTest-225056910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ef09a055-dcda-48a6-8d28-6894b3e1ab39 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7f322374-924e-45fb-b5d8-044c4f54ecea tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25699af2-0bdc-4dd8-9fe7-4425cca029f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b87c651-25f4-4fca-a7d1-87147c3ed05c', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:55:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7f322374-924e-45fb-b5d8-044c4f54ecea tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef710519-df1b-4e48-9301-3cbb7cc129fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:55:06 devstack sudo[95923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ef09a055-dcda-48a6-8d28-6894b3e1ab39 1073741824 Sep 04 17:55:06 devstack sudo[95923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:06 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-7f322374-924e-45fb-b5d8-044c4f54ecea tempest-CreateVolumesFromSnapshotTest-225056910 None] Volume volume-0b87c651-25f4-4fca-a7d1-87147c3ed05c (0b87c651-25f4-4fca-a7d1-87147c3ed05c): created successfully Sep 04 17:55:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7f322374-924e-45fb-b5d8-044c4f54ecea tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef710519-df1b-4e48-9301-3cbb7cc129fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:55:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7f322374-924e-45fb-b5d8-044c4f54ecea tempest-CreateVolumesFromSnapshotTest-225056910 None] Flow 'volume_create_manager' (febc39d7-379d-4d20-acf3-d35e7f55aa0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:55:06 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-7f322374-924e-45fb-b5d8-044c4f54ecea tempest-CreateVolumesFromSnapshotTest-225056910 None] Created volume successfully. Sep 04 17:55:07 devstack sudo[95923]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dcc76428-5bcd-43c7-b404-04d93f46c26e tempest-CreateVolumesFromSnapshotTest-225056910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ef09a055-dcda-48a6-8d28-6894b3e1ab39 1073741824" returned: 0 in 0.577s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dcc76428-5bcd-43c7-b404-04d93f46c26e tempest-CreateVolumesFromSnapshotTest-225056910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ef09a055-dcda-48a6-8d28-6894b3e1ab39 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:07 devstack sudo[95930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ef09a055-dcda-48a6-8d28-6894b3e1ab39 Sep 04 17:55:07 devstack sudo[95930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:07 devstack sudo[95930]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dcc76428-5bcd-43c7-b404-04d93f46c26e tempest-CreateVolumesFromSnapshotTest-225056910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ef09a055-dcda-48a6-8d28-6894b3e1ab39" returned: 0 in 0.326s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:07 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-dcc76428-5bcd-43c7-b404-04d93f46c26e tempest-CreateVolumesFromSnapshotTest-225056910 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:55:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-dcc76428-5bcd-43c7-b404-04d93f46c26e tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:55:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-579267c9-5f6e-4cc8-b1e4-76086dfda8cf tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.971s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:55:07 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-579267c9-5f6e-4cc8-b1e4-76086dfda8cf tempest-CreateVolumesFromSnapshotTest-225056910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2147326868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95a55544-7da4-4aff-b592-beef9d542e7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43a680c9ea5943a6a3bb25763828a556',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:55:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:55:06Z,use_quota=True,user_id='10e8b5f4d6f44b2ca2dfdb9a746c541d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:55:07 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-579267c9-5f6e-4cc8-b1e4-76086dfda8cf tempest-CreateVolumesFromSnapshotTest-225056910 None] Creating volume 95a55544-7da4-4aff-b592-beef9d542e7b {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:55:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-579267c9-5f6e-4cc8-b1e4-76086dfda8cf tempest-CreateVolumesFromSnapshotTest-225056910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:55:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-579267c9-5f6e-4cc8-b1e4-76086dfda8cf tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:55:07 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-579267c9-5f6e-4cc8-b1e4-76086dfda8cf tempest-CreateVolumesFromSnapshotTest-225056910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:55:07 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-579267c9-5f6e-4cc8-b1e4-76086dfda8cf tempest-CreateVolumesFromSnapshotTest-225056910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:55:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-579267c9-5f6e-4cc8-b1e4-76086dfda8cf tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:55:07 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-579267c9-5f6e-4cc8-b1e4-76086dfda8cf tempest-CreateVolumesFromSnapshotTest-225056910 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:55:07 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-579267c9-5f6e-4cc8-b1e4-76086dfda8cf tempest-CreateVolumesFromSnapshotTest-225056910 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:55:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-579267c9-5f6e-4cc8-b1e4-76086dfda8cf tempest-CreateVolumesFromSnapshotTest-225056910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-95a55544-7da4-4aff-b592-beef9d542e7b 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:07 devstack sudo[95941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-95a55544-7da4-4aff-b592-beef9d542e7b 1073741824 Sep 04 17:55:07 devstack sudo[95941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dcc76428-5bcd-43c7-b404-04d93f46c26e tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87091459-fa60-45a0-a274-ca71f574653c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef09a055-dcda-48a6-8d28-6894b3e1ab39', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:55:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dcc76428-5bcd-43c7-b404-04d93f46c26e tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7228f04-cb6c-4acf-8e4f-d8fa1f07eec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:55:08 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-dcc76428-5bcd-43c7-b404-04d93f46c26e tempest-CreateVolumesFromSnapshotTest-225056910 None] Volume volume-ef09a055-dcda-48a6-8d28-6894b3e1ab39 (ef09a055-dcda-48a6-8d28-6894b3e1ab39): created successfully Sep 04 17:55:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dcc76428-5bcd-43c7-b404-04d93f46c26e tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7228f04-cb6c-4acf-8e4f-d8fa1f07eec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:55:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dcc76428-5bcd-43c7-b404-04d93f46c26e tempest-CreateVolumesFromSnapshotTest-225056910 None] Flow 'volume_create_manager' (2e742dec-470d-4a41-8a65-042eff88a640) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:55:08 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-dcc76428-5bcd-43c7-b404-04d93f46c26e tempest-CreateVolumesFromSnapshotTest-225056910 None] Created volume successfully. Sep 04 17:55:08 devstack sudo[95941]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-579267c9-5f6e-4cc8-b1e4-76086dfda8cf tempest-CreateVolumesFromSnapshotTest-225056910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-95a55544-7da4-4aff-b592-beef9d542e7b 1073741824" returned: 0 in 1.069s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-579267c9-5f6e-4cc8-b1e4-76086dfda8cf tempest-CreateVolumesFromSnapshotTest-225056910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-95a55544-7da4-4aff-b592-beef9d542e7b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:09 devstack sudo[96003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-95a55544-7da4-4aff-b592-beef9d542e7b Sep 04 17:55:09 devstack sudo[96003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:09 devstack sudo[96003]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-579267c9-5f6e-4cc8-b1e4-76086dfda8cf tempest-CreateVolumesFromSnapshotTest-225056910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-95a55544-7da4-4aff-b592-beef9d542e7b" returned: 0 in 0.380s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:09 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-579267c9-5f6e-4cc8-b1e4-76086dfda8cf tempest-CreateVolumesFromSnapshotTest-225056910 None] <== create_volume: return (1580ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:55:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-579267c9-5f6e-4cc8-b1e4-76086dfda8cf tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.583s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:55:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-579267c9-5f6e-4cc8-b1e4-76086dfda8cf tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07dc258a-b6b3-479a-983f-4bd83e73508e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95a55544-7da4-4aff-b592-beef9d542e7b', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:55:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-579267c9-5f6e-4cc8-b1e4-76086dfda8cf tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3524bf7-2f72-4934-b5fc-e5b67f38d9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:55:09 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-579267c9-5f6e-4cc8-b1e4-76086dfda8cf tempest-CreateVolumesFromSnapshotTest-225056910 None] Volume volume-95a55544-7da4-4aff-b592-beef9d542e7b (95a55544-7da4-4aff-b592-beef9d542e7b): created successfully Sep 04 17:55:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-579267c9-5f6e-4cc8-b1e4-76086dfda8cf tempest-CreateVolumesFromSnapshotTest-225056910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3524bf7-2f72-4934-b5fc-e5b67f38d9bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:55:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-579267c9-5f6e-4cc8-b1e4-76086dfda8cf tempest-CreateVolumesFromSnapshotTest-225056910 None] Flow 'volume_create_manager' (167e65ad-78f0-434b-9139-b616d5cfcc54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:55:09 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-579267c9-5f6e-4cc8-b1e4-76086dfda8cf tempest-CreateVolumesFromSnapshotTest-225056910 None] Created volume successfully. Sep 04 17:55:10 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fbb98113-8f8e-46ca-8f02-a02d08046b08 tempest-CreateVolumesFromSnapshotTest-225056910 None] Acquiring lock "cinder-95a55544-7da4-4aff-b592-beef9d542e7b-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:55:10 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fbb98113-8f8e-46ca-8f02-a02d08046b08 tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "cinder-95a55544-7da4-4aff-b592-beef9d542e7b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:55:10 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fbb98113-8f8e-46ca-8f02-a02d08046b08 tempest-CreateVolumesFromSnapshotTest-225056910 None] Acquiring lock "cinder-quobyte-95a55544-7da4-4aff-b592-beef9d542e7b" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:55:10 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fbb98113-8f8e-46ca-8f02-a02d08046b08 tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "cinder-quobyte-95a55544-7da4-4aff-b592-beef9d542e7b" acquired by "delete_volume" :: waited 0.016s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:55:10 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[5359d9f4-793b-400e-a611-a7df3197b470]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:55:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fbb98113-8f8e-46ca-8f02-a02d08046b08 tempest-CreateVolumesFromSnapshotTest-225056910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-95a55544-7da4-4aff-b592-beef9d542e7b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:10 devstack sudo[96010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-95a55544-7da4-4aff-b592-beef9d542e7b Sep 04 17:55:10 devstack sudo[96010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:10 devstack sudo[96010]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fbb98113-8f8e-46ca-8f02-a02d08046b08 tempest-CreateVolumesFromSnapshotTest-225056910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-95a55544-7da4-4aff-b592-beef9d542e7b" returned: 0 in 0.434s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fbb98113-8f8e-46ca-8f02-a02d08046b08 tempest-CreateVolumesFromSnapshotTest-225056910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-95a55544-7da4-4aff-b592-beef9d542e7b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:10 devstack sudo[96015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-95a55544-7da4-4aff-b592-beef9d542e7b Sep 04 17:55:10 devstack sudo[96015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:11 devstack sudo[96015]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fbb98113-8f8e-46ca-8f02-a02d08046b08 tempest-CreateVolumesFromSnapshotTest-225056910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-95a55544-7da4-4aff-b592-beef9d542e7b" returned: 0 in 0.288s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:11 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fbb98113-8f8e-46ca-8f02-a02d08046b08 tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "cinder-quobyte-95a55544-7da4-4aff-b592-beef9d542e7b" released by "delete_volume" :: held 0.781s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:55:11 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-fbb98113-8f8e-46ca-8f02-a02d08046b08 tempest-CreateVolumesFromSnapshotTest-225056910 None] Created reservations ['c59e0b7f-7ad2-4b92-af9e-84fed4b5cd00', '1c1d4ebd-b631-427d-af9e-646a9b9178ec', 'f42b2733-545c-4417-b04d-dab00f683c82', '2c76da2c-0e0b-4606-9c45-d6229e61ab08'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:55:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fbb98113-8f8e-46ca-8f02-a02d08046b08 tempest-CreateVolumesFromSnapshotTest-225056910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:55:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fbb98113-8f8e-46ca-8f02-a02d08046b08 tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:55:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-fbb98113-8f8e-46ca-8f02-a02d08046b08 tempest-CreateVolumesFromSnapshotTest-225056910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:55:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-fbb98113-8f8e-46ca-8f02-a02d08046b08 tempest-CreateVolumesFromSnapshotTest-225056910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:55:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fbb98113-8f8e-46ca-8f02-a02d08046b08 tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:55:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fbb98113-8f8e-46ca-8f02-a02d08046b08 tempest-CreateVolumesFromSnapshotTest-225056910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:11 devstack sudo[96018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:55:11 devstack sudo[96018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:11 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-98e1829f-c187-47fc-9106-98ca7d5bc84f tempest-CreateVolumesFromSnapshotTest-225056910 None] Acquiring lock "cinder-ef09a055-dcda-48a6-8d28-6894b3e1ab39-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:55:11 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-98e1829f-c187-47fc-9106-98ca7d5bc84f tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "cinder-ef09a055-dcda-48a6-8d28-6894b3e1ab39-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:55:11 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-98e1829f-c187-47fc-9106-98ca7d5bc84f tempest-CreateVolumesFromSnapshotTest-225056910 None] Acquiring lock "cinder-quobyte-ef09a055-dcda-48a6-8d28-6894b3e1ab39" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:55:11 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-98e1829f-c187-47fc-9106-98ca7d5bc84f tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "cinder-quobyte-ef09a055-dcda-48a6-8d28-6894b3e1ab39" acquired by "delete_volume" :: waited 0.070s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:55:11 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[464fa903-986d-42b4-88a9-4d5b8f837033]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:55:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-98e1829f-c187-47fc-9106-98ca7d5bc84f tempest-CreateVolumesFromSnapshotTest-225056910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ef09a055-dcda-48a6-8d28-6894b3e1ab39 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:11 devstack sudo[96018]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fbb98113-8f8e-46ca-8f02-a02d08046b08 tempest-CreateVolumesFromSnapshotTest-225056910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.478s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:11 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-fbb98113-8f8e-46ca-8f02-a02d08046b08 tempest-CreateVolumesFromSnapshotTest-225056910 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:55:12 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-fbb98113-8f8e-46ca-8f02-a02d08046b08 tempest-CreateVolumesFromSnapshotTest-225056910 None] Deleted volume successfully. Sep 04 17:55:12 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fbb98113-8f8e-46ca-8f02-a02d08046b08 tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "cinder-95a55544-7da4-4aff-b592-beef9d542e7b-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:55:12 devstack sudo[96021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ef09a055-dcda-48a6-8d28-6894b3e1ab39 Sep 04 17:55:12 devstack sudo[96021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:12 devstack sudo[96021]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-98e1829f-c187-47fc-9106-98ca7d5bc84f tempest-CreateVolumesFromSnapshotTest-225056910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ef09a055-dcda-48a6-8d28-6894b3e1ab39" returned: 0 in 0.758s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-98e1829f-c187-47fc-9106-98ca7d5bc84f tempest-CreateVolumesFromSnapshotTest-225056910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ef09a055-dcda-48a6-8d28-6894b3e1ab39 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:12 devstack sudo[96026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ef09a055-dcda-48a6-8d28-6894b3e1ab39 Sep 04 17:55:12 devstack sudo[96026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:13 devstack sudo[96026]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-98e1829f-c187-47fc-9106-98ca7d5bc84f tempest-CreateVolumesFromSnapshotTest-225056910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ef09a055-dcda-48a6-8d28-6894b3e1ab39" returned: 0 in 0.639s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:13 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-98e1829f-c187-47fc-9106-98ca7d5bc84f tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "cinder-quobyte-ef09a055-dcda-48a6-8d28-6894b3e1ab39" released by "delete_volume" :: held 1.518s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:55:13 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-98e1829f-c187-47fc-9106-98ca7d5bc84f tempest-CreateVolumesFromSnapshotTest-225056910 None] Created reservations ['24e2d157-9b4b-432b-a60a-c64c9086a440', '4c587fe0-d746-4724-9290-e16baa3589e3', 'c73591cf-258f-4bbb-b595-f356daf20ae3', '3a3ff7d7-c851-4490-ad34-06509e580f8c'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:55:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-98e1829f-c187-47fc-9106-98ca7d5bc84f tempest-CreateVolumesFromSnapshotTest-225056910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:55:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-98e1829f-c187-47fc-9106-98ca7d5bc84f tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:55:13 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-98e1829f-c187-47fc-9106-98ca7d5bc84f tempest-CreateVolumesFromSnapshotTest-225056910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:55:13 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-98e1829f-c187-47fc-9106-98ca7d5bc84f tempest-CreateVolumesFromSnapshotTest-225056910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:55:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-98e1829f-c187-47fc-9106-98ca7d5bc84f tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:55:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-98e1829f-c187-47fc-9106-98ca7d5bc84f tempest-CreateVolumesFromSnapshotTest-225056910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:13 devstack sudo[96031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:55:13 devstack sudo[96031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:14 devstack sudo[96031]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-98e1829f-c187-47fc-9106-98ca7d5bc84f tempest-CreateVolumesFromSnapshotTest-225056910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.347s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:14 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-98e1829f-c187-47fc-9106-98ca7d5bc84f tempest-CreateVolumesFromSnapshotTest-225056910 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:55:14 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-98e1829f-c187-47fc-9106-98ca7d5bc84f tempest-CreateVolumesFromSnapshotTest-225056910 None] Deleted volume successfully. Sep 04 17:55:14 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0e8d9304-d922-491a-9974-12953c3e6fdb tempest-CreateVolumesFromSnapshotTest-225056910 None] Acquiring lock "cinder-0b87c651-25f4-4fca-a7d1-87147c3ed05c-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:55:14 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-98e1829f-c187-47fc-9106-98ca7d5bc84f tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "cinder-ef09a055-dcda-48a6-8d28-6894b3e1ab39-delete_volume" released by "delete_volume" :: held 2.402s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:55:14 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0e8d9304-d922-491a-9974-12953c3e6fdb tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "cinder-0b87c651-25f4-4fca-a7d1-87147c3ed05c-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:55:14 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0e8d9304-d922-491a-9974-12953c3e6fdb tempest-CreateVolumesFromSnapshotTest-225056910 None] Acquiring lock "cinder-quobyte-0b87c651-25f4-4fca-a7d1-87147c3ed05c" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:55:14 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0e8d9304-d922-491a-9974-12953c3e6fdb tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "cinder-quobyte-0b87c651-25f4-4fca-a7d1-87147c3ed05c" acquired by "delete_volume" :: waited 0.029s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:55:14 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a9a823-c26e-475f-ac81-32f6ae0ee98a]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:55:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0e8d9304-d922-491a-9974-12953c3e6fdb tempest-CreateVolumesFromSnapshotTest-225056910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0b87c651-25f4-4fca-a7d1-87147c3ed05c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:14 devstack sudo[96043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0b87c651-25f4-4fca-a7d1-87147c3ed05c Sep 04 17:55:14 devstack sudo[96043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:14 devstack sudo[96043]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0e8d9304-d922-491a-9974-12953c3e6fdb tempest-CreateVolumesFromSnapshotTest-225056910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0b87c651-25f4-4fca-a7d1-87147c3ed05c" returned: 0 in 0.577s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0e8d9304-d922-491a-9974-12953c3e6fdb tempest-CreateVolumesFromSnapshotTest-225056910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0b87c651-25f4-4fca-a7d1-87147c3ed05c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:14 devstack sudo[96048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0b87c651-25f4-4fca-a7d1-87147c3ed05c Sep 04 17:55:14 devstack sudo[96048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:15 devstack sudo[96048]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0e8d9304-d922-491a-9974-12953c3e6fdb tempest-CreateVolumesFromSnapshotTest-225056910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0b87c651-25f4-4fca-a7d1-87147c3ed05c" returned: 0 in 0.344s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:15 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0e8d9304-d922-491a-9974-12953c3e6fdb tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "cinder-quobyte-0b87c651-25f4-4fca-a7d1-87147c3ed05c" released by "delete_volume" :: held 1.005s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:55:15 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-0e8d9304-d922-491a-9974-12953c3e6fdb tempest-CreateVolumesFromSnapshotTest-225056910 None] Created reservations ['3795d736-435f-4bc4-a208-373a1d439fd5', 'b96eb476-07d7-4f77-b3ef-db8d578a1e5e', '147d62cb-df4c-4fea-86bc-d8a846499526', '82bb05e7-c5f2-48c0-8f5c-d3971d625769'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:55:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0e8d9304-d922-491a-9974-12953c3e6fdb tempest-CreateVolumesFromSnapshotTest-225056910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:55:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0e8d9304-d922-491a-9974-12953c3e6fdb tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:55:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0e8d9304-d922-491a-9974-12953c3e6fdb tempest-CreateVolumesFromSnapshotTest-225056910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:55:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0e8d9304-d922-491a-9974-12953c3e6fdb tempest-CreateVolumesFromSnapshotTest-225056910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:55:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0e8d9304-d922-491a-9974-12953c3e6fdb tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:55:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0e8d9304-d922-491a-9974-12953c3e6fdb tempest-CreateVolumesFromSnapshotTest-225056910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:15 devstack sudo[96051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:55:15 devstack sudo[96051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:15 devstack sudo[96051]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0e8d9304-d922-491a-9974-12953c3e6fdb tempest-CreateVolumesFromSnapshotTest-225056910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.271s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:15 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-0e8d9304-d922-491a-9974-12953c3e6fdb tempest-CreateVolumesFromSnapshotTest-225056910 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:55:15 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-0e8d9304-d922-491a-9974-12953c3e6fdb tempest-CreateVolumesFromSnapshotTest-225056910 None] Deleted volume successfully. Sep 04 17:55:15 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0e8d9304-d922-491a-9974-12953c3e6fdb tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "cinder-0b87c651-25f4-4fca-a7d1-87147c3ed05c-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:55:16 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-79ca0f37-199b-4eee-81ed-e0d6b27265d7 tempest-CreateVolumesFromSnapshotTest-225056910 None] Acquiring lock "cinder-cdd614eb-9ce1-40bf-9881-84de420069a6-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:55:16 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-79ca0f37-199b-4eee-81ed-e0d6b27265d7 tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "cinder-cdd614eb-9ce1-40bf-9881-84de420069a6-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:55:16 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-79ca0f37-199b-4eee-81ed-e0d6b27265d7 tempest-CreateVolumesFromSnapshotTest-225056910 None] Acquiring lock "cinder-quobyte-cdd614eb-9ce1-40bf-9881-84de420069a6" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:55:16 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-79ca0f37-199b-4eee-81ed-e0d6b27265d7 tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "cinder-quobyte-cdd614eb-9ce1-40bf-9881-84de420069a6" acquired by "delete_volume" :: waited 0.031s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:55:16 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3984640-487e-4b9b-8363-639ab007a53a]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:55:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-79ca0f37-199b-4eee-81ed-e0d6b27265d7 tempest-CreateVolumesFromSnapshotTest-225056910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cdd614eb-9ce1-40bf-9881-84de420069a6 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:16 devstack sudo[96054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cdd614eb-9ce1-40bf-9881-84de420069a6 Sep 04 17:55:16 devstack sudo[96054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:16 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdcdd66f-656e-47af-89d6-62e4e6fbd354 tempest-VolumeQuotasNegativeTestJSON-1248029282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:55:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-cdcdd66f-656e-47af-89d6-62e4e6fbd354 tempest-VolumeQuotasNegativeTestJSON-1248029282 None] Flow 'volume_create_manager' (510ef362-3ba5-4418-b532-b4bf251b5001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:55:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-cdcdd66f-656e-47af-89d6-62e4e6fbd354 tempest-VolumeQuotasNegativeTestJSON-1248029282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09d17224-cc18-4a6c-9977-7d18537a7185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:55:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-cdcdd66f-656e-47af-89d6-62e4e6fbd354 tempest-VolumeQuotasNegativeTestJSON-1248029282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09d17224-cc18-4a6c-9977-7d18537a7185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:55:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-599262975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bf6c809-b2a7-4b92-b7e9-3277c58c90a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0c33cd600474d5e82cde6905ed18a71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:55:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:55:17Z,use_quota=True,user_id='926771b93f1542a7924f0915e6b912a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:55:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-cdcdd66f-656e-47af-89d6-62e4e6fbd354 tempest-VolumeQuotasNegativeTestJSON-1248029282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e82eae9a-4a5c-4e84-8e41-0163f734786f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:55:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-cdcdd66f-656e-47af-89d6-62e4e6fbd354 tempest-VolumeQuotasNegativeTestJSON-1248029282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e82eae9a-4a5c-4e84-8e41-0163f734786f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:55:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-cdcdd66f-656e-47af-89d6-62e4e6fbd354 tempest-VolumeQuotasNegativeTestJSON-1248029282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae0e6cc1-471f-4ed0-9c5c-fc44cad5475b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:55:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-cdcdd66f-656e-47af-89d6-62e4e6fbd354 tempest-VolumeQuotasNegativeTestJSON-1248029282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae0e6cc1-471f-4ed0-9c5c-fc44cad5475b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bf6c809-b2a7-4b92-b7e9-3277c58c90a1', 'volume_name': 'volume-2bf6c809-b2a7-4b92-b7e9-3277c58c90a1', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:55:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-cdcdd66f-656e-47af-89d6-62e4e6fbd354 tempest-VolumeQuotasNegativeTestJSON-1248029282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe6a29f3-8b5c-4427-808e-63d8f29dde74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:55:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-cdcdd66f-656e-47af-89d6-62e4e6fbd354 tempest-VolumeQuotasNegativeTestJSON-1248029282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe6a29f3-8b5c-4427-808e-63d8f29dde74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:55:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-cdcdd66f-656e-47af-89d6-62e4e6fbd354 tempest-VolumeQuotasNegativeTestJSON-1248029282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e952ec1f-09ce-4863-bc11-e88e25ea75aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:55:16 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-cdcdd66f-656e-47af-89d6-62e4e6fbd354 tempest-VolumeQuotasNegativeTestJSON-1248029282 None] Volume 2bf6c809-b2a7-4b92-b7e9-3277c58c90a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bf6c809-b2a7-4b92-b7e9-3277c58c90a1', 'volume_size': 1} Sep 04 17:55:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-cdcdd66f-656e-47af-89d6-62e4e6fbd354 tempest-VolumeQuotasNegativeTestJSON-1248029282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:55:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-cdcdd66f-656e-47af-89d6-62e4e6fbd354 tempest-VolumeQuotasNegativeTestJSON-1248029282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:55:16 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-cdcdd66f-656e-47af-89d6-62e4e6fbd354 tempest-VolumeQuotasNegativeTestJSON-1248029282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:55:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-599262975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bf6c809-b2a7-4b92-b7e9-3277c58c90a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0c33cd600474d5e82cde6905ed18a71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:55:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:55:17Z,use_quota=True,user_id='926771b93f1542a7924f0915e6b912a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:55:16 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-cdcdd66f-656e-47af-89d6-62e4e6fbd354 tempest-VolumeQuotasNegativeTestJSON-1248029282 None] Creating volume 2bf6c809-b2a7-4b92-b7e9-3277c58c90a1 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:55:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-cdcdd66f-656e-47af-89d6-62e4e6fbd354 tempest-VolumeQuotasNegativeTestJSON-1248029282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:55:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-cdcdd66f-656e-47af-89d6-62e4e6fbd354 tempest-VolumeQuotasNegativeTestJSON-1248029282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:55:16 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-cdcdd66f-656e-47af-89d6-62e4e6fbd354 tempest-VolumeQuotasNegativeTestJSON-1248029282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:55:16 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-cdcdd66f-656e-47af-89d6-62e4e6fbd354 tempest-VolumeQuotasNegativeTestJSON-1248029282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:55:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-cdcdd66f-656e-47af-89d6-62e4e6fbd354 tempest-VolumeQuotasNegativeTestJSON-1248029282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:55:16 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-cdcdd66f-656e-47af-89d6-62e4e6fbd354 tempest-VolumeQuotasNegativeTestJSON-1248029282 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:55:16 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-cdcdd66f-656e-47af-89d6-62e4e6fbd354 tempest-VolumeQuotasNegativeTestJSON-1248029282 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:55:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cdcdd66f-656e-47af-89d6-62e4e6fbd354 tempest-VolumeQuotasNegativeTestJSON-1248029282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2bf6c809-b2a7-4b92-b7e9-3277c58c90a1 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:16 devstack sudo[96054]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-79ca0f37-199b-4eee-81ed-e0d6b27265d7 tempest-CreateVolumesFromSnapshotTest-225056910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cdd614eb-9ce1-40bf-9881-84de420069a6" returned: 0 in 0.405s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-79ca0f37-199b-4eee-81ed-e0d6b27265d7 tempest-CreateVolumesFromSnapshotTest-225056910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cdd614eb-9ce1-40bf-9881-84de420069a6 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:16 devstack sudo[96059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2bf6c809-b2a7-4b92-b7e9-3277c58c90a1 1073741824 Sep 04 17:55:16 devstack sudo[96059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:17 devstack sudo[96061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cdd614eb-9ce1-40bf-9881-84de420069a6 Sep 04 17:55:17 devstack sudo[96061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:17 devstack sudo[96061]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-79ca0f37-199b-4eee-81ed-e0d6b27265d7 tempest-CreateVolumesFromSnapshotTest-225056910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cdd614eb-9ce1-40bf-9881-84de420069a6" returned: 0 in 0.281s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:17 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-79ca0f37-199b-4eee-81ed-e0d6b27265d7 tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "cinder-quobyte-cdd614eb-9ce1-40bf-9881-84de420069a6" released by "delete_volume" :: held 0.743s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:55:17 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-79ca0f37-199b-4eee-81ed-e0d6b27265d7 tempest-CreateVolumesFromSnapshotTest-225056910 None] Created reservations ['a929e886-ab5f-49ad-9a18-c735b4e74db9', '07a96994-3f2d-4e50-ae17-c995c119a73f', '716f38de-31fa-40eb-b7c3-8f8bac9df576', '2ebadda7-1244-4739-ae17-db2651713fb2'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:55:17 devstack sudo[96059]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cdcdd66f-656e-47af-89d6-62e4e6fbd354 tempest-VolumeQuotasNegativeTestJSON-1248029282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2bf6c809-b2a7-4b92-b7e9-3277c58c90a1 1073741824" returned: 0 in 0.459s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-79ca0f37-199b-4eee-81ed-e0d6b27265d7 tempest-CreateVolumesFromSnapshotTest-225056910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:55:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-79ca0f37-199b-4eee-81ed-e0d6b27265d7 tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:55:17 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-79ca0f37-199b-4eee-81ed-e0d6b27265d7 tempest-CreateVolumesFromSnapshotTest-225056910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:55:17 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-79ca0f37-199b-4eee-81ed-e0d6b27265d7 tempest-CreateVolumesFromSnapshotTest-225056910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:55:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-79ca0f37-199b-4eee-81ed-e0d6b27265d7 tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:55:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-79ca0f37-199b-4eee-81ed-e0d6b27265d7 tempest-CreateVolumesFromSnapshotTest-225056910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:17 devstack sudo[96067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:55:17 devstack sudo[96067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cdcdd66f-656e-47af-89d6-62e4e6fbd354 tempest-VolumeQuotasNegativeTestJSON-1248029282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2bf6c809-b2a7-4b92-b7e9-3277c58c90a1 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:17 devstack sudo[96069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2bf6c809-b2a7-4b92-b7e9-3277c58c90a1 Sep 04 17:55:17 devstack sudo[96069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:17 devstack sudo[96067]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-79ca0f37-199b-4eee-81ed-e0d6b27265d7 tempest-CreateVolumesFromSnapshotTest-225056910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.304s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:17 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-79ca0f37-199b-4eee-81ed-e0d6b27265d7 tempest-CreateVolumesFromSnapshotTest-225056910 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:55:17 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-79ca0f37-199b-4eee-81ed-e0d6b27265d7 tempest-CreateVolumesFromSnapshotTest-225056910 None] Deleted volume successfully. Sep 04 17:55:17 devstack sudo[96069]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cdcdd66f-656e-47af-89d6-62e4e6fbd354 tempest-VolumeQuotasNegativeTestJSON-1248029282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2bf6c809-b2a7-4b92-b7e9-3277c58c90a1" returned: 0 in 0.303s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:17 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-cdcdd66f-656e-47af-89d6-62e4e6fbd354 tempest-VolumeQuotasNegativeTestJSON-1248029282 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:55:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-cdcdd66f-656e-47af-89d6-62e4e6fbd354 tempest-VolumeQuotasNegativeTestJSON-1248029282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:55:17 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-79ca0f37-199b-4eee-81ed-e0d6b27265d7 tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "cinder-cdd614eb-9ce1-40bf-9881-84de420069a6-delete_volume" released by "delete_volume" :: held 1.361s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:55:17 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-cdcdd66f-656e-47af-89d6-62e4e6fbd354 tempest-VolumeQuotasNegativeTestJSON-1248029282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e952ec1f-09ce-4863-bc11-e88e25ea75aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bf6c809-b2a7-4b92-b7e9-3277c58c90a1', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:55:17 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-cdcdd66f-656e-47af-89d6-62e4e6fbd354 tempest-VolumeQuotasNegativeTestJSON-1248029282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a65e543a-9475-4765-b325-7acb7ef4f749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:55:17 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-cdcdd66f-656e-47af-89d6-62e4e6fbd354 tempest-VolumeQuotasNegativeTestJSON-1248029282 None] Volume volume-2bf6c809-b2a7-4b92-b7e9-3277c58c90a1 (2bf6c809-b2a7-4b92-b7e9-3277c58c90a1): created successfully Sep 04 17:55:17 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-cdcdd66f-656e-47af-89d6-62e4e6fbd354 tempest-VolumeQuotasNegativeTestJSON-1248029282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a65e543a-9475-4765-b325-7acb7ef4f749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:55:17 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-cdcdd66f-656e-47af-89d6-62e4e6fbd354 tempest-VolumeQuotasNegativeTestJSON-1248029282 None] Flow 'volume_create_manager' (510ef362-3ba5-4418-b532-b4bf251b5001) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:55:17 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-cdcdd66f-656e-47af-89d6-62e4e6fbd354 tempest-VolumeQuotasNegativeTestJSON-1248029282 None] Created volume successfully. Sep 04 17:55:17 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-17b68fc4-2dda-4e7a-8dd3-6e897c2ae30a tempest-CreateVolumesFromSnapshotTest-225056910 None] Acquiring lock "cinder-808a549e-0d43-4e01-a6f8-8e1b420ec0fa-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:55:17 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-17b68fc4-2dda-4e7a-8dd3-6e897c2ae30a tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "cinder-808a549e-0d43-4e01-a6f8-8e1b420ec0fa-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:55:17 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-17b68fc4-2dda-4e7a-8dd3-6e897c2ae30a tempest-CreateVolumesFromSnapshotTest-225056910 None] Acquiring lock "cinder-quobyte-808a549e-0d43-4e01-a6f8-8e1b420ec0fa" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:55:18 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-17b68fc4-2dda-4e7a-8dd3-6e897c2ae30a tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "cinder-quobyte-808a549e-0d43-4e01-a6f8-8e1b420ec0fa" acquired by "delete_volume" :: waited 0.018s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:55:18 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7d1ca9-7f4a-4634-aef7-e77a460aa5b8]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:55:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-17b68fc4-2dda-4e7a-8dd3-6e897c2ae30a tempest-CreateVolumesFromSnapshotTest-225056910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-808a549e-0d43-4e01-a6f8-8e1b420ec0fa {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:18 devstack sudo[96073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-808a549e-0d43-4e01-a6f8-8e1b420ec0fa Sep 04 17:55:18 devstack sudo[96073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:18 devstack sudo[96073]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-17b68fc4-2dda-4e7a-8dd3-6e897c2ae30a tempest-CreateVolumesFromSnapshotTest-225056910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-808a549e-0d43-4e01-a6f8-8e1b420ec0fa" returned: 0 in 0.403s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-17b68fc4-2dda-4e7a-8dd3-6e897c2ae30a tempest-CreateVolumesFromSnapshotTest-225056910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-808a549e-0d43-4e01-a6f8-8e1b420ec0fa {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:18 devstack sudo[96078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-808a549e-0d43-4e01-a6f8-8e1b420ec0fa Sep 04 17:55:18 devstack sudo[96078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:18 devstack sudo[96078]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-17b68fc4-2dda-4e7a-8dd3-6e897c2ae30a tempest-CreateVolumesFromSnapshotTest-225056910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-808a549e-0d43-4e01-a6f8-8e1b420ec0fa" returned: 0 in 0.243s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:18 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-17b68fc4-2dda-4e7a-8dd3-6e897c2ae30a tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "cinder-quobyte-808a549e-0d43-4e01-a6f8-8e1b420ec0fa" released by "delete_volume" :: held 0.685s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:55:18 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-17b68fc4-2dda-4e7a-8dd3-6e897c2ae30a tempest-CreateVolumesFromSnapshotTest-225056910 None] Created reservations ['f0ea0466-b542-46d0-baf1-b98bb599b389', '6ef462ba-e46b-408b-91ca-aa8e4b9b6e35', '630bc3f7-08cd-49a7-89d4-58bbbc542c1a', 'ab4c227c-db00-46a4-908b-ddf40cfc3204'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:55:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-17b68fc4-2dda-4e7a-8dd3-6e897c2ae30a tempest-CreateVolumesFromSnapshotTest-225056910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:55:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-17b68fc4-2dda-4e7a-8dd3-6e897c2ae30a tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:55:18 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-17b68fc4-2dda-4e7a-8dd3-6e897c2ae30a tempest-CreateVolumesFromSnapshotTest-225056910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:55:18 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-17b68fc4-2dda-4e7a-8dd3-6e897c2ae30a tempest-CreateVolumesFromSnapshotTest-225056910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:55:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-17b68fc4-2dda-4e7a-8dd3-6e897c2ae30a tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:55:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-17b68fc4-2dda-4e7a-8dd3-6e897c2ae30a tempest-CreateVolumesFromSnapshotTest-225056910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:18 devstack sudo[96081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:55:18 devstack sudo[96081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:19 devstack sudo[96081]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-17b68fc4-2dda-4e7a-8dd3-6e897c2ae30a tempest-CreateVolumesFromSnapshotTest-225056910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.278s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:19 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-17b68fc4-2dda-4e7a-8dd3-6e897c2ae30a tempest-CreateVolumesFromSnapshotTest-225056910 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:55:19 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-17b68fc4-2dda-4e7a-8dd3-6e897c2ae30a tempest-CreateVolumesFromSnapshotTest-225056910 None] Deleted volume successfully. Sep 04 17:55:19 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-17b68fc4-2dda-4e7a-8dd3-6e897c2ae30a tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "cinder-808a549e-0d43-4e01-a6f8-8e1b420ec0fa-delete_volume" released by "delete_volume" :: held 1.183s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:55:19 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7b0b0a0d-1fc7-4909-b3d4-86f154210b31 tempest-CreateVolumesFromSnapshotTest-225056910 None] Acquiring lock "cinder-4026e17c-5eec-4562-adf3-96a3dae56039-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:55:19 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7b0b0a0d-1fc7-4909-b3d4-86f154210b31 tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "cinder-4026e17c-5eec-4562-adf3-96a3dae56039-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:55:19 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7b0b0a0d-1fc7-4909-b3d4-86f154210b31 tempest-CreateVolumesFromSnapshotTest-225056910 None] Acquiring lock "cinder-quobyte-192fd796-9cb5-4d20-9904-face2ab24f31" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:55:19 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7b0b0a0d-1fc7-4909-b3d4-86f154210b31 tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "cinder-quobyte-192fd796-9cb5-4d20-9904-face2ab24f31" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:55:19 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7b0b0a0d-1fc7-4909-b3d4-86f154210b31 tempest-CreateVolumesFromSnapshotTest-225056910 None] Acquiring lock "cinder-quobyte-4026e17c-5eec-4562-adf3-96a3dae56039" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:55:19 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7b0b0a0d-1fc7-4909-b3d4-86f154210b31 tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "cinder-quobyte-4026e17c-5eec-4562-adf3-96a3dae56039" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:55:19 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-7b0b0a0d-1fc7-4909-b3d4-86f154210b31 tempest-CreateVolumesFromSnapshotTest-225056910 None] Deleting offline snapshot 4026e17c-5eec-4562-adf3-96a3dae56039 of volume 192fd796-9cb5-4d20-9904-face2ab24f31 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 17:55:19 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-7b0b0a0d-1fc7-4909-b3d4-86f154210b31 tempest-CreateVolumesFromSnapshotTest-225056910 None] snapshot_file for this snap is: volume-192fd796-9cb5-4d20-9904-face2ab24f31.4026e17c-5eec-4562-adf3-96a3dae56039 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 17:55:19 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c38ac2-5ca8-4264-9657-0b8383e9470d]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:55:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7b0b0a0d-1fc7-4909-b3d4-86f154210b31 tempest-CreateVolumesFromSnapshotTest-225056910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-192fd796-9cb5-4d20-9904-face2ab24f31.4026e17c-5eec-4562-adf3-96a3dae56039 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:19 devstack sudo[96084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-192fd796-9cb5-4d20-9904-face2ab24f31.4026e17c-5eec-4562-adf3-96a3dae56039 Sep 04 17:55:19 devstack sudo[96084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:19 devstack sudo[96084]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7b0b0a0d-1fc7-4909-b3d4-86f154210b31 tempest-CreateVolumesFromSnapshotTest-225056910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-192fd796-9cb5-4d20-9904-face2ab24f31.4026e17c-5eec-4562-adf3-96a3dae56039" returned: 0 in 0.427s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:19 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-7b0b0a0d-1fc7-4909-b3d4-86f154210b31 tempest-CreateVolumesFromSnapshotTest-225056910 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-192fd796-9cb5-4d20-9904-face2ab24f31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 17:55:19 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc01a736-6761-487d-8b5c-2245b9066741]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:55:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7b0b0a0d-1fc7-4909-b3d4-86f154210b31 tempest-CreateVolumesFromSnapshotTest-225056910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-192fd796-9cb5-4d20-9904-face2ab24f31 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:19 devstack sudo[96089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-192fd796-9cb5-4d20-9904-face2ab24f31 Sep 04 17:55:19 devstack sudo[96089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:20 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7b2d5046-57fe-4dd4-9d43-f67006ca9955 tempest-VolumeQuotasNegativeTestJSON-1248029282 None] Acquiring lock "cinder-2bf6c809-b2a7-4b92-b7e9-3277c58c90a1-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:55:20 devstack sudo[96089]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7b0b0a0d-1fc7-4909-b3d4-86f154210b31 tempest-CreateVolumesFromSnapshotTest-225056910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-192fd796-9cb5-4d20-9904-face2ab24f31" returned: 0 in 0.468s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7b0b0a0d-1fc7-4909-b3d4-86f154210b31 tempest-CreateVolumesFromSnapshotTest-225056910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-192fd796-9cb5-4d20-9904-face2ab24f31.4026e17c-5eec-4562-adf3-96a3dae56039 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:20 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7b2d5046-57fe-4dd4-9d43-f67006ca9955 tempest-VolumeQuotasNegativeTestJSON-1248029282 None] Lock "cinder-2bf6c809-b2a7-4b92-b7e9-3277c58c90a1-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:55:20 devstack sudo[96094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-192fd796-9cb5-4d20-9904-face2ab24f31.4026e17c-5eec-4562-adf3-96a3dae56039 Sep 04 17:55:20 devstack sudo[96094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:20 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7b2d5046-57fe-4dd4-9d43-f67006ca9955 tempest-VolumeQuotasNegativeTestJSON-1248029282 None] Acquiring lock "cinder-quobyte-2bf6c809-b2a7-4b92-b7e9-3277c58c90a1" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:55:20 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7b2d5046-57fe-4dd4-9d43-f67006ca9955 tempest-VolumeQuotasNegativeTestJSON-1248029282 None] Lock "cinder-quobyte-2bf6c809-b2a7-4b92-b7e9-3277c58c90a1" acquired by "delete_volume" :: waited 0.021s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:55:20 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[35eb07dd-3418-471f-bd3d-ba6c2be4db0e]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:55:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7b2d5046-57fe-4dd4-9d43-f67006ca9955 tempest-VolumeQuotasNegativeTestJSON-1248029282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2bf6c809-b2a7-4b92-b7e9-3277c58c90a1 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:20 devstack sudo[96096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2bf6c809-b2a7-4b92-b7e9-3277c58c90a1 Sep 04 17:55:20 devstack sudo[96096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:20 devstack sudo[96094]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7b0b0a0d-1fc7-4909-b3d4-86f154210b31 tempest-CreateVolumesFromSnapshotTest-225056910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-192fd796-9cb5-4d20-9904-face2ab24f31.4026e17c-5eec-4562-adf3-96a3dae56039" returned: 0 in 0.383s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7b0b0a0d-1fc7-4909-b3d4-86f154210b31 tempest-CreateVolumesFromSnapshotTest-225056910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-192fd796-9cb5-4d20-9904-face2ab24f31.4026e17c-5eec-4562-adf3-96a3dae56039 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:20 devstack sudo[96101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-192fd796-9cb5-4d20-9904-face2ab24f31.4026e17c-5eec-4562-adf3-96a3dae56039 Sep 04 17:55:20 devstack sudo[96101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:20 devstack sudo[96096]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7b2d5046-57fe-4dd4-9d43-f67006ca9955 tempest-VolumeQuotasNegativeTestJSON-1248029282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2bf6c809-b2a7-4b92-b7e9-3277c58c90a1" returned: 0 in 0.407s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7b2d5046-57fe-4dd4-9d43-f67006ca9955 tempest-VolumeQuotasNegativeTestJSON-1248029282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2bf6c809-b2a7-4b92-b7e9-3277c58c90a1 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:20 devstack sudo[96106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2bf6c809-b2a7-4b92-b7e9-3277c58c90a1 Sep 04 17:55:20 devstack sudo[96106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:20 devstack sudo[96101]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7b0b0a0d-1fc7-4909-b3d4-86f154210b31 tempest-CreateVolumesFromSnapshotTest-225056910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-192fd796-9cb5-4d20-9904-face2ab24f31.4026e17c-5eec-4562-adf3-96a3dae56039" returned: 0 in 0.284s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:20 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7b0b0a0d-1fc7-4909-b3d4-86f154210b31 tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "cinder-quobyte-4026e17c-5eec-4562-adf3-96a3dae56039" released by "_delete_snapshot" :: held 1.687s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:55:20 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7b0b0a0d-1fc7-4909-b3d4-86f154210b31 tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "cinder-quobyte-192fd796-9cb5-4d20-9904-face2ab24f31" released by "delete_snapshot" :: held 1.721s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:55:20 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-7b0b0a0d-1fc7-4909-b3d4-86f154210b31 tempest-CreateVolumesFromSnapshotTest-225056910 None] Created reservations ['24fd70be-9862-4a7a-9125-f1eca771cd33', '95bfa318-4493-4e08-8729-9bdf922df4ab', 'aba973fe-4931-40ff-a35f-373d36a048c9', 'b873586e-f3a6-4404-b178-f39d495255bc'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:55:21 devstack sudo[96106]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7b2d5046-57fe-4dd4-9d43-f67006ca9955 tempest-VolumeQuotasNegativeTestJSON-1248029282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2bf6c809-b2a7-4b92-b7e9-3277c58c90a1" returned: 0 in 0.263s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:21 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7b2d5046-57fe-4dd4-9d43-f67006ca9955 tempest-VolumeQuotasNegativeTestJSON-1248029282 None] Lock "cinder-quobyte-2bf6c809-b2a7-4b92-b7e9-3277c58c90a1" released by "delete_volume" :: held 0.723s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:55:21 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-7b0b0a0d-1fc7-4909-b3d4-86f154210b31 tempest-CreateVolumesFromSnapshotTest-225056910 None] Delete snapshot completed successfully. Sep 04 17:55:21 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7b0b0a0d-1fc7-4909-b3d4-86f154210b31 tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "cinder-4026e17c-5eec-4562-adf3-96a3dae56039-delete_snapshot" released by "delete_snapshot" :: held 1.924s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:55:21 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-7b2d5046-57fe-4dd4-9d43-f67006ca9955 tempest-VolumeQuotasNegativeTestJSON-1248029282 None] Created reservations ['103f11f7-d347-4761-a97d-91fa84d82aec', 'c82233aa-dfbb-4e80-a000-1de0acfb31ae', 'b2f8cba9-80b5-4360-a81d-90d6f6f89158', '1aeeac03-41d8-40dc-a82a-7b9f6e39d7a0'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:55:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7b2d5046-57fe-4dd4-9d43-f67006ca9955 tempest-VolumeQuotasNegativeTestJSON-1248029282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:55:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7b2d5046-57fe-4dd4-9d43-f67006ca9955 tempest-VolumeQuotasNegativeTestJSON-1248029282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:55:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7b2d5046-57fe-4dd4-9d43-f67006ca9955 tempest-VolumeQuotasNegativeTestJSON-1248029282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:55:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7b2d5046-57fe-4dd4-9d43-f67006ca9955 tempest-VolumeQuotasNegativeTestJSON-1248029282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:55:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7b2d5046-57fe-4dd4-9d43-f67006ca9955 tempest-VolumeQuotasNegativeTestJSON-1248029282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:55:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7b2d5046-57fe-4dd4-9d43-f67006ca9955 tempest-VolumeQuotasNegativeTestJSON-1248029282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:21 devstack sudo[96110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:55:21 devstack sudo[96110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:21 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 17:55:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:55:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:55:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:55:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:55:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:55:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:21 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b49db44c-adb2-42bb-93e3-5af3930589c9 tempest-CreateVolumesFromSnapshotTest-225056910 None] Acquiring lock "cinder-192fd796-9cb5-4d20-9904-face2ab24f31-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:55:21 devstack sudo[96112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:55:21 devstack sudo[96112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:21 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b49db44c-adb2-42bb-93e3-5af3930589c9 tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "cinder-192fd796-9cb5-4d20-9904-face2ab24f31-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:55:21 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b49db44c-adb2-42bb-93e3-5af3930589c9 tempest-CreateVolumesFromSnapshotTest-225056910 None] Acquiring lock "cinder-quobyte-192fd796-9cb5-4d20-9904-face2ab24f31" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:55:21 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b49db44c-adb2-42bb-93e3-5af3930589c9 tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "cinder-quobyte-192fd796-9cb5-4d20-9904-face2ab24f31" acquired by "delete_volume" :: waited 0.056s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:55:21 devstack sudo[96110]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7b2d5046-57fe-4dd4-9d43-f67006ca9955 tempest-VolumeQuotasNegativeTestJSON-1248029282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.461s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:21 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-7b2d5046-57fe-4dd4-9d43-f67006ca9955 tempest-VolumeQuotasNegativeTestJSON-1248029282 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:55:21 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-7b2d5046-57fe-4dd4-9d43-f67006ca9955 tempest-VolumeQuotasNegativeTestJSON-1248029282 None] Deleted volume successfully. Sep 04 17:55:21 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dfae22a-0de8-4bbb-9b11-862adaf88740]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:55:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b49db44c-adb2-42bb-93e3-5af3930589c9 tempest-CreateVolumesFromSnapshotTest-225056910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-192fd796-9cb5-4d20-9904-face2ab24f31 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:21 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7b2d5046-57fe-4dd4-9d43-f67006ca9955 tempest-VolumeQuotasNegativeTestJSON-1248029282 None] Lock "cinder-2bf6c809-b2a7-4b92-b7e9-3277c58c90a1-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:55:21 devstack sudo[96112]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.391s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:21 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:55:21 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running periodic task VolumeManager._thread_info {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 17:55:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] thread count: 28 {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 17:55:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] thread info: [<_MainThread(MainThread, started 139900377723008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 17:55:21 devstack sudo[96116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-192fd796-9cb5-4d20-9904-face2ab24f31 Sep 04 17:55:21 devstack sudo[96116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:22 devstack sudo[96116]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b49db44c-adb2-42bb-93e3-5af3930589c9 tempest-CreateVolumesFromSnapshotTest-225056910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-192fd796-9cb5-4d20-9904-face2ab24f31" returned: 0 in 0.419s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b49db44c-adb2-42bb-93e3-5af3930589c9 tempest-CreateVolumesFromSnapshotTest-225056910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-192fd796-9cb5-4d20-9904-face2ab24f31 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:22 devstack sudo[96121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-192fd796-9cb5-4d20-9904-face2ab24f31 Sep 04 17:55:22 devstack sudo[96121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:22 devstack sudo[96121]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b49db44c-adb2-42bb-93e3-5af3930589c9 tempest-CreateVolumesFromSnapshotTest-225056910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-192fd796-9cb5-4d20-9904-face2ab24f31" returned: 0 in 0.359s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:22 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b49db44c-adb2-42bb-93e3-5af3930589c9 tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "cinder-quobyte-192fd796-9cb5-4d20-9904-face2ab24f31" released by "delete_volume" :: held 0.884s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:55:22 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-b49db44c-adb2-42bb-93e3-5af3930589c9 tempest-CreateVolumesFromSnapshotTest-225056910 None] Created reservations ['052efd67-ed8e-489b-9c58-d3ad84438b19', '194b79f7-f187-4aa7-9735-21b2e8d6e858', '5b4b3f8a-94c6-46ca-b1fe-ac48de9dc69e', '1b92b761-bd1d-40c7-a9b8-b2d32534748e'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:55:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b49db44c-adb2-42bb-93e3-5af3930589c9 tempest-CreateVolumesFromSnapshotTest-225056910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:55:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b49db44c-adb2-42bb-93e3-5af3930589c9 tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:55:22 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b49db44c-adb2-42bb-93e3-5af3930589c9 tempest-CreateVolumesFromSnapshotTest-225056910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:55:22 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b49db44c-adb2-42bb-93e3-5af3930589c9 tempest-CreateVolumesFromSnapshotTest-225056910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:55:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b49db44c-adb2-42bb-93e3-5af3930589c9 tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:55:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b49db44c-adb2-42bb-93e3-5af3930589c9 tempest-CreateVolumesFromSnapshotTest-225056910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:22 devstack sudo[96228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:55:22 devstack sudo[96228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:22 devstack sudo[96228]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b49db44c-adb2-42bb-93e3-5af3930589c9 tempest-CreateVolumesFromSnapshotTest-225056910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.283s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:22 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-b49db44c-adb2-42bb-93e3-5af3930589c9 tempest-CreateVolumesFromSnapshotTest-225056910 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:55:22 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-b49db44c-adb2-42bb-93e3-5af3930589c9 tempest-CreateVolumesFromSnapshotTest-225056910 None] Deleted volume successfully. Sep 04 17:55:22 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b49db44c-adb2-42bb-93e3-5af3930589c9 tempest-CreateVolumesFromSnapshotTest-225056910 None] Lock "cinder-192fd796-9cb5-4d20-9904-face2ab24f31-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:55:27 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-8920a4d1-b6c0-4c5c-9030-5aefda552825 tempest-CinderUnicodeTest-1484418034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:55:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8920a4d1-b6c0-4c5c-9030-5aefda552825 tempest-CinderUnicodeTest-1484418034 None] Flow 'volume_create_manager' (daf8a4af-a213-49ef-9e26-81a8efd39179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:55:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8920a4d1-b6c0-4c5c-9030-5aefda552825 tempest-CinderUnicodeTest-1484418034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c4f9c1b-d7e2-4a8b-9088-1927e56dbb29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:55:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8920a4d1-b6c0-4c5c-9030-5aefda552825 tempest-CinderUnicodeTest-1484418034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c4f9c1b-d7e2-4a8b-9088-1927e56dbb29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:55:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f74c904-a422-4697-97c8-bf5feb95190b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='780c1b0e56ce40c6b03d023592a71a19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:55:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:55:27Z,use_quota=True,user_id='195d9735990743899b82d947467be366',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:55:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8920a4d1-b6c0-4c5c-9030-5aefda552825 tempest-CinderUnicodeTest-1484418034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d48e986-0190-4d52-af96-0bdca5d690c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:55:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8920a4d1-b6c0-4c5c-9030-5aefda552825 tempest-CinderUnicodeTest-1484418034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d48e986-0190-4d52-af96-0bdca5d690c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:55:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8920a4d1-b6c0-4c5c-9030-5aefda552825 tempest-CinderUnicodeTest-1484418034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0398d66c-11ab-424f-bf1b-a7e37c1856d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:55:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8920a4d1-b6c0-4c5c-9030-5aefda552825 tempest-CinderUnicodeTest-1484418034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0398d66c-11ab-424f-bf1b-a7e37c1856d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f74c904-a422-4697-97c8-bf5feb95190b', 'volume_name': 'volume-4f74c904-a422-4697-97c8-bf5feb95190b', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:55:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8920a4d1-b6c0-4c5c-9030-5aefda552825 tempest-CinderUnicodeTest-1484418034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0952a217-edc7-4ddd-ba96-6f83501c2eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:55:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8920a4d1-b6c0-4c5c-9030-5aefda552825 tempest-CinderUnicodeTest-1484418034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0952a217-edc7-4ddd-ba96-6f83501c2eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:55:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8920a4d1-b6c0-4c5c-9030-5aefda552825 tempest-CinderUnicodeTest-1484418034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3c5d7f5-728e-4ca1-81f5-da5e9898910a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:55:27 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-8920a4d1-b6c0-4c5c-9030-5aefda552825 tempest-CinderUnicodeTest-1484418034 None] Volume 4f74c904-a422-4697-97c8-bf5feb95190b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f74c904-a422-4697-97c8-bf5feb95190b', 'volume_size': 1} Sep 04 17:55:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8920a4d1-b6c0-4c5c-9030-5aefda552825 tempest-CinderUnicodeTest-1484418034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:55:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8920a4d1-b6c0-4c5c-9030-5aefda552825 tempest-CinderUnicodeTest-1484418034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:55:27 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8920a4d1-b6c0-4c5c-9030-5aefda552825 tempest-CinderUnicodeTest-1484418034 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:55:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f74c904-a422-4697-97c8-bf5feb95190b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='780c1b0e56ce40c6b03d023592a71a19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:55:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:55:27Z,use_quota=True,user_id='195d9735990743899b82d947467be366',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:55:27 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-8920a4d1-b6c0-4c5c-9030-5aefda552825 tempest-CinderUnicodeTest-1484418034 None] Creating volume 4f74c904-a422-4697-97c8-bf5feb95190b {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:55:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8920a4d1-b6c0-4c5c-9030-5aefda552825 tempest-CinderUnicodeTest-1484418034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:55:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8920a4d1-b6c0-4c5c-9030-5aefda552825 tempest-CinderUnicodeTest-1484418034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:55:27 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8920a4d1-b6c0-4c5c-9030-5aefda552825 tempest-CinderUnicodeTest-1484418034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:55:27 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8920a4d1-b6c0-4c5c-9030-5aefda552825 tempest-CinderUnicodeTest-1484418034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:55:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8920a4d1-b6c0-4c5c-9030-5aefda552825 tempest-CinderUnicodeTest-1484418034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:55:27 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8920a4d1-b6c0-4c5c-9030-5aefda552825 tempest-CinderUnicodeTest-1484418034 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:55:27 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-8920a4d1-b6c0-4c5c-9030-5aefda552825 tempest-CinderUnicodeTest-1484418034 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:55:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8920a4d1-b6c0-4c5c-9030-5aefda552825 tempest-CinderUnicodeTest-1484418034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4f74c904-a422-4697-97c8-bf5feb95190b 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:27 devstack sudo[96260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4f74c904-a422-4697-97c8-bf5feb95190b 1073741824 Sep 04 17:55:27 devstack sudo[96260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:27 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-14fa48ef-1d3b-4e14-a404-a8d717f47c7d tempest-VolumesServicesTestJSON-1230447884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:55:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-14fa48ef-1d3b-4e14-a404-a8d717f47c7d tempest-VolumesServicesTestJSON-1230447884 None] Flow 'volume_create_manager' (5ecf1e5d-0fb1-4531-a99f-654acc7f34f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:55:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-14fa48ef-1d3b-4e14-a404-a8d717f47c7d tempest-VolumesServicesTestJSON-1230447884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc42ab2e-1382-4972-8de6-b0e160fa30fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:55:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-14fa48ef-1d3b-4e14-a404-a8d717f47c7d tempest-VolumesServicesTestJSON-1230447884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc42ab2e-1382-4972-8de6-b0e160fa30fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:55:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1546316457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf2cc376-4756-476a-accc-9b32a22f6cf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1931283cdc8c4847af0267a58ed481ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:55:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:55:27Z,use_quota=True,user_id='955b5bf9e12346ed8dae396e81a30a88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:55:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-14fa48ef-1d3b-4e14-a404-a8d717f47c7d tempest-VolumesServicesTestJSON-1230447884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85d190cc-0eae-4c10-8f10-85e3f237e639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:55:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-14fa48ef-1d3b-4e14-a404-a8d717f47c7d tempest-VolumesServicesTestJSON-1230447884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85d190cc-0eae-4c10-8f10-85e3f237e639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:55:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-14fa48ef-1d3b-4e14-a404-a8d717f47c7d tempest-VolumesServicesTestJSON-1230447884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d43da216-bd1c-42a0-8d8a-8a92fc16f925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:55:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-14fa48ef-1d3b-4e14-a404-a8d717f47c7d tempest-VolumesServicesTestJSON-1230447884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d43da216-bd1c-42a0-8d8a-8a92fc16f925) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf2cc376-4756-476a-accc-9b32a22f6cf6', 'volume_name': 'volume-bf2cc376-4756-476a-accc-9b32a22f6cf6', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:55:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-14fa48ef-1d3b-4e14-a404-a8d717f47c7d tempest-VolumesServicesTestJSON-1230447884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1cb31a8-0da4-4368-921b-20b4f085d898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:55:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-14fa48ef-1d3b-4e14-a404-a8d717f47c7d tempest-VolumesServicesTestJSON-1230447884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1cb31a8-0da4-4368-921b-20b4f085d898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:55:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-14fa48ef-1d3b-4e14-a404-a8d717f47c7d tempest-VolumesServicesTestJSON-1230447884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df5e4d67-9de3-4bde-8aac-0bfd0b363108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:55:27 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-14fa48ef-1d3b-4e14-a404-a8d717f47c7d tempest-VolumesServicesTestJSON-1230447884 None] Volume bf2cc376-4756-476a-accc-9b32a22f6cf6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf2cc376-4756-476a-accc-9b32a22f6cf6', 'volume_size': 1} Sep 04 17:55:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-14fa48ef-1d3b-4e14-a404-a8d717f47c7d tempest-VolumesServicesTestJSON-1230447884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:55:27 devstack sudo[96260]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8920a4d1-b6c0-4c5c-9030-5aefda552825 tempest-CinderUnicodeTest-1484418034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4f74c904-a422-4697-97c8-bf5feb95190b 1073741824" returned: 0 in 0.551s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8920a4d1-b6c0-4c5c-9030-5aefda552825 tempest-CinderUnicodeTest-1484418034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4f74c904-a422-4697-97c8-bf5feb95190b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:27 devstack sudo[96267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4f74c904-a422-4697-97c8-bf5feb95190b Sep 04 17:55:27 devstack sudo[96267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:28 devstack sudo[96267]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8920a4d1-b6c0-4c5c-9030-5aefda552825 tempest-CinderUnicodeTest-1484418034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4f74c904-a422-4697-97c8-bf5feb95190b" returned: 0 in 0.265s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:28 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8920a4d1-b6c0-4c5c-9030-5aefda552825 tempest-CinderUnicodeTest-1484418034 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:55:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8920a4d1-b6c0-4c5c-9030-5aefda552825 tempest-CinderUnicodeTest-1484418034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:55:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-14fa48ef-1d3b-4e14-a404-a8d717f47c7d tempest-VolumesServicesTestJSON-1230447884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.510s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:55:28 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-14fa48ef-1d3b-4e14-a404-a8d717f47c7d tempest-VolumesServicesTestJSON-1230447884 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:55:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1546316457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf2cc376-4756-476a-accc-9b32a22f6cf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1931283cdc8c4847af0267a58ed481ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:55:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:55:27Z,use_quota=True,user_id='955b5bf9e12346ed8dae396e81a30a88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:55:28 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-14fa48ef-1d3b-4e14-a404-a8d717f47c7d tempest-VolumesServicesTestJSON-1230447884 None] Creating volume bf2cc376-4756-476a-accc-9b32a22f6cf6 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:55:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-14fa48ef-1d3b-4e14-a404-a8d717f47c7d tempest-VolumesServicesTestJSON-1230447884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:55:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-14fa48ef-1d3b-4e14-a404-a8d717f47c7d tempest-VolumesServicesTestJSON-1230447884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:55:28 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-14fa48ef-1d3b-4e14-a404-a8d717f47c7d tempest-VolumesServicesTestJSON-1230447884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:55:28 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-14fa48ef-1d3b-4e14-a404-a8d717f47c7d tempest-VolumesServicesTestJSON-1230447884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:55:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-14fa48ef-1d3b-4e14-a404-a8d717f47c7d tempest-VolumesServicesTestJSON-1230447884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:55:28 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-14fa48ef-1d3b-4e14-a404-a8d717f47c7d tempest-VolumesServicesTestJSON-1230447884 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:55:28 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-14fa48ef-1d3b-4e14-a404-a8d717f47c7d tempest-VolumesServicesTestJSON-1230447884 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:55:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-14fa48ef-1d3b-4e14-a404-a8d717f47c7d tempest-VolumesServicesTestJSON-1230447884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-bf2cc376-4756-476a-accc-9b32a22f6cf6 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8920a4d1-b6c0-4c5c-9030-5aefda552825 tempest-CinderUnicodeTest-1484418034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3c5d7f5-728e-4ca1-81f5-da5e9898910a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f74c904-a422-4697-97c8-bf5feb95190b', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:55:28 devstack sudo[96271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-bf2cc376-4756-476a-accc-9b32a22f6cf6 1073741824 Sep 04 17:55:28 devstack sudo[96271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8920a4d1-b6c0-4c5c-9030-5aefda552825 tempest-CinderUnicodeTest-1484418034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d580cd85-19e7-4f6f-a7b3-455a07438237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:55:28 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-8920a4d1-b6c0-4c5c-9030-5aefda552825 tempest-CinderUnicodeTest-1484418034 None] Volume volume-4f74c904-a422-4697-97c8-bf5feb95190b (4f74c904-a422-4697-97c8-bf5feb95190b): created successfully Sep 04 17:55:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8920a4d1-b6c0-4c5c-9030-5aefda552825 tempest-CinderUnicodeTest-1484418034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d580cd85-19e7-4f6f-a7b3-455a07438237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:55:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8920a4d1-b6c0-4c5c-9030-5aefda552825 tempest-CinderUnicodeTest-1484418034 None] Flow 'volume_create_manager' (daf8a4af-a213-49ef-9e26-81a8efd39179) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:55:28 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-8920a4d1-b6c0-4c5c-9030-5aefda552825 tempest-CinderUnicodeTest-1484418034 None] Created volume successfully. Sep 04 17:55:28 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-39049295-f3d4-415f-b749-c78c4045b20c req-c6caaac7-3d31-4b10-8e99-4792e72cb9d2 tempest-ServerActionsTestOtherA-1015930920 None] Terminate volume connection completed successfully. Sep 04 17:55:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-39049295-f3d4-415f-b749-c78c4045b20c req-c6caaac7-3d31-4b10-8e99-4792e72cb9d2 tempest-ServerActionsTestOtherA-1015930920 None] Deleting attachment 7bd550bc-6c61-4c57-aebd-5cb79198b0d0. {{(pid=87314) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 17:55:28 devstack sudo[96271]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-14fa48ef-1d3b-4e14-a404-a8d717f47c7d tempest-VolumesServicesTestJSON-1230447884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-bf2cc376-4756-476a-accc-9b32a22f6cf6 1073741824" returned: 0 in 0.521s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:28 devstack cinder-volume[87314]: DEBUG cinder.coordination [req-39049295-f3d4-415f-b749-c78c4045b20c req-f0b08e1e-3ba1-47d1-aae5-c5334690dc73 tempest-ServerActionsTestOtherA-1015930920 None] Acquiring lock "cinder-fa30b325-b68f-453d-bc16-a72e3ad267cc-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:55:28 devstack cinder-volume[87314]: DEBUG cinder.coordination [req-39049295-f3d4-415f-b749-c78c4045b20c req-f0b08e1e-3ba1-47d1-aae5-c5334690dc73 tempest-ServerActionsTestOtherA-1015930920 None] Lock "cinder-fa30b325-b68f-453d-bc16-a72e3ad267cc-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:55:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-14fa48ef-1d3b-4e14-a404-a8d717f47c7d tempest-VolumesServicesTestJSON-1230447884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-bf2cc376-4756-476a-accc-9b32a22f6cf6 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:28 devstack sudo[96278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-bf2cc376-4756-476a-accc-9b32a22f6cf6 Sep 04 17:55:28 devstack sudo[96278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:28 devstack cinder-volume[87314]: DEBUG cinder.coordination [req-39049295-f3d4-415f-b749-c78c4045b20c req-f0b08e1e-3ba1-47d1-aae5-c5334690dc73 tempest-ServerActionsTestOtherA-1015930920 None] Acquiring lock "cinder-quobyte-fa30b325-b68f-453d-bc16-a72e3ad267cc" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:55:28 devstack cinder-volume[87314]: DEBUG cinder.coordination [req-39049295-f3d4-415f-b749-c78c4045b20c req-f0b08e1e-3ba1-47d1-aae5-c5334690dc73 tempest-ServerActionsTestOtherA-1015930920 None] Lock "cinder-quobyte-fa30b325-b68f-453d-bc16-a72e3ad267cc" acquired by "delete_volume" :: waited 0.013s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:55:28 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e972aa-2672-4d0c-80d2-0a718dd3214e]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:55:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-39049295-f3d4-415f-b749-c78c4045b20c req-f0b08e1e-3ba1-47d1-aae5-c5334690dc73 tempest-ServerActionsTestOtherA-1015930920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-fa30b325-b68f-453d-bc16-a72e3ad267cc {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:28 devstack sudo[96280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-fa30b325-b68f-453d-bc16-a72e3ad267cc Sep 04 17:55:28 devstack sudo[96280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:28 devstack sudo[96278]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-14fa48ef-1d3b-4e14-a404-a8d717f47c7d tempest-VolumesServicesTestJSON-1230447884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-bf2cc376-4756-476a-accc-9b32a22f6cf6" returned: 0 in 0.310s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:28 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-14fa48ef-1d3b-4e14-a404-a8d717f47c7d tempest-VolumesServicesTestJSON-1230447884 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:55:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-14fa48ef-1d3b-4e14-a404-a8d717f47c7d tempest-VolumesServicesTestJSON-1230447884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:55:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-14fa48ef-1d3b-4e14-a404-a8d717f47c7d tempest-VolumesServicesTestJSON-1230447884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df5e4d67-9de3-4bde-8aac-0bfd0b363108) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf2cc376-4756-476a-accc-9b32a22f6cf6', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:55:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-14fa48ef-1d3b-4e14-a404-a8d717f47c7d tempest-VolumesServicesTestJSON-1230447884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75967af5-cf33-41b2-8117-344b105534cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:55:29 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-14fa48ef-1d3b-4e14-a404-a8d717f47c7d tempest-VolumesServicesTestJSON-1230447884 None] Volume volume-bf2cc376-4756-476a-accc-9b32a22f6cf6 (bf2cc376-4756-476a-accc-9b32a22f6cf6): created successfully Sep 04 17:55:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-14fa48ef-1d3b-4e14-a404-a8d717f47c7d tempest-VolumesServicesTestJSON-1230447884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75967af5-cf33-41b2-8117-344b105534cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:55:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-14fa48ef-1d3b-4e14-a404-a8d717f47c7d tempest-VolumesServicesTestJSON-1230447884 None] Flow 'volume_create_manager' (5ecf1e5d-0fb1-4531-a99f-654acc7f34f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:55:29 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-14fa48ef-1d3b-4e14-a404-a8d717f47c7d tempest-VolumesServicesTestJSON-1230447884 None] Created volume successfully. Sep 04 17:55:29 devstack sudo[96280]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-39049295-f3d4-415f-b749-c78c4045b20c req-f0b08e1e-3ba1-47d1-aae5-c5334690dc73 tempest-ServerActionsTestOtherA-1015930920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-fa30b325-b68f-453d-bc16-a72e3ad267cc" returned: 0 in 0.444s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-39049295-f3d4-415f-b749-c78c4045b20c req-f0b08e1e-3ba1-47d1-aae5-c5334690dc73 tempest-ServerActionsTestOtherA-1015930920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-fa30b325-b68f-453d-bc16-a72e3ad267cc {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:29 devstack sudo[96286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-fa30b325-b68f-453d-bc16-a72e3ad267cc Sep 04 17:55:29 devstack sudo[96286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:29 devstack sudo[96286]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-39049295-f3d4-415f-b749-c78c4045b20c req-f0b08e1e-3ba1-47d1-aae5-c5334690dc73 tempest-ServerActionsTestOtherA-1015930920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-fa30b325-b68f-453d-bc16-a72e3ad267cc" returned: 0 in 0.337s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:29 devstack cinder-volume[87314]: DEBUG cinder.coordination [req-39049295-f3d4-415f-b749-c78c4045b20c req-f0b08e1e-3ba1-47d1-aae5-c5334690dc73 tempest-ServerActionsTestOtherA-1015930920 None] Lock "cinder-quobyte-fa30b325-b68f-453d-bc16-a72e3ad267cc" released by "delete_volume" :: held 0.835s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:55:29 devstack cinder-volume[87314]: DEBUG cinder.quota [req-39049295-f3d4-415f-b749-c78c4045b20c req-f0b08e1e-3ba1-47d1-aae5-c5334690dc73 tempest-ServerActionsTestOtherA-1015930920 None] Created reservations ['aac6a56a-0047-4632-8e7b-d684cd9d168b', 'a843e047-ba91-4018-a611-62fe01d518c3', '5b5a6fe2-336e-4ff4-8619-1c6fd2bea242', 'f3b7577c-1526-4afd-8c1f-b0c21ddef281'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:55:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-39049295-f3d4-415f-b749-c78c4045b20c req-f0b08e1e-3ba1-47d1-aae5-c5334690dc73 tempest-ServerActionsTestOtherA-1015930920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:55:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-39049295-f3d4-415f-b749-c78c4045b20c req-f0b08e1e-3ba1-47d1-aae5-c5334690dc73 tempest-ServerActionsTestOtherA-1015930920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:55:29 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [req-39049295-f3d4-415f-b749-c78c4045b20c req-f0b08e1e-3ba1-47d1-aae5-c5334690dc73 tempest-ServerActionsTestOtherA-1015930920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:55:29 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [req-39049295-f3d4-415f-b749-c78c4045b20c req-f0b08e1e-3ba1-47d1-aae5-c5334690dc73 tempest-ServerActionsTestOtherA-1015930920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:55:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-39049295-f3d4-415f-b749-c78c4045b20c req-f0b08e1e-3ba1-47d1-aae5-c5334690dc73 tempest-ServerActionsTestOtherA-1015930920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:55:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-39049295-f3d4-415f-b749-c78c4045b20c req-f0b08e1e-3ba1-47d1-aae5-c5334690dc73 tempest-ServerActionsTestOtherA-1015930920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:29 devstack sudo[96289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:55:29 devstack sudo[96289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:29 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-d849480d-8d1f-49bd-8135-4cfcd48d1297 tempest-CinderUnicodeTest-1484418034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:55:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d849480d-8d1f-49bd-8135-4cfcd48d1297 tempest-CinderUnicodeTest-1484418034 None] Flow 'volume_create_manager' (65cff3c9-61e8-47d4-9077-c26b74c7f4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:55:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d849480d-8d1f-49bd-8135-4cfcd48d1297 tempest-CinderUnicodeTest-1484418034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acf90f43-86ad-421d-9f17-9874d3da81ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:55:29 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f9f1cda8-b703-4614-bb84-0f1d8da40506 tempest-VolumesServicesTestJSON-1230447884 None] Acquiring lock "cinder-bf2cc376-4756-476a-accc-9b32a22f6cf6-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:55:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d849480d-8d1f-49bd-8135-4cfcd48d1297 tempest-CinderUnicodeTest-1484418034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acf90f43-86ad-421d-9f17-9874d3da81ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:55:29Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1426597307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='780c1b0e56ce40c6b03d023592a71a19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:55:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:55:30Z,use_quota=True,user_id='195d9735990743899b82d947467be366',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:55:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d849480d-8d1f-49bd-8135-4cfcd48d1297 tempest-CinderUnicodeTest-1484418034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dea2ffd5-6924-4c4d-b434-e6a74c1d4c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:55:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d849480d-8d1f-49bd-8135-4cfcd48d1297 tempest-CinderUnicodeTest-1484418034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dea2ffd5-6924-4c4d-b434-e6a74c1d4c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:55:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d849480d-8d1f-49bd-8135-4cfcd48d1297 tempest-CinderUnicodeTest-1484418034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e0e0131-7d77-4fe2-bc69-9c8f4175c117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:55:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d849480d-8d1f-49bd-8135-4cfcd48d1297 tempest-CinderUnicodeTest-1484418034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e0e0131-7d77-4fe2-bc69-9c8f4175c117) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f', 'volume_name': 'volume-d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:55:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d849480d-8d1f-49bd-8135-4cfcd48d1297 tempest-CinderUnicodeTest-1484418034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a7f3942-0cbc-4a9b-b830-1173d4a741c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:55:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d849480d-8d1f-49bd-8135-4cfcd48d1297 tempest-CinderUnicodeTest-1484418034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a7f3942-0cbc-4a9b-b830-1173d4a741c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:55:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d849480d-8d1f-49bd-8135-4cfcd48d1297 tempest-CinderUnicodeTest-1484418034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2e3b570-cf93-46f2-8b8c-7973a5bf99f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:55:29 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-d849480d-8d1f-49bd-8135-4cfcd48d1297 tempest-CinderUnicodeTest-1484418034 None] Volume d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f', 'volume_size': 1} Sep 04 17:55:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d849480d-8d1f-49bd-8135-4cfcd48d1297 tempest-CinderUnicodeTest-1484418034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:55:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d849480d-8d1f-49bd-8135-4cfcd48d1297 tempest-CinderUnicodeTest-1484418034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:55:29 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d849480d-8d1f-49bd-8135-4cfcd48d1297 tempest-CinderUnicodeTest-1484418034 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:55:29Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1426597307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='780c1b0e56ce40c6b03d023592a71a19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:55:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:55:30Z,use_quota=True,user_id='195d9735990743899b82d947467be366',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:55:29 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-d849480d-8d1f-49bd-8135-4cfcd48d1297 tempest-CinderUnicodeTest-1484418034 None] Creating volume d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:55:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d849480d-8d1f-49bd-8135-4cfcd48d1297 tempest-CinderUnicodeTest-1484418034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:55:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d849480d-8d1f-49bd-8135-4cfcd48d1297 tempest-CinderUnicodeTest-1484418034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:55:29 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d849480d-8d1f-49bd-8135-4cfcd48d1297 tempest-CinderUnicodeTest-1484418034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:55:29 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d849480d-8d1f-49bd-8135-4cfcd48d1297 tempest-CinderUnicodeTest-1484418034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:55:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d849480d-8d1f-49bd-8135-4cfcd48d1297 tempest-CinderUnicodeTest-1484418034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:55:29 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d849480d-8d1f-49bd-8135-4cfcd48d1297 tempest-CinderUnicodeTest-1484418034 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:55:29 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-d849480d-8d1f-49bd-8135-4cfcd48d1297 tempest-CinderUnicodeTest-1484418034 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:55:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d849480d-8d1f-49bd-8135-4cfcd48d1297 tempest-CinderUnicodeTest-1484418034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:29 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f9f1cda8-b703-4614-bb84-0f1d8da40506 tempest-VolumesServicesTestJSON-1230447884 None] Lock "cinder-bf2cc376-4756-476a-accc-9b32a22f6cf6-delete_volume" acquired by "delete_volume" :: waited 0.097s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:55:29 devstack sudo[96291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f 1073741824 Sep 04 17:55:29 devstack sudo[96291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:29 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f9f1cda8-b703-4614-bb84-0f1d8da40506 tempest-VolumesServicesTestJSON-1230447884 None] Acquiring lock "cinder-quobyte-bf2cc376-4756-476a-accc-9b32a22f6cf6" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:55:29 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f9f1cda8-b703-4614-bb84-0f1d8da40506 tempest-VolumesServicesTestJSON-1230447884 None] Lock "cinder-quobyte-bf2cc376-4756-476a-accc-9b32a22f6cf6" acquired by "delete_volume" :: waited 0.019s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:55:29 devstack sudo[96289]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-39049295-f3d4-415f-b749-c78c4045b20c req-f0b08e1e-3ba1-47d1-aae5-c5334690dc73 tempest-ServerActionsTestOtherA-1015930920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.269s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:29 devstack cinder-volume[87314]: DEBUG cinder.manager [req-39049295-f3d4-415f-b749-c78c4045b20c req-f0b08e1e-3ba1-47d1-aae5-c5334690dc73 tempest-ServerActionsTestOtherA-1015930920 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:55:29 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e52d185-6710-4afe-8623-10d8fbbfa469]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:55:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f9f1cda8-b703-4614-bb84-0f1d8da40506 tempest-VolumesServicesTestJSON-1230447884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-bf2cc376-4756-476a-accc-9b32a22f6cf6 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:30 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-39049295-f3d4-415f-b749-c78c4045b20c req-f0b08e1e-3ba1-47d1-aae5-c5334690dc73 tempest-ServerActionsTestOtherA-1015930920 None] Deleted volume successfully. Sep 04 17:55:30 devstack cinder-volume[87314]: DEBUG cinder.coordination [req-39049295-f3d4-415f-b749-c78c4045b20c req-f0b08e1e-3ba1-47d1-aae5-c5334690dc73 tempest-ServerActionsTestOtherA-1015930920 None] Lock "cinder-fa30b325-b68f-453d-bc16-a72e3ad267cc-delete_volume" released by "delete_volume" :: held 1.397s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:55:30 devstack sudo[96294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-bf2cc376-4756-476a-accc-9b32a22f6cf6 Sep 04 17:55:30 devstack sudo[96294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:30 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-70a49be9-bf4d-415b-8659-1e8e67e4cc38 tempest-ServerActionsTestOtherA-1015930920 None] Acquiring lock "cinder-c4140bdd-ea08-49d5-90d4-3f5ee64f5ea4-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:55:30 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-70a49be9-bf4d-415b-8659-1e8e67e4cc38 tempest-ServerActionsTestOtherA-1015930920 None] Lock "cinder-c4140bdd-ea08-49d5-90d4-3f5ee64f5ea4-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:55:30 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-70a49be9-bf4d-415b-8659-1e8e67e4cc38 tempest-ServerActionsTestOtherA-1015930920 None] Acquiring lock "cinder-quobyte-c4140bdd-ea08-49d5-90d4-3f5ee64f5ea4" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:55:30 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-70a49be9-bf4d-415b-8659-1e8e67e4cc38 tempest-ServerActionsTestOtherA-1015930920 None] Lock "cinder-quobyte-c4140bdd-ea08-49d5-90d4-3f5ee64f5ea4" acquired by "delete_volume" :: waited 0.018s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:55:30 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44f1942-fc34-4f69-aecd-4d91a68435d4]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:55:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-70a49be9-bf4d-415b-8659-1e8e67e4cc38 tempest-ServerActionsTestOtherA-1015930920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c4140bdd-ea08-49d5-90d4-3f5ee64f5ea4 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:30 devstack sudo[96294]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f9f1cda8-b703-4614-bb84-0f1d8da40506 tempest-VolumesServicesTestJSON-1230447884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-bf2cc376-4756-476a-accc-9b32a22f6cf6" returned: 0 in 0.558s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f9f1cda8-b703-4614-bb84-0f1d8da40506 tempest-VolumesServicesTestJSON-1230447884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-bf2cc376-4756-476a-accc-9b32a22f6cf6 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:30 devstack sudo[96291]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d849480d-8d1f-49bd-8135-4cfcd48d1297 tempest-CinderUnicodeTest-1484418034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f 1073741824" returned: 0 in 0.691s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:30 devstack sudo[96304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-bf2cc376-4756-476a-accc-9b32a22f6cf6 Sep 04 17:55:30 devstack sudo[96304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:30 devstack sudo[96303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c4140bdd-ea08-49d5-90d4-3f5ee64f5ea4 Sep 04 17:55:30 devstack sudo[96303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d849480d-8d1f-49bd-8135-4cfcd48d1297 tempest-CinderUnicodeTest-1484418034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:30 devstack sudo[96307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f Sep 04 17:55:30 devstack sudo[96307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:30 devstack sudo[96304]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f9f1cda8-b703-4614-bb84-0f1d8da40506 tempest-VolumesServicesTestJSON-1230447884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-bf2cc376-4756-476a-accc-9b32a22f6cf6" returned: 0 in 0.326s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:30 devstack sudo[96303]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-70a49be9-bf4d-415b-8659-1e8e67e4cc38 tempest-ServerActionsTestOtherA-1015930920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c4140bdd-ea08-49d5-90d4-3f5ee64f5ea4" returned: 0 in 0.406s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-70a49be9-bf4d-415b-8659-1e8e67e4cc38 tempest-ServerActionsTestOtherA-1015930920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c4140bdd-ea08-49d5-90d4-3f5ee64f5ea4 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:30 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f9f1cda8-b703-4614-bb84-0f1d8da40506 tempest-VolumesServicesTestJSON-1230447884 None] Lock "cinder-quobyte-bf2cc376-4756-476a-accc-9b32a22f6cf6" released by "delete_volume" :: held 0.948s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:55:30 devstack sudo[96314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c4140bdd-ea08-49d5-90d4-3f5ee64f5ea4 Sep 04 17:55:30 devstack sudo[96314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:30 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-f9f1cda8-b703-4614-bb84-0f1d8da40506 tempest-VolumesServicesTestJSON-1230447884 None] Created reservations ['6e685138-cd70-4153-b5cd-87a9d1f8ddd1', '1b47ac17-903a-4cf6-a588-90e44824bab1', 'd1b24918-f239-4ead-8e43-51bb1099b738', '84128d6f-b451-4d8e-a42f-ecb1c3291fac'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:55:30 devstack sudo[96307]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d849480d-8d1f-49bd-8135-4cfcd48d1297 tempest-CinderUnicodeTest-1484418034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f" returned: 0 in 0.346s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:31 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d849480d-8d1f-49bd-8135-4cfcd48d1297 tempest-CinderUnicodeTest-1484418034 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:55:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d849480d-8d1f-49bd-8135-4cfcd48d1297 tempest-CinderUnicodeTest-1484418034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:55:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d849480d-8d1f-49bd-8135-4cfcd48d1297 tempest-CinderUnicodeTest-1484418034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2e3b570-cf93-46f2-8b8c-7973a5bf99f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:55:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d849480d-8d1f-49bd-8135-4cfcd48d1297 tempest-CinderUnicodeTest-1484418034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59a7cb59-1a90-423f-b4b0-809c551bc7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:55:31 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-d849480d-8d1f-49bd-8135-4cfcd48d1297 tempest-CinderUnicodeTest-1484418034 None] Volume volume-d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f (d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f): created successfully Sep 04 17:55:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d849480d-8d1f-49bd-8135-4cfcd48d1297 tempest-CinderUnicodeTest-1484418034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59a7cb59-1a90-423f-b4b0-809c551bc7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:55:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d849480d-8d1f-49bd-8135-4cfcd48d1297 tempest-CinderUnicodeTest-1484418034 None] Flow 'volume_create_manager' (65cff3c9-61e8-47d4-9077-c26b74c7f4d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:55:31 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-d849480d-8d1f-49bd-8135-4cfcd48d1297 tempest-CinderUnicodeTest-1484418034 None] Created volume successfully. Sep 04 17:55:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f9f1cda8-b703-4614-bb84-0f1d8da40506 tempest-VolumesServicesTestJSON-1230447884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:55:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f9f1cda8-b703-4614-bb84-0f1d8da40506 tempest-VolumesServicesTestJSON-1230447884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:55:31 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f9f1cda8-b703-4614-bb84-0f1d8da40506 tempest-VolumesServicesTestJSON-1230447884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:55:31 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f9f1cda8-b703-4614-bb84-0f1d8da40506 tempest-VolumesServicesTestJSON-1230447884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:55:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f9f1cda8-b703-4614-bb84-0f1d8da40506 tempest-VolumesServicesTestJSON-1230447884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:55:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f9f1cda8-b703-4614-bb84-0f1d8da40506 tempest-VolumesServicesTestJSON-1230447884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:31 devstack sudo[96317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:55:31 devstack sudo[96317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:31 devstack sudo[96314]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-70a49be9-bf4d-415b-8659-1e8e67e4cc38 tempest-ServerActionsTestOtherA-1015930920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c4140bdd-ea08-49d5-90d4-3f5ee64f5ea4" returned: 0 in 0.288s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:31 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-70a49be9-bf4d-415b-8659-1e8e67e4cc38 tempest-ServerActionsTestOtherA-1015930920 None] Lock "cinder-quobyte-c4140bdd-ea08-49d5-90d4-3f5ee64f5ea4" released by "delete_volume" :: held 0.748s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:55:31 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-70a49be9-bf4d-415b-8659-1e8e67e4cc38 tempest-ServerActionsTestOtherA-1015930920 None] Created reservations ['81b8ff3a-ae61-47f9-b76d-9c46aecaab11', 'a50911fe-ef90-433e-bf44-4332a9e31b36', 'b167d5d2-8d6b-432b-9efd-a1a512c5f658', 'a88c538a-7a1a-4f1b-8d22-65ed4763844f'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:55:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-70a49be9-bf4d-415b-8659-1e8e67e4cc38 tempest-ServerActionsTestOtherA-1015930920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:55:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-70a49be9-bf4d-415b-8659-1e8e67e4cc38 tempest-ServerActionsTestOtherA-1015930920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:55:31 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-70a49be9-bf4d-415b-8659-1e8e67e4cc38 tempest-ServerActionsTestOtherA-1015930920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:55:31 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-70a49be9-bf4d-415b-8659-1e8e67e4cc38 tempest-ServerActionsTestOtherA-1015930920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:55:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-70a49be9-bf4d-415b-8659-1e8e67e4cc38 tempest-ServerActionsTestOtherA-1015930920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:55:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-70a49be9-bf4d-415b-8659-1e8e67e4cc38 tempest-ServerActionsTestOtherA-1015930920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:31 devstack sudo[96320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:55:31 devstack sudo[96320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:31 devstack sudo[96317]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f9f1cda8-b703-4614-bb84-0f1d8da40506 tempest-VolumesServicesTestJSON-1230447884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.266s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:31 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-f9f1cda8-b703-4614-bb84-0f1d8da40506 tempest-VolumesServicesTestJSON-1230447884 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:55:31 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-f9f1cda8-b703-4614-bb84-0f1d8da40506 tempest-VolumesServicesTestJSON-1230447884 None] Deleted volume successfully. Sep 04 17:55:31 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f9f1cda8-b703-4614-bb84-0f1d8da40506 tempest-VolumesServicesTestJSON-1230447884 None] Lock "cinder-bf2cc376-4756-476a-accc-9b32a22f6cf6-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:55:31 devstack sudo[96320]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-70a49be9-bf4d-415b-8659-1e8e67e4cc38 tempest-ServerActionsTestOtherA-1015930920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.268s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:31 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-70a49be9-bf4d-415b-8659-1e8e67e4cc38 tempest-ServerActionsTestOtherA-1015930920 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:55:31 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-70a49be9-bf4d-415b-8659-1e8e67e4cc38 tempest-ServerActionsTestOtherA-1015930920 None] Deleted volume successfully. Sep 04 17:55:31 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-70a49be9-bf4d-415b-8659-1e8e67e4cc38 tempest-ServerActionsTestOtherA-1015930920 None] Lock "cinder-c4140bdd-ea08-49d5-90d4-3f5ee64f5ea4-delete_volume" released by "delete_volume" :: held 1.248s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:55:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e6dc1db1-a064-4159-85db-59b65ee31e59 tempest-CinderUnicodeTest-1484418034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:55:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e6dc1db1-a064-4159-85db-59b65ee31e59 tempest-CinderUnicodeTest-1484418034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:55:32 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-e6dc1db1-a064-4159-85db-59b65ee31e59 tempest-CinderUnicodeTest-1484418034 None] Creating offline snapshot 8abc47b2-f9fa-4b33-8c2d-465def93f087 of volume d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 17:55:32 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb2d4fc-50c5-4d84-b923-822907ab5c2b]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:55:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e6dc1db1-a064-4159-85db-59b65ee31e59 tempest-CinderUnicodeTest-1484418034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:32 devstack sudo[96346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f Sep 04 17:55:32 devstack sudo[96346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:32 devstack sudo[96346]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e6dc1db1-a064-4159-85db-59b65ee31e59 tempest-CinderUnicodeTest-1484418034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f" returned: 0 in 0.430s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e6dc1db1-a064-4159-85db-59b65ee31e59 tempest-CinderUnicodeTest-1484418034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f.8abc47b2-f9fa-4b33-8c2d-465def93f087 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:32 devstack sudo[96351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f.8abc47b2-f9fa-4b33-8c2d-465def93f087 1G Sep 04 17:55:32 devstack sudo[96351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:33 devstack sudo[96351]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e6dc1db1-a064-4159-85db-59b65ee31e59 tempest-CinderUnicodeTest-1484418034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f.8abc47b2-f9fa-4b33-8c2d-465def93f087 1G" returned: 0 in 0.532s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e6dc1db1-a064-4159-85db-59b65ee31e59 tempest-CinderUnicodeTest-1484418034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f.8abc47b2-f9fa-4b33-8c2d-465def93f087 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:33 devstack sudo[96360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f.8abc47b2-f9fa-4b33-8c2d-465def93f087 Sep 04 17:55:33 devstack sudo[96360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:33 devstack sudo[96360]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e6dc1db1-a064-4159-85db-59b65ee31e59 tempest-CinderUnicodeTest-1484418034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f.8abc47b2-f9fa-4b33-8c2d-465def93f087" returned: 0 in 0.512s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:33 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-e6dc1db1-a064-4159-85db-59b65ee31e59 tempest-CinderUnicodeTest-1484418034 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f.8abc47b2-f9fa-4b33-8c2d-465def93f087 is being set with open permissions: ugo+rw Sep 04 17:55:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e6dc1db1-a064-4159-85db-59b65ee31e59 tempest-CinderUnicodeTest-1484418034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f.8abc47b2-f9fa-4b33-8c2d-465def93f087 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:33 devstack sudo[96366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f.8abc47b2-f9fa-4b33-8c2d-465def93f087 Sep 04 17:55:33 devstack sudo[96366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:34 devstack sudo[96366]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e6dc1db1-a064-4159-85db-59b65ee31e59 tempest-CinderUnicodeTest-1484418034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f.8abc47b2-f9fa-4b33-8c2d-465def93f087" returned: 0 in 0.384s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:34 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c7e2994-b454-4f64-b0f5-16febc1ce6ad tempest-AttachVolumeNegativeTest-221345582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:55:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1c7e2994-b454-4f64-b0f5-16febc1ce6ad tempest-AttachVolumeNegativeTest-221345582 None] Flow 'volume_create_manager' (65d44f61-174b-4021-997d-c837f0880d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:55:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1c7e2994-b454-4f64-b0f5-16febc1ce6ad tempest-AttachVolumeNegativeTest-221345582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (461f6202-6ccb-4767-9199-5115fcb7afd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:55:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e6dc1db1-a064-4159-85db-59b65ee31e59 tempest-CinderUnicodeTest-1484418034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:34 devstack sudo[96369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f.info Sep 04 17:55:34 devstack sudo[96369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1c7e2994-b454-4f64-b0f5-16febc1ce6ad tempest-AttachVolumeNegativeTest-221345582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (461f6202-6ccb-4767-9199-5115fcb7afd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:55:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1108580839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e51cddb6-5fea-4c99-b83e-fb982408b7b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cb92ac13b534f169ec45e07b30f7478',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:55:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:55:34Z,use_quota=True,user_id='059c6c050db2446f85a498a65fe5bd6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:55:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1c7e2994-b454-4f64-b0f5-16febc1ce6ad tempest-AttachVolumeNegativeTest-221345582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba349bb4-8734-47e8-89c9-6a61ef300bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:55:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1c7e2994-b454-4f64-b0f5-16febc1ce6ad tempest-AttachVolumeNegativeTest-221345582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba349bb4-8734-47e8-89c9-6a61ef300bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:55:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1c7e2994-b454-4f64-b0f5-16febc1ce6ad tempest-AttachVolumeNegativeTest-221345582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70082381-ec53-4b16-91a8-c329750d6705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:55:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1c7e2994-b454-4f64-b0f5-16febc1ce6ad tempest-AttachVolumeNegativeTest-221345582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70082381-ec53-4b16-91a8-c329750d6705) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e51cddb6-5fea-4c99-b83e-fb982408b7b5', 'volume_name': 'volume-e51cddb6-5fea-4c99-b83e-fb982408b7b5', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:55:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1c7e2994-b454-4f64-b0f5-16febc1ce6ad tempest-AttachVolumeNegativeTest-221345582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3ec0d91-2381-4a6d-9110-ebb7f29b2c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:55:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1c7e2994-b454-4f64-b0f5-16febc1ce6ad tempest-AttachVolumeNegativeTest-221345582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3ec0d91-2381-4a6d-9110-ebb7f29b2c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:55:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1c7e2994-b454-4f64-b0f5-16febc1ce6ad tempest-AttachVolumeNegativeTest-221345582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b661973-bda4-457d-a2ce-fdd88183aa70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:55:34 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-1c7e2994-b454-4f64-b0f5-16febc1ce6ad tempest-AttachVolumeNegativeTest-221345582 None] Volume e51cddb6-5fea-4c99-b83e-fb982408b7b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e51cddb6-5fea-4c99-b83e-fb982408b7b5', 'volume_size': 1} Sep 04 17:55:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1c7e2994-b454-4f64-b0f5-16febc1ce6ad tempest-AttachVolumeNegativeTest-221345582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:55:34 devstack sudo[96369]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e6dc1db1-a064-4159-85db-59b65ee31e59 tempest-CinderUnicodeTest-1484418034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f.info" returned: 0 in 0.287s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:34 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-e6dc1db1-a064-4159-85db-59b65ee31e59 tempest-CinderUnicodeTest-1484418034 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f.info is being set with open permissions: ugo+rw Sep 04 17:55:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e6dc1db1-a064-4159-85db-59b65ee31e59 tempest-CinderUnicodeTest-1484418034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:34 devstack sudo[96372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f.info Sep 04 17:55:34 devstack sudo[96372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:34 devstack sudo[96372]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e6dc1db1-a064-4159-85db-59b65ee31e59 tempest-CinderUnicodeTest-1484418034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f.info" returned: 0 in 0.248s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e6dc1db1-a064-4159-85db-59b65ee31e59 tempest-CinderUnicodeTest-1484418034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.579s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:55:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1c7e2994-b454-4f64-b0f5-16febc1ce6ad tempest-AttachVolumeNegativeTest-221345582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.482s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:55:34 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-1c7e2994-b454-4f64-b0f5-16febc1ce6ad tempest-AttachVolumeNegativeTest-221345582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:55:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1108580839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e51cddb6-5fea-4c99-b83e-fb982408b7b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cb92ac13b534f169ec45e07b30f7478',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:55:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:55:34Z,use_quota=True,user_id='059c6c050db2446f85a498a65fe5bd6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:55:34 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-1c7e2994-b454-4f64-b0f5-16febc1ce6ad tempest-AttachVolumeNegativeTest-221345582 None] Creating volume e51cddb6-5fea-4c99-b83e-fb982408b7b5 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:55:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1c7e2994-b454-4f64-b0f5-16febc1ce6ad tempest-AttachVolumeNegativeTest-221345582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:55:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1c7e2994-b454-4f64-b0f5-16febc1ce6ad tempest-AttachVolumeNegativeTest-221345582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:55:34 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-1c7e2994-b454-4f64-b0f5-16febc1ce6ad tempest-AttachVolumeNegativeTest-221345582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:55:34 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-1c7e2994-b454-4f64-b0f5-16febc1ce6ad tempest-AttachVolumeNegativeTest-221345582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:55:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1c7e2994-b454-4f64-b0f5-16febc1ce6ad tempest-AttachVolumeNegativeTest-221345582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:55:34 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-1c7e2994-b454-4f64-b0f5-16febc1ce6ad tempest-AttachVolumeNegativeTest-221345582 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:55:34 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-1c7e2994-b454-4f64-b0f5-16febc1ce6ad tempest-AttachVolumeNegativeTest-221345582 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:55:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1c7e2994-b454-4f64-b0f5-16febc1ce6ad tempest-AttachVolumeNegativeTest-221345582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-e51cddb6-5fea-4c99-b83e-fb982408b7b5 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:35 devstack sudo[96375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-e51cddb6-5fea-4c99-b83e-fb982408b7b5 1073741824 Sep 04 17:55:35 devstack sudo[96375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:35 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-e6dc1db1-a064-4159-85db-59b65ee31e59 tempest-CinderUnicodeTest-1484418034 None] Create snapshot completed successfully Sep 04 17:55:35 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3a601c9d-3083-46e2-9ba8-6a2c0ee8768e tempest-CinderUnicodeTest-1484418034 None] Acquiring lock "cinder-8abc47b2-f9fa-4b33-8c2d-465def93f087-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:55:35 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3a601c9d-3083-46e2-9ba8-6a2c0ee8768e tempest-CinderUnicodeTest-1484418034 None] Lock "cinder-8abc47b2-f9fa-4b33-8c2d-465def93f087-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:55:35 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3a601c9d-3083-46e2-9ba8-6a2c0ee8768e tempest-CinderUnicodeTest-1484418034 None] Acquiring lock "cinder-quobyte-d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:55:35 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3a601c9d-3083-46e2-9ba8-6a2c0ee8768e tempest-CinderUnicodeTest-1484418034 None] Lock "cinder-quobyte-d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:55:35 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3a601c9d-3083-46e2-9ba8-6a2c0ee8768e tempest-CinderUnicodeTest-1484418034 None] Acquiring lock "cinder-quobyte-8abc47b2-f9fa-4b33-8c2d-465def93f087" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:55:35 devstack sudo[96375]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1c7e2994-b454-4f64-b0f5-16febc1ce6ad tempest-AttachVolumeNegativeTest-221345582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-e51cddb6-5fea-4c99-b83e-fb982408b7b5 1073741824" returned: 0 in 0.680s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:35 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3a601c9d-3083-46e2-9ba8-6a2c0ee8768e tempest-CinderUnicodeTest-1484418034 None] Lock "cinder-quobyte-8abc47b2-f9fa-4b33-8c2d-465def93f087" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:55:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-3a601c9d-3083-46e2-9ba8-6a2c0ee8768e tempest-CinderUnicodeTest-1484418034 None] Deleting offline snapshot 8abc47b2-f9fa-4b33-8c2d-465def93f087 of volume d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 17:55:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-3a601c9d-3083-46e2-9ba8-6a2c0ee8768e tempest-CinderUnicodeTest-1484418034 None] snapshot_file for this snap is: volume-d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f.8abc47b2-f9fa-4b33-8c2d-465def93f087 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 17:55:35 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb75daec-37a4-46a5-b07b-90bcccfc2534]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:55:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3a601c9d-3083-46e2-9ba8-6a2c0ee8768e tempest-CinderUnicodeTest-1484418034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f.8abc47b2-f9fa-4b33-8c2d-465def93f087 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1c7e2994-b454-4f64-b0f5-16febc1ce6ad tempest-AttachVolumeNegativeTest-221345582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-e51cddb6-5fea-4c99-b83e-fb982408b7b5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:35 devstack sudo[96381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-e51cddb6-5fea-4c99-b83e-fb982408b7b5 Sep 04 17:55:35 devstack sudo[96381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:35 devstack sudo[96380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f.8abc47b2-f9fa-4b33-8c2d-465def93f087 Sep 04 17:55:35 devstack sudo[96380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:36 devstack sudo[96381]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1c7e2994-b454-4f64-b0f5-16febc1ce6ad tempest-AttachVolumeNegativeTest-221345582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-e51cddb6-5fea-4c99-b83e-fb982408b7b5" returned: 0 in 0.315s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-1c7e2994-b454-4f64-b0f5-16febc1ce6ad tempest-AttachVolumeNegativeTest-221345582 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:55:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1c7e2994-b454-4f64-b0f5-16febc1ce6ad tempest-AttachVolumeNegativeTest-221345582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:55:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1c7e2994-b454-4f64-b0f5-16febc1ce6ad tempest-AttachVolumeNegativeTest-221345582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b661973-bda4-457d-a2ce-fdd88183aa70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e51cddb6-5fea-4c99-b83e-fb982408b7b5', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:55:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1c7e2994-b454-4f64-b0f5-16febc1ce6ad tempest-AttachVolumeNegativeTest-221345582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (912020c5-1c85-45b1-ae1a-03d2b1032d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:55:36 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-1c7e2994-b454-4f64-b0f5-16febc1ce6ad tempest-AttachVolumeNegativeTest-221345582 None] Volume volume-e51cddb6-5fea-4c99-b83e-fb982408b7b5 (e51cddb6-5fea-4c99-b83e-fb982408b7b5): created successfully Sep 04 17:55:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1c7e2994-b454-4f64-b0f5-16febc1ce6ad tempest-AttachVolumeNegativeTest-221345582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (912020c5-1c85-45b1-ae1a-03d2b1032d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:55:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1c7e2994-b454-4f64-b0f5-16febc1ce6ad tempest-AttachVolumeNegativeTest-221345582 None] Flow 'volume_create_manager' (65d44f61-174b-4021-997d-c837f0880d7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:55:36 devstack sudo[96380]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3a601c9d-3083-46e2-9ba8-6a2c0ee8768e tempest-CinderUnicodeTest-1484418034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f.8abc47b2-f9fa-4b33-8c2d-465def93f087" returned: 0 in 0.421s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-3a601c9d-3083-46e2-9ba8-6a2c0ee8768e tempest-CinderUnicodeTest-1484418034 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 17:55:36 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-1c7e2994-b454-4f64-b0f5-16febc1ce6ad tempest-AttachVolumeNegativeTest-221345582 None] Created volume successfully. Sep 04 17:55:36 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0234e5f-9513-444c-abe5-71be9046085c]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:55:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3a601c9d-3083-46e2-9ba8-6a2c0ee8768e tempest-CinderUnicodeTest-1484418034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:36 devstack sudo[96388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f Sep 04 17:55:36 devstack sudo[96388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:36 devstack sudo[96388]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3a601c9d-3083-46e2-9ba8-6a2c0ee8768e tempest-CinderUnicodeTest-1484418034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f" returned: 0 in 0.459s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3a601c9d-3083-46e2-9ba8-6a2c0ee8768e tempest-CinderUnicodeTest-1484418034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f.8abc47b2-f9fa-4b33-8c2d-465def93f087 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:36 devstack sudo[96397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f.8abc47b2-f9fa-4b33-8c2d-465def93f087 Sep 04 17:55:36 devstack sudo[96397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:37 devstack sudo[96397]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3a601c9d-3083-46e2-9ba8-6a2c0ee8768e tempest-CinderUnicodeTest-1484418034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f.8abc47b2-f9fa-4b33-8c2d-465def93f087" returned: 0 in 0.440s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3a601c9d-3083-46e2-9ba8-6a2c0ee8768e tempest-CinderUnicodeTest-1484418034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f.8abc47b2-f9fa-4b33-8c2d-465def93f087 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:37 devstack sudo[96403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f.8abc47b2-f9fa-4b33-8c2d-465def93f087 Sep 04 17:55:37 devstack sudo[96403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:37 devstack sudo[96403]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3a601c9d-3083-46e2-9ba8-6a2c0ee8768e tempest-CinderUnicodeTest-1484418034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f.8abc47b2-f9fa-4b33-8c2d-465def93f087" returned: 0 in 0.332s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3a601c9d-3083-46e2-9ba8-6a2c0ee8768e tempest-CinderUnicodeTest-1484418034 None] Lock "cinder-quobyte-8abc47b2-f9fa-4b33-8c2d-465def93f087" released by "_delete_snapshot" :: held 1.796s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:55:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3a601c9d-3083-46e2-9ba8-6a2c0ee8768e tempest-CinderUnicodeTest-1484418034 None] Lock "cinder-quobyte-d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f" released by "delete_snapshot" :: held 1.850s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:55:37 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-3a601c9d-3083-46e2-9ba8-6a2c0ee8768e tempest-CinderUnicodeTest-1484418034 None] Created reservations ['a9f5585e-3d02-4f0b-9ba8-7bc2c97d5f09', '503f3858-4581-4d01-95c5-6add3eef80e9', '82255675-380b-4ff8-93ad-0e0f98eedb7e', '9498c641-ee25-4d2f-8d91-db51bf742e1d'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:55:37 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-3a601c9d-3083-46e2-9ba8-6a2c0ee8768e tempest-CinderUnicodeTest-1484418034 None] Delete snapshot completed successfully. Sep 04 17:55:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3a601c9d-3083-46e2-9ba8-6a2c0ee8768e tempest-CinderUnicodeTest-1484418034 None] Lock "cinder-8abc47b2-f9fa-4b33-8c2d-465def93f087-delete_snapshot" released by "delete_snapshot" :: held 2.122s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:55:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-3100a6b2-4ce7-4aae-a445-853a533daf13 req-77e3082f-0d85-4c27-b53e-a5de1b3b60a4 tempest-AttachVolumeNegativeTest-221345582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:55:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-3100a6b2-4ce7-4aae-a445-853a533daf13 req-77e3082f-0d85-4c27-b53e-a5de1b3b60a4 tempest-AttachVolumeNegativeTest-221345582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:55:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-3100a6b2-4ce7-4aae-a445-853a533daf13 req-77e3082f-0d85-4c27-b53e-a5de1b3b60a4 tempest-AttachVolumeNegativeTest-221345582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:55:37 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-3100a6b2-4ce7-4aae-a445-853a533daf13 req-77e3082f-0d85-4c27-b53e-a5de1b3b60a4 tempest-AttachVolumeNegativeTest-221345582 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a', 'name': 'volume-e51cddb6-5fea-4c99-b83e-fb982408b7b5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8cf237a5-f82b-4597-87b9-797d98b5549a', 'enforce_multipath': True} {{(pid=87314) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 17:55:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ad69248c-c29c-4a2a-b96c-440493b9d887 tempest-CinderUnicodeTest-1484418034 None] Acquiring lock "cinder-d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:55:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ad69248c-c29c-4a2a-b96c-440493b9d887 tempest-CinderUnicodeTest-1484418034 None] Lock "cinder-d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:55:37 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-3100a6b2-4ce7-4aae-a445-853a533daf13 req-77e3082f-0d85-4c27-b53e-a5de1b3b60a4 tempest-AttachVolumeNegativeTest-221345582 None] attachment_update completed successfully. Sep 04 17:55:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ad69248c-c29c-4a2a-b96c-440493b9d887 tempest-CinderUnicodeTest-1484418034 None] Acquiring lock "cinder-quobyte-d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:55:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ad69248c-c29c-4a2a-b96c-440493b9d887 tempest-CinderUnicodeTest-1484418034 None] Lock "cinder-quobyte-d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f" acquired by "delete_volume" :: waited 0.026s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:55:38 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b68168-24b6-46f3-bda7-92867d8565b7]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:55:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ad69248c-c29c-4a2a-b96c-440493b9d887 tempest-CinderUnicodeTest-1484418034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:38 devstack sudo[96452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f Sep 04 17:55:38 devstack sudo[96452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:38 devstack sudo[96452]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ad69248c-c29c-4a2a-b96c-440493b9d887 tempest-CinderUnicodeTest-1484418034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f" returned: 0 in 0.545s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ad69248c-c29c-4a2a-b96c-440493b9d887 tempest-CinderUnicodeTest-1484418034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:38 devstack sudo[96838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f Sep 04 17:55:38 devstack sudo[96838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:39 devstack sudo[96838]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ad69248c-c29c-4a2a-b96c-440493b9d887 tempest-CinderUnicodeTest-1484418034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f" returned: 0 in 0.408s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:39 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ad69248c-c29c-4a2a-b96c-440493b9d887 tempest-CinderUnicodeTest-1484418034 None] Lock "cinder-quobyte-d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f" released by "delete_volume" :: held 1.087s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:55:39 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-ad69248c-c29c-4a2a-b96c-440493b9d887 tempest-CinderUnicodeTest-1484418034 None] Created reservations ['4d97c952-5086-42a0-b6f1-fa7377929705', '38dbd8fa-3bad-4e6e-a525-9a706fd8f697', '92066e4d-7d09-4ec5-aab8-2c608336a3ec', 'd104485f-11de-4840-b0eb-f889b2d35362'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:55:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ad69248c-c29c-4a2a-b96c-440493b9d887 tempest-CinderUnicodeTest-1484418034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:55:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ad69248c-c29c-4a2a-b96c-440493b9d887 tempest-CinderUnicodeTest-1484418034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:55:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ad69248c-c29c-4a2a-b96c-440493b9d887 tempest-CinderUnicodeTest-1484418034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:55:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ad69248c-c29c-4a2a-b96c-440493b9d887 tempest-CinderUnicodeTest-1484418034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:55:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ad69248c-c29c-4a2a-b96c-440493b9d887 tempest-CinderUnicodeTest-1484418034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:55:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ad69248c-c29c-4a2a-b96c-440493b9d887 tempest-CinderUnicodeTest-1484418034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:39 devstack sudo[96841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:55:39 devstack sudo[96841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:39 devstack sudo[96841]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ad69248c-c29c-4a2a-b96c-440493b9d887 tempest-CinderUnicodeTest-1484418034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.260s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:39 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-ad69248c-c29c-4a2a-b96c-440493b9d887 tempest-CinderUnicodeTest-1484418034 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:55:39 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-ad69248c-c29c-4a2a-b96c-440493b9d887 tempest-CinderUnicodeTest-1484418034 None] Deleted volume successfully. Sep 04 17:55:39 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ad69248c-c29c-4a2a-b96c-440493b9d887 tempest-CinderUnicodeTest-1484418034 None] Lock "cinder-d4a9d8ab-d51e-42ad-849d-9cb43bb6bf4f-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:55:40 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6063abdb-c14c-4fca-b02f-a97a70e58601 tempest-CinderUnicodeTest-1484418034 None] Acquiring lock "cinder-4f74c904-a422-4697-97c8-bf5feb95190b-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:55:40 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6063abdb-c14c-4fca-b02f-a97a70e58601 tempest-CinderUnicodeTest-1484418034 None] Lock "cinder-4f74c904-a422-4697-97c8-bf5feb95190b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:55:40 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6063abdb-c14c-4fca-b02f-a97a70e58601 tempest-CinderUnicodeTest-1484418034 None] Acquiring lock "cinder-quobyte-4f74c904-a422-4697-97c8-bf5feb95190b" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:55:40 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6063abdb-c14c-4fca-b02f-a97a70e58601 tempest-CinderUnicodeTest-1484418034 None] Lock "cinder-quobyte-4f74c904-a422-4697-97c8-bf5feb95190b" acquired by "delete_volume" :: waited 0.024s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:55:40 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c8c249-492f-40ce-84f7-58f0e023baff]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:55:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6063abdb-c14c-4fca-b02f-a97a70e58601 tempest-CinderUnicodeTest-1484418034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4f74c904-a422-4697-97c8-bf5feb95190b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:40 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-046fdf8b-5b4a-49fd-9f95-b0c3b3cba85b req-730230b6-c6ce-4de4-ae03-94bcb557c4e6 tempest-AttachVolumeNegativeTest-221345582 None] Terminate volume connection completed successfully. Sep 04 17:55:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-046fdf8b-5b4a-49fd-9f95-b0c3b3cba85b req-730230b6-c6ce-4de4-ae03-94bcb557c4e6 tempest-AttachVolumeNegativeTest-221345582 None] Deleting attachment 8cf237a5-f82b-4597-87b9-797d98b5549a. {{(pid=87314) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 17:55:40 devstack sudo[96845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4f74c904-a422-4697-97c8-bf5feb95190b Sep 04 17:55:40 devstack sudo[96845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:40 devstack sudo[96845]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6063abdb-c14c-4fca-b02f-a97a70e58601 tempest-CinderUnicodeTest-1484418034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4f74c904-a422-4697-97c8-bf5feb95190b" returned: 0 in 0.497s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6063abdb-c14c-4fca-b02f-a97a70e58601 tempest-CinderUnicodeTest-1484418034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4f74c904-a422-4697-97c8-bf5feb95190b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:40 devstack sudo[96875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4f74c904-a422-4697-97c8-bf5feb95190b Sep 04 17:55:40 devstack sudo[96875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:41 devstack sudo[96875]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6063abdb-c14c-4fca-b02f-a97a70e58601 tempest-CinderUnicodeTest-1484418034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4f74c904-a422-4697-97c8-bf5feb95190b" returned: 0 in 0.321s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:41 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6063abdb-c14c-4fca-b02f-a97a70e58601 tempest-CinderUnicodeTest-1484418034 None] Lock "cinder-quobyte-4f74c904-a422-4697-97c8-bf5feb95190b" released by "delete_volume" :: held 0.871s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:55:41 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-6063abdb-c14c-4fca-b02f-a97a70e58601 tempest-CinderUnicodeTest-1484418034 None] Created reservations ['6c4b708f-6cb6-418c-b803-1d5da1af5e59', 'edfa2450-fcee-4f54-b682-447e24c8f6bd', '2031ad44-2f49-4e33-b4e9-75dd8b3977f5', 'aab9b9fe-d72a-42f4-b619-dccefc7732e0'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:55:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6063abdb-c14c-4fca-b02f-a97a70e58601 tempest-CinderUnicodeTest-1484418034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:55:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6063abdb-c14c-4fca-b02f-a97a70e58601 tempest-CinderUnicodeTest-1484418034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:55:41 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-6063abdb-c14c-4fca-b02f-a97a70e58601 tempest-CinderUnicodeTest-1484418034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:55:41 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-6063abdb-c14c-4fca-b02f-a97a70e58601 tempest-CinderUnicodeTest-1484418034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:55:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6063abdb-c14c-4fca-b02f-a97a70e58601 tempest-CinderUnicodeTest-1484418034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:55:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6063abdb-c14c-4fca-b02f-a97a70e58601 tempest-CinderUnicodeTest-1484418034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:41 devstack sudo[96879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:55:41 devstack sudo[96879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:41 devstack sudo[96879]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6063abdb-c14c-4fca-b02f-a97a70e58601 tempest-CinderUnicodeTest-1484418034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.425s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:41 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-6063abdb-c14c-4fca-b02f-a97a70e58601 tempest-CinderUnicodeTest-1484418034 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:55:41 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-6063abdb-c14c-4fca-b02f-a97a70e58601 tempest-CinderUnicodeTest-1484418034 None] Deleted volume successfully. Sep 04 17:55:42 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6063abdb-c14c-4fca-b02f-a97a70e58601 tempest-CinderUnicodeTest-1484418034 None] Lock "cinder-4f74c904-a422-4697-97c8-bf5feb95190b-delete_volume" released by "delete_volume" :: held 1.731s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:55:48 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5413e085-ec44-4237-932d-3dd36b7b1c2f tempest-AttachVolumeNegativeTest-221345582 None] Acquiring lock "cinder-e51cddb6-5fea-4c99-b83e-fb982408b7b5-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:55:48 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5413e085-ec44-4237-932d-3dd36b7b1c2f tempest-AttachVolumeNegativeTest-221345582 None] Lock "cinder-e51cddb6-5fea-4c99-b83e-fb982408b7b5-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:55:48 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5413e085-ec44-4237-932d-3dd36b7b1c2f tempest-AttachVolumeNegativeTest-221345582 None] Acquiring lock "cinder-quobyte-e51cddb6-5fea-4c99-b83e-fb982408b7b5" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:55:48 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5413e085-ec44-4237-932d-3dd36b7b1c2f tempest-AttachVolumeNegativeTest-221345582 None] Lock "cinder-quobyte-e51cddb6-5fea-4c99-b83e-fb982408b7b5" acquired by "delete_volume" :: waited 0.032s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:55:48 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bfad4fa-21b4-4730-ac90-2ca3d9a7c217]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:55:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5413e085-ec44-4237-932d-3dd36b7b1c2f tempest-AttachVolumeNegativeTest-221345582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-e51cddb6-5fea-4c99-b83e-fb982408b7b5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:48 devstack sudo[96906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-e51cddb6-5fea-4c99-b83e-fb982408b7b5 Sep 04 17:55:48 devstack sudo[96906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:48 devstack sudo[96906]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5413e085-ec44-4237-932d-3dd36b7b1c2f tempest-AttachVolumeNegativeTest-221345582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-e51cddb6-5fea-4c99-b83e-fb982408b7b5" returned: 0 in 0.520s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5413e085-ec44-4237-932d-3dd36b7b1c2f tempest-AttachVolumeNegativeTest-221345582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-e51cddb6-5fea-4c99-b83e-fb982408b7b5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:49 devstack sudo[96911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-e51cddb6-5fea-4c99-b83e-fb982408b7b5 Sep 04 17:55:49 devstack sudo[96911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:49 devstack sudo[96911]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5413e085-ec44-4237-932d-3dd36b7b1c2f tempest-AttachVolumeNegativeTest-221345582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-e51cddb6-5fea-4c99-b83e-fb982408b7b5" returned: 0 in 0.264s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5413e085-ec44-4237-932d-3dd36b7b1c2f tempest-AttachVolumeNegativeTest-221345582 None] Lock "cinder-quobyte-e51cddb6-5fea-4c99-b83e-fb982408b7b5" released by "delete_volume" :: held 0.864s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:55:49 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-5413e085-ec44-4237-932d-3dd36b7b1c2f tempest-AttachVolumeNegativeTest-221345582 None] Created reservations ['b3e859c6-5d35-49cc-95c0-d5fc274d0285', '47a06fbc-d333-4df8-9821-a14064794963', 'db16d990-b34e-4514-b8f6-5a12feab97a2', 'f62f0ebc-e42b-42de-9f0d-defff231d741'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:55:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5413e085-ec44-4237-932d-3dd36b7b1c2f tempest-AttachVolumeNegativeTest-221345582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:55:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5413e085-ec44-4237-932d-3dd36b7b1c2f tempest-AttachVolumeNegativeTest-221345582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:55:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5413e085-ec44-4237-932d-3dd36b7b1c2f tempest-AttachVolumeNegativeTest-221345582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:55:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5413e085-ec44-4237-932d-3dd36b7b1c2f tempest-AttachVolumeNegativeTest-221345582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:55:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5413e085-ec44-4237-932d-3dd36b7b1c2f tempest-AttachVolumeNegativeTest-221345582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:55:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5413e085-ec44-4237-932d-3dd36b7b1c2f tempest-AttachVolumeNegativeTest-221345582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:49 devstack sudo[96914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:55:49 devstack sudo[96914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-03d9cbae-f857-4516-a280-7d0ddbbe2f81 tempest-AttachVolumeNegativeTest-221345582 None] Acquiring lock "cinder-cc9723cf-6972-4a43-a1d5-fb327158319b-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:55:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-03d9cbae-f857-4516-a280-7d0ddbbe2f81 tempest-AttachVolumeNegativeTest-221345582 None] Lock "cinder-cc9723cf-6972-4a43-a1d5-fb327158319b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:55:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-03d9cbae-f857-4516-a280-7d0ddbbe2f81 tempest-AttachVolumeNegativeTest-221345582 None] Acquiring lock "cinder-quobyte-cc9723cf-6972-4a43-a1d5-fb327158319b" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:55:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-03d9cbae-f857-4516-a280-7d0ddbbe2f81 tempest-AttachVolumeNegativeTest-221345582 None] Lock "cinder-quobyte-cc9723cf-6972-4a43-a1d5-fb327158319b" acquired by "delete_volume" :: waited 0.038s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:55:49 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3027453-21c2-45b6-9b27-c2dac9b20205]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:55:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-03d9cbae-f857-4516-a280-7d0ddbbe2f81 tempest-AttachVolumeNegativeTest-221345582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cc9723cf-6972-4a43-a1d5-fb327158319b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:49 devstack sudo[96916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cc9723cf-6972-4a43-a1d5-fb327158319b Sep 04 17:55:49 devstack sudo[96916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:49 devstack sudo[96914]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5413e085-ec44-4237-932d-3dd36b7b1c2f tempest-AttachVolumeNegativeTest-221345582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.453s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:49 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-5413e085-ec44-4237-932d-3dd36b7b1c2f tempest-AttachVolumeNegativeTest-221345582 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:55:49 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-5413e085-ec44-4237-932d-3dd36b7b1c2f tempest-AttachVolumeNegativeTest-221345582 None] Deleted volume successfully. Sep 04 17:55:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5413e085-ec44-4237-932d-3dd36b7b1c2f tempest-AttachVolumeNegativeTest-221345582 None] Lock "cinder-e51cddb6-5fea-4c99-b83e-fb982408b7b5-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:55:50 devstack sudo[96916]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-03d9cbae-f857-4516-a280-7d0ddbbe2f81 tempest-AttachVolumeNegativeTest-221345582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cc9723cf-6972-4a43-a1d5-fb327158319b" returned: 0 in 0.468s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-03d9cbae-f857-4516-a280-7d0ddbbe2f81 tempest-AttachVolumeNegativeTest-221345582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cc9723cf-6972-4a43-a1d5-fb327158319b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:50 devstack sudo[96922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cc9723cf-6972-4a43-a1d5-fb327158319b Sep 04 17:55:50 devstack sudo[96922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:50 devstack sudo[96922]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-03d9cbae-f857-4516-a280-7d0ddbbe2f81 tempest-AttachVolumeNegativeTest-221345582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cc9723cf-6972-4a43-a1d5-fb327158319b" returned: 0 in 0.308s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:50 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-03d9cbae-f857-4516-a280-7d0ddbbe2f81 tempest-AttachVolumeNegativeTest-221345582 None] Lock "cinder-quobyte-cc9723cf-6972-4a43-a1d5-fb327158319b" released by "delete_volume" :: held 0.847s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:55:50 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-03d9cbae-f857-4516-a280-7d0ddbbe2f81 tempest-AttachVolumeNegativeTest-221345582 None] Created reservations ['84673ad9-f783-4ee5-895f-345332d91bda', 'a04aa8b4-c0b9-4c0f-8f18-44323ddd39a9', 'cec67e3a-aad6-484a-8771-f4979536a389', 'e0272b15-a9df-4b24-b212-2b01c3fd5856'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:55:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-03d9cbae-f857-4516-a280-7d0ddbbe2f81 tempest-AttachVolumeNegativeTest-221345582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:55:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-03d9cbae-f857-4516-a280-7d0ddbbe2f81 tempest-AttachVolumeNegativeTest-221345582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:55:50 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-03d9cbae-f857-4516-a280-7d0ddbbe2f81 tempest-AttachVolumeNegativeTest-221345582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:55:50 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-03d9cbae-f857-4516-a280-7d0ddbbe2f81 tempest-AttachVolumeNegativeTest-221345582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:55:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-03d9cbae-f857-4516-a280-7d0ddbbe2f81 tempest-AttachVolumeNegativeTest-221345582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:55:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-03d9cbae-f857-4516-a280-7d0ddbbe2f81 tempest-AttachVolumeNegativeTest-221345582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:50 devstack sudo[96925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:55:50 devstack sudo[96925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:51 devstack sudo[96925]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-03d9cbae-f857-4516-a280-7d0ddbbe2f81 tempest-AttachVolumeNegativeTest-221345582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.374s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:51 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-03d9cbae-f857-4516-a280-7d0ddbbe2f81 tempest-AttachVolumeNegativeTest-221345582 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:55:51 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3872fa7a-6923-40fa-8b0d-3c476422bb8e tempest-AttachVolumeNegativeTest-221345582 None] Acquiring lock "cinder-b2ea5ce7-0b61-45a3-a3b7-4e4cc94688e2-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:55:51 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-03d9cbae-f857-4516-a280-7d0ddbbe2f81 tempest-AttachVolumeNegativeTest-221345582 None] Deleted volume successfully. Sep 04 17:55:51 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3872fa7a-6923-40fa-8b0d-3c476422bb8e tempest-AttachVolumeNegativeTest-221345582 None] Lock "cinder-b2ea5ce7-0b61-45a3-a3b7-4e4cc94688e2-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:55:51 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-03d9cbae-f857-4516-a280-7d0ddbbe2f81 tempest-AttachVolumeNegativeTest-221345582 None] Lock "cinder-cc9723cf-6972-4a43-a1d5-fb327158319b-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:55:51 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3872fa7a-6923-40fa-8b0d-3c476422bb8e tempest-AttachVolumeNegativeTest-221345582 None] Acquiring lock "cinder-quobyte-b2ea5ce7-0b61-45a3-a3b7-4e4cc94688e2" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:55:51 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3872fa7a-6923-40fa-8b0d-3c476422bb8e tempest-AttachVolumeNegativeTest-221345582 None] Lock "cinder-quobyte-b2ea5ce7-0b61-45a3-a3b7-4e4cc94688e2" acquired by "delete_volume" :: waited 0.026s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:55:51 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba275063-83cd-4ff5-ac3a-e008a669feca]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:55:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3872fa7a-6923-40fa-8b0d-3c476422bb8e tempest-AttachVolumeNegativeTest-221345582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b2ea5ce7-0b61-45a3-a3b7-4e4cc94688e2 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:51 devstack sudo[96928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b2ea5ce7-0b61-45a3-a3b7-4e4cc94688e2 Sep 04 17:55:51 devstack sudo[96928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:51 devstack sudo[96928]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3872fa7a-6923-40fa-8b0d-3c476422bb8e tempest-AttachVolumeNegativeTest-221345582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b2ea5ce7-0b61-45a3-a3b7-4e4cc94688e2" returned: 0 in 0.422s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3872fa7a-6923-40fa-8b0d-3c476422bb8e tempest-AttachVolumeNegativeTest-221345582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b2ea5ce7-0b61-45a3-a3b7-4e4cc94688e2 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:51 devstack sudo[96933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b2ea5ce7-0b61-45a3-a3b7-4e4cc94688e2 Sep 04 17:55:51 devstack sudo[96933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:52 devstack sudo[96933]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3872fa7a-6923-40fa-8b0d-3c476422bb8e tempest-AttachVolumeNegativeTest-221345582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b2ea5ce7-0b61-45a3-a3b7-4e4cc94688e2" returned: 0 in 0.289s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3872fa7a-6923-40fa-8b0d-3c476422bb8e tempest-AttachVolumeNegativeTest-221345582 None] Lock "cinder-quobyte-b2ea5ce7-0b61-45a3-a3b7-4e4cc94688e2" released by "delete_volume" :: held 0.760s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:55:52 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-3872fa7a-6923-40fa-8b0d-3c476422bb8e tempest-AttachVolumeNegativeTest-221345582 None] Created reservations ['d186451a-6bfb-4126-a677-eef36330b898', '0e6e5b4d-1da5-43f4-8417-61d9930eae8d', '682f90e2-0697-4146-a3a1-7229859fe59d', 'a2748f0a-a3a0-4577-bfdc-b6d6b8181ec3'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:55:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3872fa7a-6923-40fa-8b0d-3c476422bb8e tempest-AttachVolumeNegativeTest-221345582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:55:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3872fa7a-6923-40fa-8b0d-3c476422bb8e tempest-AttachVolumeNegativeTest-221345582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:55:52 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-3872fa7a-6923-40fa-8b0d-3c476422bb8e tempest-AttachVolumeNegativeTest-221345582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:55:52 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-3872fa7a-6923-40fa-8b0d-3c476422bb8e tempest-AttachVolumeNegativeTest-221345582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:55:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3872fa7a-6923-40fa-8b0d-3c476422bb8e tempest-AttachVolumeNegativeTest-221345582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:55:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3872fa7a-6923-40fa-8b0d-3c476422bb8e tempest-AttachVolumeNegativeTest-221345582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:55:52 devstack sudo[96936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:55:52 devstack sudo[96936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:55:52 devstack sudo[96936]: pam_unix(sudo:session): session closed for user root Sep 04 17:55:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3872fa7a-6923-40fa-8b0d-3c476422bb8e tempest-AttachVolumeNegativeTest-221345582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.319s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:55:52 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-3872fa7a-6923-40fa-8b0d-3c476422bb8e tempest-AttachVolumeNegativeTest-221345582 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:55:52 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-3872fa7a-6923-40fa-8b0d-3c476422bb8e tempest-AttachVolumeNegativeTest-221345582 None] Deleted volume successfully. Sep 04 17:55:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3872fa7a-6923-40fa-8b0d-3c476422bb8e tempest-AttachVolumeNegativeTest-221345582 None] Lock "cinder-b2ea5ce7-0b61-45a3-a3b7-4e4cc94688e2-delete_volume" released by "delete_volume" :: held 1.323s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:56:02 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:UPDATE=169,cinder:DELETE=10,cinder:SELECT=126,cinder:INSERT=46 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 17:56:02 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=117,cinder:UPDATE=165,cinder:DELETE=18,cinder:INSERT=34 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 17:56:12 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=1 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 17:56:17 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-531d568c-0230-435e-861c-7beec1f2e8aa tempest-GroupSnapshotsTest-1632469284 None] Group tempest-GroupSnapshotsTest-Group-1742312144: creating Sep 04 17:56:17 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-531d568c-0230-435e-861c-7beec1f2e8aa tempest-GroupSnapshotsTest-1632469284 None] Group tempest-GroupSnapshotsTest-Group-1742312144: created successfully Sep 04 17:56:17 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-531d568c-0230-435e-861c-7beec1f2e8aa tempest-GroupSnapshotsTest-1632469284 None] Create group completed successfully. Sep 04 17:56:19 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f2fabfb-63bb-4aba-a66e-331d75808fcc tempest-GroupSnapshotsTest-1632469284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:56:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4f2fabfb-63bb-4aba-a66e-331d75808fcc tempest-GroupSnapshotsTest-1632469284 None] Flow 'volume_create_manager' (9057bd73-982e-4bf3-b213-80ed2cd6b7cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:56:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4f2fabfb-63bb-4aba-a66e-331d75808fcc tempest-GroupSnapshotsTest-1632469284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31514ae6-7b46-4fe4-8bc3-93a3eb90ed34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:56:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4f2fabfb-63bb-4aba-a66e-331d75808fcc tempest-GroupSnapshotsTest-1632469284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31514ae6-7b46-4fe4-8bc3-93a3eb90ed34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:56:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-362029511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1c10ebe0-27c9-4fe0-9ee9-dec23584931b,host='devstack@QuobyteHD#QuobyteHD',id=2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b90a7a1d394b4293aa22af639974cdd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:56:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:56:19Z,use_quota=True,user_id='2deecbeab20243e89090df54531c8db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56db490e-6ddc-4073-a600-eebc3dbd2d59),volume_type_id=56db490e-6ddc-4073-a600-eebc3dbd2d59)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:56:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4f2fabfb-63bb-4aba-a66e-331d75808fcc tempest-GroupSnapshotsTest-1632469284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac66c3f2-411d-4cab-87ae-1ed920b163ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:56:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4f2fabfb-63bb-4aba-a66e-331d75808fcc tempest-GroupSnapshotsTest-1632469284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac66c3f2-411d-4cab-87ae-1ed920b163ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:56:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4f2fabfb-63bb-4aba-a66e-331d75808fcc tempest-GroupSnapshotsTest-1632469284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6895db16-dd84-4731-a59d-8e1e298e44b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:56:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4f2fabfb-63bb-4aba-a66e-331d75808fcc tempest-GroupSnapshotsTest-1632469284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6895db16-dd84-4731-a59d-8e1e298e44b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c', 'volume_name': 'volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:56:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4f2fabfb-63bb-4aba-a66e-331d75808fcc tempest-GroupSnapshotsTest-1632469284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (931a3a74-9929-4c4b-8844-fb124b755f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:56:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4f2fabfb-63bb-4aba-a66e-331d75808fcc tempest-GroupSnapshotsTest-1632469284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (931a3a74-9929-4c4b-8844-fb124b755f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:56:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4f2fabfb-63bb-4aba-a66e-331d75808fcc tempest-GroupSnapshotsTest-1632469284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f3e3379-bcf9-431e-a959-249c58b3b35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:56:19 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-4f2fabfb-63bb-4aba-a66e-331d75808fcc tempest-GroupSnapshotsTest-1632469284 None] Volume 2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c', 'volume_size': 1} Sep 04 17:56:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4f2fabfb-63bb-4aba-a66e-331d75808fcc tempest-GroupSnapshotsTest-1632469284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:56:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4f2fabfb-63bb-4aba-a66e-331d75808fcc tempest-GroupSnapshotsTest-1632469284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:56:19 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4f2fabfb-63bb-4aba-a66e-331d75808fcc tempest-GroupSnapshotsTest-1632469284 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1c10ebe0-27c9-4fe0-9ee9-dec23584931b,created_at=2026-09-04T15:56:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-362029511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1c10ebe0-27c9-4fe0-9ee9-dec23584931b,host='devstack@QuobyteHD#QuobyteHD',id=2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b90a7a1d394b4293aa22af639974cdd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:56:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:56:19Z,use_quota=True,user_id='2deecbeab20243e89090df54531c8db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56db490e-6ddc-4073-a600-eebc3dbd2d59),volume_type_id=56db490e-6ddc-4073-a600-eebc3dbd2d59)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:56:19 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-4f2fabfb-63bb-4aba-a66e-331d75808fcc tempest-GroupSnapshotsTest-1632469284 None] Creating volume 2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:56:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4f2fabfb-63bb-4aba-a66e-331d75808fcc tempest-GroupSnapshotsTest-1632469284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:56:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4f2fabfb-63bb-4aba-a66e-331d75808fcc tempest-GroupSnapshotsTest-1632469284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:56:19 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4f2fabfb-63bb-4aba-a66e-331d75808fcc tempest-GroupSnapshotsTest-1632469284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:56:19 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4f2fabfb-63bb-4aba-a66e-331d75808fcc tempest-GroupSnapshotsTest-1632469284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:56:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4f2fabfb-63bb-4aba-a66e-331d75808fcc tempest-GroupSnapshotsTest-1632469284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:56:19 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4f2fabfb-63bb-4aba-a66e-331d75808fcc tempest-GroupSnapshotsTest-1632469284 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:56:19 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-4f2fabfb-63bb-4aba-a66e-331d75808fcc tempest-GroupSnapshotsTest-1632469284 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:56:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4f2fabfb-63bb-4aba-a66e-331d75808fcc tempest-GroupSnapshotsTest-1632469284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:56:19 devstack sudo[96997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c 1073741824 Sep 04 17:56:19 devstack sudo[96997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:56:19 devstack sudo[96997]: pam_unix(sudo:session): session closed for user root Sep 04 17:56:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4f2fabfb-63bb-4aba-a66e-331d75808fcc tempest-GroupSnapshotsTest-1632469284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c 1073741824" returned: 0 in 0.595s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:56:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4f2fabfb-63bb-4aba-a66e-331d75808fcc tempest-GroupSnapshotsTest-1632469284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:56:19 devstack sudo[97004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c Sep 04 17:56:19 devstack sudo[97004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:56:20 devstack sudo[97004]: pam_unix(sudo:session): session closed for user root Sep 04 17:56:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4f2fabfb-63bb-4aba-a66e-331d75808fcc tempest-GroupSnapshotsTest-1632469284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c" returned: 0 in 0.279s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:56:20 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4f2fabfb-63bb-4aba-a66e-331d75808fcc tempest-GroupSnapshotsTest-1632469284 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:56:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4f2fabfb-63bb-4aba-a66e-331d75808fcc tempest-GroupSnapshotsTest-1632469284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:56:20 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4f2fabfb-63bb-4aba-a66e-331d75808fcc tempest-GroupSnapshotsTest-1632469284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f3e3379-bcf9-431e-a959-249c58b3b35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:56:20 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4f2fabfb-63bb-4aba-a66e-331d75808fcc tempest-GroupSnapshotsTest-1632469284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f7574a5-c526-47a9-91aa-0e1011f8afa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:56:20 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-4f2fabfb-63bb-4aba-a66e-331d75808fcc tempest-GroupSnapshotsTest-1632469284 None] Volume volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c (2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c): created successfully Sep 04 17:56:20 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4f2fabfb-63bb-4aba-a66e-331d75808fcc tempest-GroupSnapshotsTest-1632469284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f7574a5-c526-47a9-91aa-0e1011f8afa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:56:20 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4f2fabfb-63bb-4aba-a66e-331d75808fcc tempest-GroupSnapshotsTest-1632469284 None] Flow 'volume_create_manager' (9057bd73-982e-4bf3-b213-80ed2cd6b7cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:56:20 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-4f2fabfb-63bb-4aba-a66e-331d75808fcc tempest-GroupSnapshotsTest-1632469284 None] Created volume successfully. Sep 04 17:56:21 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 17:56:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:56:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:56:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:56:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:56:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:56:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:56:21 devstack sudo[97008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:56:21 devstack sudo[97008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:56:21 devstack sudo[97008]: pam_unix(sudo:session): session closed for user root Sep 04 17:56:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.371s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:56:21 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:56:21 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running periodic task VolumeManager._thread_info {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 17:56:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] thread count: 28 {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 17:56:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] thread info: [<_MainThread(MainThread, started 139900377723008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 17:56:21 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-97094d8b-4baa-45a4-bd95-9e2e63be336c tempest-GroupSnapshotsTest-1632469284 None] GroupSnapshot 2a3f1624-bbb0-4455-9f1c-ff439b309d1b: creating. Sep 04 17:56:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-97094d8b-4baa-45a4-bd95-9e2e63be336c tempest-GroupSnapshotsTest-1632469284 None] Group snapshot 2a3f1624-bbb0-4455-9f1c-ff439b309d1b: creating. {{(pid=87314) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 04 17:56:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-97094d8b-4baa-45a4-bd95-9e2e63be336c tempest-GroupSnapshotsTest-1632469284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:56:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-97094d8b-4baa-45a4-bd95-9e2e63be336c tempest-GroupSnapshotsTest-1632469284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:56:22 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-97094d8b-4baa-45a4-bd95-9e2e63be336c tempest-GroupSnapshotsTest-1632469284 None] Creating offline snapshot 83b28670-8389-442f-96be-ef3d12249768 of volume 2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 17:56:22 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[3468a629-473b-467d-adbb-dfd3d17ad5b2]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:56:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-97094d8b-4baa-45a4-bd95-9e2e63be336c tempest-GroupSnapshotsTest-1632469284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:56:22 devstack sudo[97012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c Sep 04 17:56:22 devstack sudo[97012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:56:22 devstack sudo[97012]: pam_unix(sudo:session): session closed for user root Sep 04 17:56:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-97094d8b-4baa-45a4-bd95-9e2e63be336c tempest-GroupSnapshotsTest-1632469284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c" returned: 0 in 0.676s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:56:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-97094d8b-4baa-45a4-bd95-9e2e63be336c tempest-GroupSnapshotsTest-1632469284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c.83b28670-8389-442f-96be-ef3d12249768 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:56:22 devstack sudo[97038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c.83b28670-8389-442f-96be-ef3d12249768 1G Sep 04 17:56:22 devstack sudo[97038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:56:23 devstack sudo[97038]: pam_unix(sudo:session): session closed for user root Sep 04 17:56:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-97094d8b-4baa-45a4-bd95-9e2e63be336c tempest-GroupSnapshotsTest-1632469284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c.83b28670-8389-442f-96be-ef3d12249768 1G" returned: 0 in 0.849s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:56:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-97094d8b-4baa-45a4-bd95-9e2e63be336c tempest-GroupSnapshotsTest-1632469284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c.83b28670-8389-442f-96be-ef3d12249768 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:56:23 devstack sudo[97087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c.83b28670-8389-442f-96be-ef3d12249768 Sep 04 17:56:23 devstack sudo[97087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:56:24 devstack sudo[97087]: pam_unix(sudo:session): session closed for user root Sep 04 17:56:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-97094d8b-4baa-45a4-bd95-9e2e63be336c tempest-GroupSnapshotsTest-1632469284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c.83b28670-8389-442f-96be-ef3d12249768" returned: 0 in 0.655s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:56:24 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-97094d8b-4baa-45a4-bd95-9e2e63be336c tempest-GroupSnapshotsTest-1632469284 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c.83b28670-8389-442f-96be-ef3d12249768 is being set with open permissions: ugo+rw: NotImplementedError Sep 04 17:56:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-97094d8b-4baa-45a4-bd95-9e2e63be336c tempest-GroupSnapshotsTest-1632469284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c.83b28670-8389-442f-96be-ef3d12249768 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:56:24 devstack sudo[97105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c.83b28670-8389-442f-96be-ef3d12249768 Sep 04 17:56:24 devstack sudo[97105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:56:25 devstack sudo[97105]: pam_unix(sudo:session): session closed for user root Sep 04 17:56:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-97094d8b-4baa-45a4-bd95-9e2e63be336c tempest-GroupSnapshotsTest-1632469284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c.83b28670-8389-442f-96be-ef3d12249768" returned: 0 in 0.852s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:56:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-97094d8b-4baa-45a4-bd95-9e2e63be336c tempest-GroupSnapshotsTest-1632469284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:56:25 devstack sudo[97149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c.info Sep 04 17:56:25 devstack sudo[97149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:56:26 devstack sudo[97149]: pam_unix(sudo:session): session closed for user root Sep 04 17:56:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-97094d8b-4baa-45a4-bd95-9e2e63be336c tempest-GroupSnapshotsTest-1632469284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c.info" returned: 0 in 0.814s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:56:26 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-97094d8b-4baa-45a4-bd95-9e2e63be336c tempest-GroupSnapshotsTest-1632469284 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c.info is being set with open permissions: ugo+rw: NotImplementedError Sep 04 17:56:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-97094d8b-4baa-45a4-bd95-9e2e63be336c tempest-GroupSnapshotsTest-1632469284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:56:26 devstack sudo[97163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c.info Sep 04 17:56:26 devstack sudo[97163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:56:26 devstack sudo[97163]: pam_unix(sudo:session): session closed for user root Sep 04 17:56:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-97094d8b-4baa-45a4-bd95-9e2e63be336c tempest-GroupSnapshotsTest-1632469284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c.info" returned: 0 in 0.796s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:56:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-97094d8b-4baa-45a4-bd95-9e2e63be336c tempest-GroupSnapshotsTest-1632469284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.874s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:56:27 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-97094d8b-4baa-45a4-bd95-9e2e63be336c tempest-GroupSnapshotsTest-1632469284 None] group_snapshot 2a3f1624-bbb0-4455-9f1c-ff439b309d1b: created successfully Sep 04 17:56:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-508828d9-f965-4c3a-801d-ad49814fb41f tempest-GroupSnapshotsTest-1632469284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:56:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-508828d9-f965-4c3a-801d-ad49814fb41f tempest-GroupSnapshotsTest-1632469284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:56:28 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-508828d9-f965-4c3a-801d-ad49814fb41f tempest-GroupSnapshotsTest-1632469284 None] Acquiring lock "cinder-quobyte-83b28670-8389-442f-96be-ef3d12249768-f38052af-4d16-405b-a6cd-fcd2d7ae999d" by "_create_volume_from_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:56:28 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-508828d9-f965-4c3a-801d-ad49814fb41f tempest-GroupSnapshotsTest-1632469284 None] Lock "cinder-quobyte-83b28670-8389-442f-96be-ef3d12249768-f38052af-4d16-405b-a6cd-fcd2d7ae999d" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:56:28 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-508828d9-f965-4c3a-801d-ad49814fb41f tempest-GroupSnapshotsTest-1632469284 None] Creating volume f38052af-4d16-405b-a6cd-fcd2d7ae999d from snapshot 83b28670-8389-442f-96be-ef3d12249768 {{(pid=87314) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 04 17:56:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-508828d9-f965-4c3a-801d-ad49814fb41f tempest-GroupSnapshotsTest-1632469284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:56:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-508828d9-f965-4c3a-801d-ad49814fb41f tempest-GroupSnapshotsTest-1632469284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:56:28 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-508828d9-f965-4c3a-801d-ad49814fb41f tempest-GroupSnapshotsTest-1632469284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:56:28 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-508828d9-f965-4c3a-801d-ad49814fb41f tempest-GroupSnapshotsTest-1632469284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:56:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-508828d9-f965-4c3a-801d-ad49814fb41f tempest-GroupSnapshotsTest-1632469284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:56:28 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-508828d9-f965-4c3a-801d-ad49814fb41f tempest-GroupSnapshotsTest-1632469284 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:56:28 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-508828d9-f965-4c3a-801d-ad49814fb41f tempest-GroupSnapshotsTest-1632469284 None] Acquiring lock "cinder-quobyte-f38052af-4d16-405b-a6cd-fcd2d7ae999d" by "_copy_volume_from_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:56:28 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-508828d9-f965-4c3a-801d-ad49814fb41f tempest-GroupSnapshotsTest-1632469284 None] Lock "cinder-quobyte-f38052af-4d16-405b-a6cd-fcd2d7ae999d" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:56:28 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-508828d9-f965-4c3a-801d-ad49814fb41f tempest-GroupSnapshotsTest-1632469284 None] snapshot: 83b28670-8389-442f-96be-ef3d12249768, volume: f38052af-4d16-405b-a6cd-fcd2d7ae999d, {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 04 17:56:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-508828d9-f965-4c3a-801d-ad49814fb41f tempest-GroupSnapshotsTest-1632469284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:56:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-508828d9-f965-4c3a-801d-ad49814fb41f tempest-GroupSnapshotsTest-1632469284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:56:28 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-508828d9-f965-4c3a-801d-ad49814fb41f tempest-GroupSnapshotsTest-1632469284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:56:28 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-508828d9-f965-4c3a-801d-ad49814fb41f tempest-GroupSnapshotsTest-1632469284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:56:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-508828d9-f965-4c3a-801d-ad49814fb41f tempest-GroupSnapshotsTest-1632469284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:56:28 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[777bd7d8-b117-4906-b9a4-93a6617139bf]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:56:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-508828d9-f965-4c3a-801d-ad49814fb41f tempest-GroupSnapshotsTest-1632469284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c.83b28670-8389-442f-96be-ef3d12249768 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:56:29 devstack sudo[97169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c.83b28670-8389-442f-96be-ef3d12249768 Sep 04 17:56:29 devstack sudo[97169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:56:29 devstack sudo[97169]: pam_unix(sudo:session): session closed for user root Sep 04 17:56:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-508828d9-f965-4c3a-801d-ad49814fb41f tempest-GroupSnapshotsTest-1632469284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c.83b28670-8389-442f-96be-ef3d12249768" returned: 0 in 0.732s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:56:29 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-508828d9-f965-4c3a-801d-ad49814fb41f tempest-GroupSnapshotsTest-1632469284 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 17:56:29 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dcea3c6-e035-4fcb-8669-81212816a360]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:56:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-508828d9-f965-4c3a-801d-ad49814fb41f tempest-GroupSnapshotsTest-1632469284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:56:29 devstack sudo[97175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c Sep 04 17:56:29 devstack sudo[97175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:56:30 devstack sudo[97175]: pam_unix(sudo:session): session closed for user root Sep 04 17:56:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-508828d9-f965-4c3a-801d-ad49814fb41f tempest-GroupSnapshotsTest-1632469284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c" returned: 0 in 0.668s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:56:30 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-508828d9-f965-4c3a-801d-ad49814fb41f tempest-GroupSnapshotsTest-1632469284 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 04 17:56:30 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-508828d9-f965-4c3a-801d-ad49814fb41f tempest-GroupSnapshotsTest-1632469284 None] Creating direct copy from snapshot {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 04 17:56:30 devstack cinder-volume[87314]: DEBUG cinder.utils [None req-508828d9-f965-4c3a-801d-ad49814fb41f tempest-GroupSnapshotsTest-1632469284 None] Path /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f38052af-4d16-405b-a6cd-fcd2d7ae999d not found in is_blk_device check {{(pid=87314) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 04 17:56:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-508828d9-f965-4c3a-801d-ad49814fb41f tempest-GroupSnapshotsTest-1632469284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f38052af-4d16-405b-a6cd-fcd2d7ae999d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:56:30 devstack sudo[97180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f38052af-4d16-405b-a6cd-fcd2d7ae999d Sep 04 17:56:30 devstack sudo[97180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:56:38 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=10,cinder:UPDATE=7,cinder:INSERT=1 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 17:56:38 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:UPDATE=5,cinder:SELECT=14,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 17:56:41 devstack sudo[97180]: pam_unix(sudo:session): session closed for user root Sep 04 17:56:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-508828d9-f965-4c3a-801d-ad49814fb41f tempest-GroupSnapshotsTest-1632469284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f38052af-4d16-405b-a6cd-fcd2d7ae999d" returned: 0 in 10.657s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:56:41 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-508828d9-f965-4c3a-801d-ad49814fb41f tempest-GroupSnapshotsTest-1632469284 None] Image conversion details: src /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c, size 1024.00 MB, duration 10.66 sec, destination /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f38052af-4d16-405b-a6cd-fcd2d7ae999d {{(pid=87314) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 17:56:41 devstack cinder-volume[87314]: INFO cinder.image.image_utils [None req-508828d9-f965-4c3a-801d-ad49814fb41f tempest-GroupSnapshotsTest-1632469284 None] Converted 1024.00 MB image at 96.07 MB/s Sep 04 17:56:41 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-508828d9-f965-4c3a-801d-ad49814fb41f tempest-GroupSnapshotsTest-1632469284 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f38052af-4d16-405b-a6cd-fcd2d7ae999d is being set with open permissions: ugo+rw: NotImplementedError Sep 04 17:56:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-508828d9-f965-4c3a-801d-ad49814fb41f tempest-GroupSnapshotsTest-1632469284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f38052af-4d16-405b-a6cd-fcd2d7ae999d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:56:41 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-2298a44c-d8c4-43e1-b320-d56dc8674f45 tempest-VolumesActionsTest-4714917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:56:41 devstack sudo[97261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f38052af-4d16-405b-a6cd-fcd2d7ae999d Sep 04 17:56:41 devstack sudo[97261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:56:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2298a44c-d8c4-43e1-b320-d56dc8674f45 tempest-VolumesActionsTest-4714917 None] Flow 'volume_create_manager' (eace18ba-9f98-48e5-a59c-89877b6ed649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:56:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2298a44c-d8c4-43e1-b320-d56dc8674f45 tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (311af375-9d91-4bdc-9ff6-12c144e74547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:56:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2298a44c-d8c4-43e1-b320-d56dc8674f45 tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (311af375-9d91-4bdc-9ff6-12c144e74547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:56:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-924034082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94472fd9-a6d1-4876-927a-366e6237fd2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38378c3abbf14ff4955c45d1c327ad3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:56:41Z,use_quota=True,user_id='875b51464a33490b8c4a2405e23a4980',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:56:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2298a44c-d8c4-43e1-b320-d56dc8674f45 tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed319501-d1fa-4606-982f-0d20cdc00453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:56:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2298a44c-d8c4-43e1-b320-d56dc8674f45 tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed319501-d1fa-4606-982f-0d20cdc00453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:56:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2298a44c-d8c4-43e1-b320-d56dc8674f45 tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (949efb69-3d50-4f91-9fcd-d85651bd2d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:56:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2298a44c-d8c4-43e1-b320-d56dc8674f45 tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (949efb69-3d50-4f91-9fcd-d85651bd2d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94472fd9-a6d1-4876-927a-366e6237fd2e', 'volume_name': 'volume-94472fd9-a6d1-4876-927a-366e6237fd2e', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:56:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2298a44c-d8c4-43e1-b320-d56dc8674f45 tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46cd0150-92ab-40a4-b920-46d96ef93cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:56:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2298a44c-d8c4-43e1-b320-d56dc8674f45 tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46cd0150-92ab-40a4-b920-46d96ef93cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:56:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2298a44c-d8c4-43e1-b320-d56dc8674f45 tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46f08435-8962-4cb9-b721-30e767d68252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:56:41 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-2298a44c-d8c4-43e1-b320-d56dc8674f45 tempest-VolumesActionsTest-4714917 None] Volume 94472fd9-a6d1-4876-927a-366e6237fd2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94472fd9-a6d1-4876-927a-366e6237fd2e', 'volume_size': 1} Sep 04 17:56:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-2298a44c-d8c4-43e1-b320-d56dc8674f45 tempest-VolumesActionsTest-4714917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:56:41 devstack sudo[97261]: pam_unix(sudo:session): session closed for user root Sep 04 17:56:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-508828d9-f965-4c3a-801d-ad49814fb41f tempest-GroupSnapshotsTest-1632469284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f38052af-4d16-405b-a6cd-fcd2d7ae999d" returned: 0 in 0.490s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:56:41 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-508828d9-f965-4c3a-801d-ad49814fb41f tempest-GroupSnapshotsTest-1632469284 None] Lock "cinder-quobyte-f38052af-4d16-405b-a6cd-fcd2d7ae999d" released by "_copy_volume_from_snapshot" :: held 12.695s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:56:41 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-508828d9-f965-4c3a-801d-ad49814fb41f tempest-GroupSnapshotsTest-1632469284 None] Lock "cinder-quobyte-83b28670-8389-442f-96be-ef3d12249768-f38052af-4d16-405b-a6cd-fcd2d7ae999d" released by "_create_volume_from_snapshot" :: held 12.805s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:56:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-508828d9-f965-4c3a-801d-ad49814fb41f tempest-GroupSnapshotsTest-1632469284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.833s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:56:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-2298a44c-d8c4-43e1-b320-d56dc8674f45 tempest-VolumesActionsTest-4714917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.205s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:56:41 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-2298a44c-d8c4-43e1-b320-d56dc8674f45 tempest-VolumesActionsTest-4714917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:56:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-924034082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94472fd9-a6d1-4876-927a-366e6237fd2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38378c3abbf14ff4955c45d1c327ad3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:56:41Z,use_quota=True,user_id='875b51464a33490b8c4a2405e23a4980',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:56:41 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-2298a44c-d8c4-43e1-b320-d56dc8674f45 tempest-VolumesActionsTest-4714917 None] Creating volume 94472fd9-a6d1-4876-927a-366e6237fd2e {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:56:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-2298a44c-d8c4-43e1-b320-d56dc8674f45 tempest-VolumesActionsTest-4714917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:56:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-2298a44c-d8c4-43e1-b320-d56dc8674f45 tempest-VolumesActionsTest-4714917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:56:41 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-2298a44c-d8c4-43e1-b320-d56dc8674f45 tempest-VolumesActionsTest-4714917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:56:41 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-2298a44c-d8c4-43e1-b320-d56dc8674f45 tempest-VolumesActionsTest-4714917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:56:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-2298a44c-d8c4-43e1-b320-d56dc8674f45 tempest-VolumesActionsTest-4714917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:56:41 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-2298a44c-d8c4-43e1-b320-d56dc8674f45 tempest-VolumesActionsTest-4714917 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:56:41 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-2298a44c-d8c4-43e1-b320-d56dc8674f45 tempest-VolumesActionsTest-4714917 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:56:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2298a44c-d8c4-43e1-b320-d56dc8674f45 tempest-VolumesActionsTest-4714917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-94472fd9-a6d1-4876-927a-366e6237fd2e 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:56:41 devstack sudo[97264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-94472fd9-a6d1-4876-927a-366e6237fd2e 1073741824 Sep 04 17:56:41 devstack sudo[97264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:56:41 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-508828d9-f965-4c3a-801d-ad49814fb41f tempest-GroupSnapshotsTest-1632469284 None] Create group from source-snapshot-2a3f1624-bbb0-4455-9f1c-ff439b309d1b completed successfully. Sep 04 17:56:42 devstack sudo[97264]: pam_unix(sudo:session): session closed for user root Sep 04 17:56:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2298a44c-d8c4-43e1-b320-d56dc8674f45 tempest-VolumesActionsTest-4714917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-94472fd9-a6d1-4876-927a-366e6237fd2e 1073741824" returned: 0 in 0.605s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:56:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2298a44c-d8c4-43e1-b320-d56dc8674f45 tempest-VolumesActionsTest-4714917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-94472fd9-a6d1-4876-927a-366e6237fd2e {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:56:42 devstack sudo[97287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-94472fd9-a6d1-4876-927a-366e6237fd2e Sep 04 17:56:42 devstack sudo[97287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:56:42 devstack sudo[97287]: pam_unix(sudo:session): session closed for user root Sep 04 17:56:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2298a44c-d8c4-43e1-b320-d56dc8674f45 tempest-VolumesActionsTest-4714917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-94472fd9-a6d1-4876-927a-366e6237fd2e" returned: 0 in 0.255s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:56:42 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-2298a44c-d8c4-43e1-b320-d56dc8674f45 tempest-VolumesActionsTest-4714917 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:56:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-2298a44c-d8c4-43e1-b320-d56dc8674f45 tempest-VolumesActionsTest-4714917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:56:42 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2298a44c-d8c4-43e1-b320-d56dc8674f45 tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46f08435-8962-4cb9-b721-30e767d68252) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94472fd9-a6d1-4876-927a-366e6237fd2e', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:56:42 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2298a44c-d8c4-43e1-b320-d56dc8674f45 tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab1d8d96-b356-4baf-8896-2b44c2b12711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:56:42 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-2298a44c-d8c4-43e1-b320-d56dc8674f45 tempest-VolumesActionsTest-4714917 None] Volume volume-94472fd9-a6d1-4876-927a-366e6237fd2e (94472fd9-a6d1-4876-927a-366e6237fd2e): created successfully Sep 04 17:56:42 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2298a44c-d8c4-43e1-b320-d56dc8674f45 tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab1d8d96-b356-4baf-8896-2b44c2b12711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:56:42 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2298a44c-d8c4-43e1-b320-d56dc8674f45 tempest-VolumesActionsTest-4714917 None] Flow 'volume_create_manager' (eace18ba-9f98-48e5-a59c-89877b6ed649) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:56:42 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-2298a44c-d8c4-43e1-b320-d56dc8674f45 tempest-VolumesActionsTest-4714917 None] Created volume successfully. Sep 04 17:56:42 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbd1dce1-d387-4401-ac17-cbb978d633c8 tempest-SnapshotDependencyTests-1848094913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:56:42 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bbd1dce1-d387-4401-ac17-cbb978d633c8 tempest-SnapshotDependencyTests-1848094913 None] Flow 'volume_create_manager' (df15af10-542f-4cf1-82a8-0aaa71197a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:56:42 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bbd1dce1-d387-4401-ac17-cbb978d633c8 tempest-SnapshotDependencyTests-1848094913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b617173d-6128-4e52-a679-655021c463ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:56:42 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bbd1dce1-d387-4401-ac17-cbb978d633c8 tempest-SnapshotDependencyTests-1848094913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b617173d-6128-4e52-a679-655021c463ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:56:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-831221001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0ea1f76-83e8-493d-825b-a47c6f642af4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d060d442ced14f99acb17ee5f708a83e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:56:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:56:43Z,use_quota=True,user_id='6be7909f142c4e2bad16bb7eaca944ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:56:42 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bbd1dce1-d387-4401-ac17-cbb978d633c8 tempest-SnapshotDependencyTests-1848094913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aab7f319-ffbb-49a4-8bd3-bf2732b4b7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:56:42 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bbd1dce1-d387-4401-ac17-cbb978d633c8 tempest-SnapshotDependencyTests-1848094913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aab7f319-ffbb-49a4-8bd3-bf2732b4b7e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:56:42 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bbd1dce1-d387-4401-ac17-cbb978d633c8 tempest-SnapshotDependencyTests-1848094913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6300d1ac-dd4d-4e1f-bb1b-742b4b52e608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:56:42 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bbd1dce1-d387-4401-ac17-cbb978d633c8 tempest-SnapshotDependencyTests-1848094913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6300d1ac-dd4d-4e1f-bb1b-742b4b52e608) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0ea1f76-83e8-493d-825b-a47c6f642af4', 'volume_name': 'volume-a0ea1f76-83e8-493d-825b-a47c6f642af4', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:56:42 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bbd1dce1-d387-4401-ac17-cbb978d633c8 tempest-SnapshotDependencyTests-1848094913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d684a2b1-307b-4eb2-a5a6-a948abad027e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:56:42 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bbd1dce1-d387-4401-ac17-cbb978d633c8 tempest-SnapshotDependencyTests-1848094913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d684a2b1-307b-4eb2-a5a6-a948abad027e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:56:42 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bbd1dce1-d387-4401-ac17-cbb978d633c8 tempest-SnapshotDependencyTests-1848094913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59f4ac3d-7d43-4278-8886-d2ffa9b3f60c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:56:42 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-bbd1dce1-d387-4401-ac17-cbb978d633c8 tempest-SnapshotDependencyTests-1848094913 None] Volume a0ea1f76-83e8-493d-825b-a47c6f642af4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0ea1f76-83e8-493d-825b-a47c6f642af4', 'volume_size': 1} Sep 04 17:56:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bbd1dce1-d387-4401-ac17-cbb978d633c8 tempest-SnapshotDependencyTests-1848094913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:56:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bbd1dce1-d387-4401-ac17-cbb978d633c8 tempest-SnapshotDependencyTests-1848094913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:56:42 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-bbd1dce1-d387-4401-ac17-cbb978d633c8 tempest-SnapshotDependencyTests-1848094913 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:56:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-831221001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0ea1f76-83e8-493d-825b-a47c6f642af4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d060d442ced14f99acb17ee5f708a83e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:56:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:56:43Z,use_quota=True,user_id='6be7909f142c4e2bad16bb7eaca944ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:56:42 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-bbd1dce1-d387-4401-ac17-cbb978d633c8 tempest-SnapshotDependencyTests-1848094913 None] Creating volume a0ea1f76-83e8-493d-825b-a47c6f642af4 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:56:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bbd1dce1-d387-4401-ac17-cbb978d633c8 tempest-SnapshotDependencyTests-1848094913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:56:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bbd1dce1-d387-4401-ac17-cbb978d633c8 tempest-SnapshotDependencyTests-1848094913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:56:42 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-bbd1dce1-d387-4401-ac17-cbb978d633c8 tempest-SnapshotDependencyTests-1848094913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:56:42 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-bbd1dce1-d387-4401-ac17-cbb978d633c8 tempest-SnapshotDependencyTests-1848094913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:56:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bbd1dce1-d387-4401-ac17-cbb978d633c8 tempest-SnapshotDependencyTests-1848094913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:56:42 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-bbd1dce1-d387-4401-ac17-cbb978d633c8 tempest-SnapshotDependencyTests-1848094913 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:56:42 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-bbd1dce1-d387-4401-ac17-cbb978d633c8 tempest-SnapshotDependencyTests-1848094913 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:56:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bbd1dce1-d387-4401-ac17-cbb978d633c8 tempest-SnapshotDependencyTests-1848094913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0ea1f76-83e8-493d-825b-a47c6f642af4 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:56:42 devstack sudo[97290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0ea1f76-83e8-493d-825b-a47c6f642af4 1073741824 Sep 04 17:56:42 devstack sudo[97290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:56:43 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f198d08a-1721-4210-97dc-e6e7923b9498 tempest-GroupSnapshotsTest-1632469284 None] Acquiring lock "cinder-quobyte-f38052af-4d16-405b-a6cd-fcd2d7ae999d" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:56:43 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f198d08a-1721-4210-97dc-e6e7923b9498 tempest-GroupSnapshotsTest-1632469284 None] Lock "cinder-quobyte-f38052af-4d16-405b-a6cd-fcd2d7ae999d" acquired by "delete_volume" :: waited 0.026s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:56:43 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[36cce806-665b-49c8-a7d8-508edb90f0de]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:56:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f198d08a-1721-4210-97dc-e6e7923b9498 tempest-GroupSnapshotsTest-1632469284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f38052af-4d16-405b-a6cd-fcd2d7ae999d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:56:43 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4b33982a-76e7-42cb-9bcf-6f5158d00dc1 tempest-VolumesActionsTest-4714917 None] Acquiring lock "cinder-94472fd9-a6d1-4876-927a-366e6237fd2e" by "attach_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:56:43 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4b33982a-76e7-42cb-9bcf-6f5158d00dc1 tempest-VolumesActionsTest-4714917 None] Lock "cinder-94472fd9-a6d1-4876-927a-366e6237fd2e" acquired by "attach_volume" :: waited 0.025s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:56:43 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-4b33982a-76e7-42cb-9bcf-6f5158d00dc1 tempest-VolumesActionsTest-4714917 None] Attaching volume 94472fd9-a6d1-4876-927a-366e6237fd2e to instance a2d551cb-6faa-422e-98fa-74d113c7b245 at mountpoint /dev/vdb on host None. Sep 04 17:56:43 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-4b33982a-76e7-42cb-9bcf-6f5158d00dc1 tempest-VolumesActionsTest-4714917 None] Attach volume completed successfully. Sep 04 17:56:43 devstack sudo[97294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f38052af-4d16-405b-a6cd-fcd2d7ae999d Sep 04 17:56:43 devstack sudo[97294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:56:43 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4b33982a-76e7-42cb-9bcf-6f5158d00dc1 tempest-VolumesActionsTest-4714917 None] Lock "cinder-94472fd9-a6d1-4876-927a-366e6237fd2e" released by "attach_volume" :: held 0.105s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:56:43 devstack sudo[97290]: pam_unix(sudo:session): session closed for user root Sep 04 17:56:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bbd1dce1-d387-4401-ac17-cbb978d633c8 tempest-SnapshotDependencyTests-1848094913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0ea1f76-83e8-493d-825b-a47c6f642af4 1073741824" returned: 0 in 0.490s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:56:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bbd1dce1-d387-4401-ac17-cbb978d633c8 tempest-SnapshotDependencyTests-1848094913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0ea1f76-83e8-493d-825b-a47c6f642af4 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:56:43 devstack sudo[97299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0ea1f76-83e8-493d-825b-a47c6f642af4 Sep 04 17:56:43 devstack sudo[97299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:56:43 devstack sudo[97294]: pam_unix(sudo:session): session closed for user root Sep 04 17:56:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f198d08a-1721-4210-97dc-e6e7923b9498 tempest-GroupSnapshotsTest-1632469284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f38052af-4d16-405b-a6cd-fcd2d7ae999d" returned: 0 in 0.431s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:56:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f198d08a-1721-4210-97dc-e6e7923b9498 tempest-GroupSnapshotsTest-1632469284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f38052af-4d16-405b-a6cd-fcd2d7ae999d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:56:43 devstack sudo[97304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f38052af-4d16-405b-a6cd-fcd2d7ae999d Sep 04 17:56:43 devstack sudo[97304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:56:43 devstack sudo[97299]: pam_unix(sudo:session): session closed for user root Sep 04 17:56:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bbd1dce1-d387-4401-ac17-cbb978d633c8 tempest-SnapshotDependencyTests-1848094913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0ea1f76-83e8-493d-825b-a47c6f642af4" returned: 0 in 0.267s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:56:43 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-bbd1dce1-d387-4401-ac17-cbb978d633c8 tempest-SnapshotDependencyTests-1848094913 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:56:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bbd1dce1-d387-4401-ac17-cbb978d633c8 tempest-SnapshotDependencyTests-1848094913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:56:43 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bbd1dce1-d387-4401-ac17-cbb978d633c8 tempest-SnapshotDependencyTests-1848094913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59f4ac3d-7d43-4278-8886-d2ffa9b3f60c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0ea1f76-83e8-493d-825b-a47c6f642af4', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:56:43 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bbd1dce1-d387-4401-ac17-cbb978d633c8 tempest-SnapshotDependencyTests-1848094913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (257e2214-32e4-46ed-90ee-584261362a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:56:43 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-bbd1dce1-d387-4401-ac17-cbb978d633c8 tempest-SnapshotDependencyTests-1848094913 None] Volume volume-a0ea1f76-83e8-493d-825b-a47c6f642af4 (a0ea1f76-83e8-493d-825b-a47c6f642af4): created successfully Sep 04 17:56:43 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bbd1dce1-d387-4401-ac17-cbb978d633c8 tempest-SnapshotDependencyTests-1848094913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (257e2214-32e4-46ed-90ee-584261362a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:56:43 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bbd1dce1-d387-4401-ac17-cbb978d633c8 tempest-SnapshotDependencyTests-1848094913 None] Flow 'volume_create_manager' (df15af10-542f-4cf1-82a8-0aaa71197a79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:56:43 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-bbd1dce1-d387-4401-ac17-cbb978d633c8 tempest-SnapshotDependencyTests-1848094913 None] Created volume successfully. Sep 04 17:56:43 devstack sudo[97304]: pam_unix(sudo:session): session closed for user root Sep 04 17:56:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f198d08a-1721-4210-97dc-e6e7923b9498 tempest-GroupSnapshotsTest-1632469284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f38052af-4d16-405b-a6cd-fcd2d7ae999d" returned: 0 in 0.257s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:56:43 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f198d08a-1721-4210-97dc-e6e7923b9498 tempest-GroupSnapshotsTest-1632469284 None] Lock "cinder-quobyte-f38052af-4d16-405b-a6cd-fcd2d7ae999d" released by "delete_volume" :: held 0.744s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:56:43 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-e66a5766-8b6b-485c-9048-c60c428e5f8b tempest-VolumesActionsTest-852108199 None] Terminate volume connection completed successfully. Sep 04 17:56:43 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-f198d08a-1721-4210-97dc-e6e7923b9498 tempest-GroupSnapshotsTest-1632469284 None] Created reservations ['c4a56d96-fbe4-409b-a8e4-85934e2c5d24'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:56:43 devstack cinder-volume[87314]: WARNING cinder.quota [None req-f198d08a-1721-4210-97dc-e6e7923b9498 tempest-GroupSnapshotsTest-1632469284 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-521799476 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-521799476, it is now deprecated. Please use the default quota class for default quota. Sep 04 17:56:43 devstack cinder-volume[87314]: WARNING cinder.quota [None req-f198d08a-1721-4210-97dc-e6e7923b9498 tempest-GroupSnapshotsTest-1632469284 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-521799476 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-521799476, it is now deprecated. Please use the default quota class for default quota. Sep 04 17:56:43 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e66a5766-8b6b-485c-9048-c60c428e5f8b tempest-VolumesActionsTest-852108199 None] Acquiring lock "cinder-94472fd9-a6d1-4876-927a-366e6237fd2e-detach_volume" by "detach_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:56:43 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-f198d08a-1721-4210-97dc-e6e7923b9498 tempest-GroupSnapshotsTest-1632469284 None] Created reservations ['da309793-81e0-476d-95fb-934afb86df62', 'dc8ed91a-1cf0-4032-82d5-0da2e949eab2', '4f30664b-4f11-4e63-aef0-e11fa68824d7', 'def42625-caff-4a74-a9f8-0886ff931f98'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:56:43 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e66a5766-8b6b-485c-9048-c60c428e5f8b tempest-VolumesActionsTest-852108199 None] Lock "cinder-94472fd9-a6d1-4876-927a-366e6237fd2e-detach_volume" acquired by "detach_volume" :: waited 0.025s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:56:43 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-e66a5766-8b6b-485c-9048-c60c428e5f8b tempest-VolumesActionsTest-852108199 None] Detaching volume 94472fd9-a6d1-4876-927a-366e6237fd2e from instance a2d551cb-6faa-422e-98fa-74d113c7b245. Sep 04 17:56:44 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-e66a5766-8b6b-485c-9048-c60c428e5f8b tempest-VolumesActionsTest-852108199 None] Detach volume completed successfully. Sep 04 17:56:44 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e66a5766-8b6b-485c-9048-c60c428e5f8b tempest-VolumesActionsTest-852108199 None] Lock "cinder-94472fd9-a6d1-4876-927a-366e6237fd2e-detach_volume" released by "detach_volume" :: held 0.092s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:56:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f198d08a-1721-4210-97dc-e6e7923b9498 tempest-GroupSnapshotsTest-1632469284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:56:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f198d08a-1721-4210-97dc-e6e7923b9498 tempest-GroupSnapshotsTest-1632469284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:56:44 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f198d08a-1721-4210-97dc-e6e7923b9498 tempest-GroupSnapshotsTest-1632469284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:56:44 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f198d08a-1721-4210-97dc-e6e7923b9498 tempest-GroupSnapshotsTest-1632469284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:56:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f198d08a-1721-4210-97dc-e6e7923b9498 tempest-GroupSnapshotsTest-1632469284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:56:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f198d08a-1721-4210-97dc-e6e7923b9498 tempest-GroupSnapshotsTest-1632469284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:56:44 devstack sudo[97308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:56:44 devstack sudo[97308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:56:44 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4fb9926e-e449-46a8-8d12-f8516007cc64 tempest-VolumesActionsTest-4714917 None] Acquiring lock "cinder-94472fd9-a6d1-4876-927a-366e6237fd2e-detach_volume" by "detach_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:56:44 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4fb9926e-e449-46a8-8d12-f8516007cc64 tempest-VolumesActionsTest-4714917 None] Lock "cinder-94472fd9-a6d1-4876-927a-366e6237fd2e-detach_volume" acquired by "detach_volume" :: waited 0.016s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:56:44 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-4fb9926e-e449-46a8-8d12-f8516007cc64 tempest-VolumesActionsTest-4714917 None] Volume detach called, but volume not attached. Sep 04 17:56:44 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4fb9926e-e449-46a8-8d12-f8516007cc64 tempest-VolumesActionsTest-4714917 None] Lock "cinder-94472fd9-a6d1-4876-927a-366e6237fd2e-detach_volume" released by "detach_volume" :: held 0.022s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:56:44 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-e30a244a-ed83-4627-835b-0907643f3d25 tempest-GroupSnapshotsTest-1632469284 None] group_snapshot 2a3f1624-bbb0-4455-9f1c-ff439b309d1b: deleting Sep 04 17:56:44 devstack sudo[97308]: pam_unix(sudo:session): session closed for user root Sep 04 17:56:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f198d08a-1721-4210-97dc-e6e7923b9498 tempest-GroupSnapshotsTest-1632469284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.288s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:56:44 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-f198d08a-1721-4210-97dc-e6e7923b9498 tempest-GroupSnapshotsTest-1632469284 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:56:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e30a244a-ed83-4627-835b-0907643f3d25 tempest-GroupSnapshotsTest-1632469284 None] group_snapshot 2a3f1624-bbb0-4455-9f1c-ff439b309d1b: deleting {{(pid=87314) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 04 17:56:44 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-f198d08a-1721-4210-97dc-e6e7923b9498 tempest-GroupSnapshotsTest-1632469284 None] Delete group completed successfully. Sep 04 17:56:44 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e30a244a-ed83-4627-835b-0907643f3d25 tempest-GroupSnapshotsTest-1632469284 None] Acquiring lock "cinder-quobyte-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:56:44 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e30a244a-ed83-4627-835b-0907643f3d25 tempest-GroupSnapshotsTest-1632469284 None] Lock "cinder-quobyte-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:56:44 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e30a244a-ed83-4627-835b-0907643f3d25 tempest-GroupSnapshotsTest-1632469284 None] Acquiring lock "cinder-quobyte-83b28670-8389-442f-96be-ef3d12249768" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:56:44 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e30a244a-ed83-4627-835b-0907643f3d25 tempest-GroupSnapshotsTest-1632469284 None] Lock "cinder-quobyte-83b28670-8389-442f-96be-ef3d12249768" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:56:44 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-e30a244a-ed83-4627-835b-0907643f3d25 tempest-GroupSnapshotsTest-1632469284 None] Deleting offline snapshot 83b28670-8389-442f-96be-ef3d12249768 of volume 2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 17:56:44 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-e30a244a-ed83-4627-835b-0907643f3d25 tempest-GroupSnapshotsTest-1632469284 None] snapshot_file for this snap is: volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c.83b28670-8389-442f-96be-ef3d12249768 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 17:56:44 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69be48a-9427-451b-84d4-b465ae28c3c5]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:56:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e30a244a-ed83-4627-835b-0907643f3d25 tempest-GroupSnapshotsTest-1632469284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c.83b28670-8389-442f-96be-ef3d12249768 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:56:44 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fd02862b-1736-4d70-b0b1-74ce36f16bb3 tempest-VolumesActionsTest-4714917 None] Acquiring lock "cinder-94472fd9-a6d1-4876-927a-366e6237fd2e-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:56:44 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fd02862b-1736-4d70-b0b1-74ce36f16bb3 tempest-VolumesActionsTest-4714917 None] Lock "cinder-94472fd9-a6d1-4876-927a-366e6237fd2e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:56:44 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fd02862b-1736-4d70-b0b1-74ce36f16bb3 tempest-VolumesActionsTest-4714917 None] Acquiring lock "cinder-quobyte-94472fd9-a6d1-4876-927a-366e6237fd2e" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:56:44 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fd02862b-1736-4d70-b0b1-74ce36f16bb3 tempest-VolumesActionsTest-4714917 None] Lock "cinder-quobyte-94472fd9-a6d1-4876-927a-366e6237fd2e" acquired by "delete_volume" :: waited 0.018s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:56:44 devstack sudo[97311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c.83b28670-8389-442f-96be-ef3d12249768 Sep 04 17:56:44 devstack sudo[97311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:56:44 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[898d5868-9e07-4a0a-8411-13058ccc09ab]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:56:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fd02862b-1736-4d70-b0b1-74ce36f16bb3 tempest-VolumesActionsTest-4714917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-94472fd9-a6d1-4876-927a-366e6237fd2e {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:56:44 devstack sudo[97313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-94472fd9-a6d1-4876-927a-366e6237fd2e Sep 04 17:56:44 devstack sudo[97313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:56:44 devstack sudo[97311]: pam_unix(sudo:session): session closed for user root Sep 04 17:56:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e30a244a-ed83-4627-835b-0907643f3d25 tempest-GroupSnapshotsTest-1632469284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c.83b28670-8389-442f-96be-ef3d12249768" returned: 0 in 0.454s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:56:44 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-e30a244a-ed83-4627-835b-0907643f3d25 tempest-GroupSnapshotsTest-1632469284 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 17:56:45 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b500eda-5816-44a6-9283-713272137d44]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:56:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e30a244a-ed83-4627-835b-0907643f3d25 tempest-GroupSnapshotsTest-1632469284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:56:45 devstack sudo[97313]: pam_unix(sudo:session): session closed for user root Sep 04 17:56:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fd02862b-1736-4d70-b0b1-74ce36f16bb3 tempest-VolumesActionsTest-4714917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-94472fd9-a6d1-4876-927a-366e6237fd2e" returned: 0 in 0.424s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:56:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fd02862b-1736-4d70-b0b1-74ce36f16bb3 tempest-VolumesActionsTest-4714917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-94472fd9-a6d1-4876-927a-366e6237fd2e {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:56:45 devstack sudo[97320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c Sep 04 17:56:45 devstack sudo[97322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-94472fd9-a6d1-4876-927a-366e6237fd2e Sep 04 17:56:45 devstack sudo[97320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:56:45 devstack sudo[97322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:56:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0d3d652e-cd9b-4316-ac1d-de914b196f72 tempest-SnapshotDependencyTests-1848094913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:56:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0d3d652e-cd9b-4316-ac1d-de914b196f72 tempest-SnapshotDependencyTests-1848094913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:56:45 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-0d3d652e-cd9b-4316-ac1d-de914b196f72 tempest-SnapshotDependencyTests-1848094913 None] Creating offline snapshot 6bdb2071-2797-4c17-a2bf-48b58bb2e897 of volume a0ea1f76-83e8-493d-825b-a47c6f642af4 {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 17:56:45 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df616a8-606b-4908-bc16-bb57676dc699]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:56:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0d3d652e-cd9b-4316-ac1d-de914b196f72 tempest-SnapshotDependencyTests-1848094913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0ea1f76-83e8-493d-825b-a47c6f642af4 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:56:45 devstack sudo[97322]: pam_unix(sudo:session): session closed for user root Sep 04 17:56:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fd02862b-1736-4d70-b0b1-74ce36f16bb3 tempest-VolumesActionsTest-4714917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-94472fd9-a6d1-4876-927a-366e6237fd2e" returned: 0 in 0.343s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:56:45 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fd02862b-1736-4d70-b0b1-74ce36f16bb3 tempest-VolumesActionsTest-4714917 None] Lock "cinder-quobyte-94472fd9-a6d1-4876-927a-366e6237fd2e" released by "delete_volume" :: held 0.820s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:56:45 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-fd02862b-1736-4d70-b0b1-74ce36f16bb3 tempest-VolumesActionsTest-4714917 None] Created reservations ['76d7676f-202b-4c5a-9bcc-15b4dbe8dd3a', '1a89a503-20e9-4e8c-b089-16729e596165', '5d8616a9-ded8-4240-ad3b-77a55a0cfafb', 'dd4bb5ff-3010-470e-a3cb-091642e0a52d'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:56:45 devstack sudo[97326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0ea1f76-83e8-493d-825b-a47c6f642af4 Sep 04 17:56:45 devstack sudo[97326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:56:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fd02862b-1736-4d70-b0b1-74ce36f16bb3 tempest-VolumesActionsTest-4714917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:56:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fd02862b-1736-4d70-b0b1-74ce36f16bb3 tempest-VolumesActionsTest-4714917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:56:45 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-fd02862b-1736-4d70-b0b1-74ce36f16bb3 tempest-VolumesActionsTest-4714917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:56:45 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-fd02862b-1736-4d70-b0b1-74ce36f16bb3 tempest-VolumesActionsTest-4714917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:56:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fd02862b-1736-4d70-b0b1-74ce36f16bb3 tempest-VolumesActionsTest-4714917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:56:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fd02862b-1736-4d70-b0b1-74ce36f16bb3 tempest-VolumesActionsTest-4714917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:56:45 devstack sudo[97330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:56:45 devstack sudo[97330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:56:45 devstack sudo[97320]: pam_unix(sudo:session): session closed for user root Sep 04 17:56:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e30a244a-ed83-4627-835b-0907643f3d25 tempest-GroupSnapshotsTest-1632469284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c" returned: 0 in 0.770s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:56:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e30a244a-ed83-4627-835b-0907643f3d25 tempest-GroupSnapshotsTest-1632469284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c.83b28670-8389-442f-96be-ef3d12249768 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:56:45 devstack sudo[97333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c.83b28670-8389-442f-96be-ef3d12249768 Sep 04 17:56:45 devstack sudo[97333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:56:46 devstack sudo[97326]: pam_unix(sudo:session): session closed for user root Sep 04 17:56:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0d3d652e-cd9b-4316-ac1d-de914b196f72 tempest-SnapshotDependencyTests-1848094913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0ea1f76-83e8-493d-825b-a47c6f642af4" returned: 0 in 0.620s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:56:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0d3d652e-cd9b-4316-ac1d-de914b196f72 tempest-SnapshotDependencyTests-1848094913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0ea1f76-83e8-493d-825b-a47c6f642af4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0ea1f76-83e8-493d-825b-a47c6f642af4.6bdb2071-2797-4c17-a2bf-48b58bb2e897 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:56:46 devstack sudo[97330]: pam_unix(sudo:session): session closed for user root Sep 04 17:56:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fd02862b-1736-4d70-b0b1-74ce36f16bb3 tempest-VolumesActionsTest-4714917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.391s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:56:46 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-fd02862b-1736-4d70-b0b1-74ce36f16bb3 tempest-VolumesActionsTest-4714917 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:56:46 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-fd02862b-1736-4d70-b0b1-74ce36f16bb3 tempest-VolumesActionsTest-4714917 None] Deleted volume successfully. Sep 04 17:56:46 devstack sudo[97340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0ea1f76-83e8-493d-825b-a47c6f642af4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0ea1f76-83e8-493d-825b-a47c6f642af4.6bdb2071-2797-4c17-a2bf-48b58bb2e897 1G Sep 04 17:56:46 devstack sudo[97340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:56:46 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fd02862b-1736-4d70-b0b1-74ce36f16bb3 tempest-VolumesActionsTest-4714917 None] Lock "cinder-94472fd9-a6d1-4876-927a-366e6237fd2e-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:56:46 devstack sudo[97333]: pam_unix(sudo:session): session closed for user root Sep 04 17:56:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e30a244a-ed83-4627-835b-0907643f3d25 tempest-GroupSnapshotsTest-1632469284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c.83b28670-8389-442f-96be-ef3d12249768" returned: 0 in 0.640s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:56:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e30a244a-ed83-4627-835b-0907643f3d25 tempest-GroupSnapshotsTest-1632469284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c.83b28670-8389-442f-96be-ef3d12249768 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:56:46 devstack sudo[97358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c.83b28670-8389-442f-96be-ef3d12249768 Sep 04 17:56:46 devstack sudo[97358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:56:46 devstack sudo[97340]: pam_unix(sudo:session): session closed for user root Sep 04 17:56:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0d3d652e-cd9b-4316-ac1d-de914b196f72 tempest-SnapshotDependencyTests-1848094913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0ea1f76-83e8-493d-825b-a47c6f642af4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0ea1f76-83e8-493d-825b-a47c6f642af4.6bdb2071-2797-4c17-a2bf-48b58bb2e897 1G" returned: 0 in 0.777s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:56:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0d3d652e-cd9b-4316-ac1d-de914b196f72 tempest-SnapshotDependencyTests-1848094913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0ea1f76-83e8-493d-825b-a47c6f642af4 -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0ea1f76-83e8-493d-825b-a47c6f642af4.6bdb2071-2797-4c17-a2bf-48b58bb2e897 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:56:46 devstack sudo[97370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0ea1f76-83e8-493d-825b-a47c6f642af4 -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0ea1f76-83e8-493d-825b-a47c6f642af4.6bdb2071-2797-4c17-a2bf-48b58bb2e897 Sep 04 17:56:46 devstack sudo[97370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:56:46 devstack sudo[97358]: pam_unix(sudo:session): session closed for user root Sep 04 17:56:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e30a244a-ed83-4627-835b-0907643f3d25 tempest-GroupSnapshotsTest-1632469284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c.83b28670-8389-442f-96be-ef3d12249768" returned: 0 in 0.465s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:56:46 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e30a244a-ed83-4627-835b-0907643f3d25 tempest-GroupSnapshotsTest-1632469284 None] Lock "cinder-quobyte-83b28670-8389-442f-96be-ef3d12249768" released by "_delete_snapshot" :: held 2.474s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:56:46 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e30a244a-ed83-4627-835b-0907643f3d25 tempest-GroupSnapshotsTest-1632469284 None] Lock "cinder-quobyte-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c" released by "delete_snapshot" :: held 2.511s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:56:47 devstack cinder-volume[87314]: WARNING cinder.quota [None req-e30a244a-ed83-4627-835b-0907643f3d25 tempest-GroupSnapshotsTest-1632469284 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-521799476 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-521799476, it is now deprecated. Please use the default quota class for default quota. Sep 04 17:56:47 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-e30a244a-ed83-4627-835b-0907643f3d25 tempest-GroupSnapshotsTest-1632469284 None] Created reservations ['cff7e672-32fa-4706-854a-5a62d3e2443e', 'ba07db2b-d254-452c-8cc9-a6f2f32ddf5f', '0678da14-9dad-428a-8b3a-bed118ea7fdb', '1aa82738-606b-45c7-a20b-8a8b6e8cb3f7'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:56:47 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-e30a244a-ed83-4627-835b-0907643f3d25 tempest-GroupSnapshotsTest-1632469284 None] group_snapshot 2a3f1624-bbb0-4455-9f1c-ff439b309d1b: deleted successfully Sep 04 17:56:47 devstack sudo[97370]: pam_unix(sudo:session): session closed for user root Sep 04 17:56:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0d3d652e-cd9b-4316-ac1d-de914b196f72 tempest-SnapshotDependencyTests-1848094913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0ea1f76-83e8-493d-825b-a47c6f642af4 -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0ea1f76-83e8-493d-825b-a47c6f642af4.6bdb2071-2797-4c17-a2bf-48b58bb2e897" returned: 0 in 0.454s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:56:47 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-0d3d652e-cd9b-4316-ac1d-de914b196f72 tempest-SnapshotDependencyTests-1848094913 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0ea1f76-83e8-493d-825b-a47c6f642af4.6bdb2071-2797-4c17-a2bf-48b58bb2e897 is being set with open permissions: ugo+rw Sep 04 17:56:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0d3d652e-cd9b-4316-ac1d-de914b196f72 tempest-SnapshotDependencyTests-1848094913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0ea1f76-83e8-493d-825b-a47c6f642af4.6bdb2071-2797-4c17-a2bf-48b58bb2e897 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:56:47 devstack sudo[97377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0ea1f76-83e8-493d-825b-a47c6f642af4.6bdb2071-2797-4c17-a2bf-48b58bb2e897 Sep 04 17:56:47 devstack sudo[97377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:56:47 devstack sudo[97377]: pam_unix(sudo:session): session closed for user root Sep 04 17:56:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0d3d652e-cd9b-4316-ac1d-de914b196f72 tempest-SnapshotDependencyTests-1848094913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0ea1f76-83e8-493d-825b-a47c6f642af4.6bdb2071-2797-4c17-a2bf-48b58bb2e897" returned: 0 in 0.291s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:56:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0d3d652e-cd9b-4316-ac1d-de914b196f72 tempest-SnapshotDependencyTests-1848094913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0ea1f76-83e8-493d-825b-a47c6f642af4.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:56:47 devstack sudo[97380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0ea1f76-83e8-493d-825b-a47c6f642af4.info Sep 04 17:56:47 devstack sudo[97380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:56:48 devstack sudo[97380]: pam_unix(sudo:session): session closed for user root Sep 04 17:56:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0d3d652e-cd9b-4316-ac1d-de914b196f72 tempest-SnapshotDependencyTests-1848094913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0ea1f76-83e8-493d-825b-a47c6f642af4.info" returned: 0 in 0.483s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:56:48 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-0d3d652e-cd9b-4316-ac1d-de914b196f72 tempest-SnapshotDependencyTests-1848094913 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0ea1f76-83e8-493d-825b-a47c6f642af4.info is being set with open permissions: ugo+rw Sep 04 17:56:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0d3d652e-cd9b-4316-ac1d-de914b196f72 tempest-SnapshotDependencyTests-1848094913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0ea1f76-83e8-493d-825b-a47c6f642af4.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:56:48 devstack sudo[97387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0ea1f76-83e8-493d-825b-a47c6f642af4.info Sep 04 17:56:48 devstack sudo[97387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:56:48 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ff8b421a-1206-41d7-a0df-37ec9e01d8d0 tempest-GroupSnapshotsTest-1632469284 None] Acquiring lock "cinder-quobyte-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:56:48 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ff8b421a-1206-41d7-a0df-37ec9e01d8d0 tempest-GroupSnapshotsTest-1632469284 None] Lock "cinder-quobyte-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c" acquired by "delete_volume" :: waited 0.022s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:56:48 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[735df40b-b18c-4e7b-a715-74bfb0f8c446]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:56:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ff8b421a-1206-41d7-a0df-37ec9e01d8d0 tempest-GroupSnapshotsTest-1632469284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:56:48 devstack sudo[97387]: pam_unix(sudo:session): session closed for user root Sep 04 17:56:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0d3d652e-cd9b-4316-ac1d-de914b196f72 tempest-SnapshotDependencyTests-1848094913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0ea1f76-83e8-493d-825b-a47c6f642af4.info" returned: 0 in 0.398s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:56:48 devstack sudo[97389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c Sep 04 17:56:48 devstack sudo[97389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:56:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0d3d652e-cd9b-4316-ac1d-de914b196f72 tempest-SnapshotDependencyTests-1848094913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.172s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:56:48 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-0d3d652e-cd9b-4316-ac1d-de914b196f72 tempest-SnapshotDependencyTests-1848094913 None] Create snapshot completed successfully Sep 04 17:56:48 devstack sudo[97389]: pam_unix(sudo:session): session closed for user root Sep 04 17:56:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ff8b421a-1206-41d7-a0df-37ec9e01d8d0 tempest-GroupSnapshotsTest-1632469284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c" returned: 0 in 0.487s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:56:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ff8b421a-1206-41d7-a0df-37ec9e01d8d0 tempest-GroupSnapshotsTest-1632469284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:56:48 devstack sudo[97395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c Sep 04 17:56:48 devstack sudo[97395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:56:48 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-34517df6-0806-4f94-8dcb-b7e1be29ee36 tempest-AttachVolumeShelveTestJSON-1130860107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:56:48 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-34517df6-0806-4f94-8dcb-b7e1be29ee36 tempest-AttachVolumeShelveTestJSON-1130860107 None] Flow 'volume_create_manager' (cdc72883-405a-40c0-a8f1-3aad0664f593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:56:48 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-34517df6-0806-4f94-8dcb-b7e1be29ee36 tempest-AttachVolumeShelveTestJSON-1130860107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76a60b55-31f7-4866-8154-00c671b10ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:56:48 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-34517df6-0806-4f94-8dcb-b7e1be29ee36 tempest-AttachVolumeShelveTestJSON-1130860107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76a60b55-31f7-4866-8154-00c671b10ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:56:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1717932623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=391c7c53-9752-48ce-80cf-5a132a172ed0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33c73ee22ff240b1b5e63b1859c13390',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:56:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:56:49Z,use_quota=True,user_id='bdca4d56576b4079a29adb66211dae8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:56:48 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-34517df6-0806-4f94-8dcb-b7e1be29ee36 tempest-AttachVolumeShelveTestJSON-1130860107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b515a6cd-0f3a-45f7-a750-74ce95b8ac0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:56:48 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-34517df6-0806-4f94-8dcb-b7e1be29ee36 tempest-AttachVolumeShelveTestJSON-1130860107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b515a6cd-0f3a-45f7-a750-74ce95b8ac0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:56:48 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-34517df6-0806-4f94-8dcb-b7e1be29ee36 tempest-AttachVolumeShelveTestJSON-1130860107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e65512fe-4a7f-4926-9a55-e52a2b672627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:56:48 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-34517df6-0806-4f94-8dcb-b7e1be29ee36 tempest-AttachVolumeShelveTestJSON-1130860107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e65512fe-4a7f-4926-9a55-e52a2b672627) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '391c7c53-9752-48ce-80cf-5a132a172ed0', 'volume_name': 'volume-391c7c53-9752-48ce-80cf-5a132a172ed0', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:56:48 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-34517df6-0806-4f94-8dcb-b7e1be29ee36 tempest-AttachVolumeShelveTestJSON-1130860107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a63779c-62a6-47a8-b70b-ae4c8f0d5ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:56:48 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-34517df6-0806-4f94-8dcb-b7e1be29ee36 tempest-AttachVolumeShelveTestJSON-1130860107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a63779c-62a6-47a8-b70b-ae4c8f0d5ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:56:48 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-34517df6-0806-4f94-8dcb-b7e1be29ee36 tempest-AttachVolumeShelveTestJSON-1130860107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87016194-d274-44c6-aaa2-d9c5bfe91f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:56:48 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-34517df6-0806-4f94-8dcb-b7e1be29ee36 tempest-AttachVolumeShelveTestJSON-1130860107 None] Volume 391c7c53-9752-48ce-80cf-5a132a172ed0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-391c7c53-9752-48ce-80cf-5a132a172ed0', 'volume_size': 1} Sep 04 17:56:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-34517df6-0806-4f94-8dcb-b7e1be29ee36 tempest-AttachVolumeShelveTestJSON-1130860107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:56:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-34517df6-0806-4f94-8dcb-b7e1be29ee36 tempest-AttachVolumeShelveTestJSON-1130860107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:56:48 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-34517df6-0806-4f94-8dcb-b7e1be29ee36 tempest-AttachVolumeShelveTestJSON-1130860107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:56:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1717932623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=391c7c53-9752-48ce-80cf-5a132a172ed0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33c73ee22ff240b1b5e63b1859c13390',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:56:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:56:49Z,use_quota=True,user_id='bdca4d56576b4079a29adb66211dae8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:56:48 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-34517df6-0806-4f94-8dcb-b7e1be29ee36 tempest-AttachVolumeShelveTestJSON-1130860107 None] Creating volume 391c7c53-9752-48ce-80cf-5a132a172ed0 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:56:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-34517df6-0806-4f94-8dcb-b7e1be29ee36 tempest-AttachVolumeShelveTestJSON-1130860107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:56:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-34517df6-0806-4f94-8dcb-b7e1be29ee36 tempest-AttachVolumeShelveTestJSON-1130860107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:56:48 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-34517df6-0806-4f94-8dcb-b7e1be29ee36 tempest-AttachVolumeShelveTestJSON-1130860107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:56:48 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-34517df6-0806-4f94-8dcb-b7e1be29ee36 tempest-AttachVolumeShelveTestJSON-1130860107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:56:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-34517df6-0806-4f94-8dcb-b7e1be29ee36 tempest-AttachVolumeShelveTestJSON-1130860107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:56:48 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-34517df6-0806-4f94-8dcb-b7e1be29ee36 tempest-AttachVolumeShelveTestJSON-1130860107 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:56:48 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-34517df6-0806-4f94-8dcb-b7e1be29ee36 tempest-AttachVolumeShelveTestJSON-1130860107 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:56:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-34517df6-0806-4f94-8dcb-b7e1be29ee36 tempest-AttachVolumeShelveTestJSON-1130860107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-391c7c53-9752-48ce-80cf-5a132a172ed0 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:56:48 devstack sudo[97397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-391c7c53-9752-48ce-80cf-5a132a172ed0 1073741824 Sep 04 17:56:48 devstack sudo[97397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:56:49 devstack sudo[97395]: pam_unix(sudo:session): session closed for user root Sep 04 17:56:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ff8b421a-1206-41d7-a0df-37ec9e01d8d0 tempest-GroupSnapshotsTest-1632469284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c" returned: 0 in 0.254s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:56:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ff8b421a-1206-41d7-a0df-37ec9e01d8d0 tempest-GroupSnapshotsTest-1632469284 None] Lock "cinder-quobyte-2a5aa797-2b98-4d50-8bee-a2fa4e10ce2c" released by "delete_volume" :: held 0.833s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:56:49 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-ff8b421a-1206-41d7-a0df-37ec9e01d8d0 tempest-GroupSnapshotsTest-1632469284 None] Created reservations ['2d7d6112-18b9-46bf-bed3-2317b826b233'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:56:49 devstack cinder-volume[87314]: WARNING cinder.db.api [None req-ff8b421a-1206-41d7-a0df-37ec9e01d8d0 tempest-GroupSnapshotsTest-1632469284 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-521799476'] Sep 04 17:56:49 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-ff8b421a-1206-41d7-a0df-37ec9e01d8d0 tempest-GroupSnapshotsTest-1632469284 None] Created reservations ['001b83f6-372c-4c33-8cd2-9c3b9e0569ff', 'ed163205-6f79-432b-b46e-f31870e368f0', 'a49499a0-2654-4f7b-b520-edde868bf1fc', '1c2c4f83-3544-417d-ab3f-ba933b9dfa9f'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:56:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ff8b421a-1206-41d7-a0df-37ec9e01d8d0 tempest-GroupSnapshotsTest-1632469284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:56:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ff8b421a-1206-41d7-a0df-37ec9e01d8d0 tempest-GroupSnapshotsTest-1632469284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:56:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ff8b421a-1206-41d7-a0df-37ec9e01d8d0 tempest-GroupSnapshotsTest-1632469284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:56:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ff8b421a-1206-41d7-a0df-37ec9e01d8d0 tempest-GroupSnapshotsTest-1632469284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:56:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ff8b421a-1206-41d7-a0df-37ec9e01d8d0 tempest-GroupSnapshotsTest-1632469284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:56:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ff8b421a-1206-41d7-a0df-37ec9e01d8d0 tempest-GroupSnapshotsTest-1632469284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:56:49 devstack sudo[97404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:56:49 devstack sudo[97404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:56:49 devstack sudo[97397]: pam_unix(sudo:session): session closed for user root Sep 04 17:56:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-34517df6-0806-4f94-8dcb-b7e1be29ee36 tempest-AttachVolumeShelveTestJSON-1130860107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-391c7c53-9752-48ce-80cf-5a132a172ed0 1073741824" returned: 0 in 0.484s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:56:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-34517df6-0806-4f94-8dcb-b7e1be29ee36 tempest-AttachVolumeShelveTestJSON-1130860107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-391c7c53-9752-48ce-80cf-5a132a172ed0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:56:49 devstack sudo[97406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-391c7c53-9752-48ce-80cf-5a132a172ed0 Sep 04 17:56:49 devstack sudo[97406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:56:49 devstack sudo[97404]: pam_unix(sudo:session): session closed for user root Sep 04 17:56:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ff8b421a-1206-41d7-a0df-37ec9e01d8d0 tempest-GroupSnapshotsTest-1632469284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.401s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:56:49 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-ff8b421a-1206-41d7-a0df-37ec9e01d8d0 tempest-GroupSnapshotsTest-1632469284 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:56:49 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-ff8b421a-1206-41d7-a0df-37ec9e01d8d0 tempest-GroupSnapshotsTest-1632469284 None] Delete group completed successfully. Sep 04 17:56:49 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f43fa2d-cce0-4b70-bbed-b12645cf15e5 tempest-VolumesActionsTest-4714917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:56:49 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9f43fa2d-cce0-4b70-bbed-b12645cf15e5 tempest-VolumesActionsTest-4714917 None] Flow 'volume_create_manager' (5f9f359d-9007-4a11-b2a7-998976dcdf60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:56:49 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9f43fa2d-cce0-4b70-bbed-b12645cf15e5 tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1a09fa8-78d1-4063-b4a8-66b0babf6f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:56:49 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9f43fa2d-cce0-4b70-bbed-b12645cf15e5 tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1a09fa8-78d1-4063-b4a8-66b0babf6f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:56:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-406964906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f4f21ce-37b5-40ec-8944-52b424b5da40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38378c3abbf14ff4955c45d1c327ad3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:56:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:56:50Z,use_quota=True,user_id='875b51464a33490b8c4a2405e23a4980',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:56:49 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9f43fa2d-cce0-4b70-bbed-b12645cf15e5 tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46b6b343-4246-43fd-89ca-721601cb1533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:56:49 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9f43fa2d-cce0-4b70-bbed-b12645cf15e5 tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46b6b343-4246-43fd-89ca-721601cb1533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:56:49 devstack sudo[97406]: pam_unix(sudo:session): session closed for user root Sep 04 17:56:49 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9f43fa2d-cce0-4b70-bbed-b12645cf15e5 tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af6a0ff3-7c20-4264-b6b8-38823eadcffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:56:49 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9f43fa2d-cce0-4b70-bbed-b12645cf15e5 tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af6a0ff3-7c20-4264-b6b8-38823eadcffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f4f21ce-37b5-40ec-8944-52b424b5da40', 'volume_name': 'volume-7f4f21ce-37b5-40ec-8944-52b424b5da40', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:56:49 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9f43fa2d-cce0-4b70-bbed-b12645cf15e5 tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bad07ad8-0144-47df-9879-5b19113348ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:56:49 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9f43fa2d-cce0-4b70-bbed-b12645cf15e5 tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bad07ad8-0144-47df-9879-5b19113348ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:56:49 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9f43fa2d-cce0-4b70-bbed-b12645cf15e5 tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ef63366-3094-49be-87dc-c346d39a4b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:56:49 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-9f43fa2d-cce0-4b70-bbed-b12645cf15e5 tempest-VolumesActionsTest-4714917 None] Volume 7f4f21ce-37b5-40ec-8944-52b424b5da40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f4f21ce-37b5-40ec-8944-52b424b5da40', 'volume_size': 1} Sep 04 17:56:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9f43fa2d-cce0-4b70-bbed-b12645cf15e5 tempest-VolumesActionsTest-4714917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:56:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-34517df6-0806-4f94-8dcb-b7e1be29ee36 tempest-AttachVolumeShelveTestJSON-1130860107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-391c7c53-9752-48ce-80cf-5a132a172ed0" returned: 0 in 0.391s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:56:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-34517df6-0806-4f94-8dcb-b7e1be29ee36 tempest-AttachVolumeShelveTestJSON-1130860107 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:56:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-34517df6-0806-4f94-8dcb-b7e1be29ee36 tempest-AttachVolumeShelveTestJSON-1130860107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:56:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9f43fa2d-cce0-4b70-bbed-b12645cf15e5 tempest-VolumesActionsTest-4714917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:56:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9f43fa2d-cce0-4b70-bbed-b12645cf15e5 tempest-VolumesActionsTest-4714917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:56:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-406964906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f4f21ce-37b5-40ec-8944-52b424b5da40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38378c3abbf14ff4955c45d1c327ad3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:56:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:56:50Z,use_quota=True,user_id='875b51464a33490b8c4a2405e23a4980',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:56:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-9f43fa2d-cce0-4b70-bbed-b12645cf15e5 tempest-VolumesActionsTest-4714917 None] Creating volume 7f4f21ce-37b5-40ec-8944-52b424b5da40 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:56:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9f43fa2d-cce0-4b70-bbed-b12645cf15e5 tempest-VolumesActionsTest-4714917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:56:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9f43fa2d-cce0-4b70-bbed-b12645cf15e5 tempest-VolumesActionsTest-4714917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:56:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9f43fa2d-cce0-4b70-bbed-b12645cf15e5 tempest-VolumesActionsTest-4714917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:56:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9f43fa2d-cce0-4b70-bbed-b12645cf15e5 tempest-VolumesActionsTest-4714917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:56:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9f43fa2d-cce0-4b70-bbed-b12645cf15e5 tempest-VolumesActionsTest-4714917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:56:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9f43fa2d-cce0-4b70-bbed-b12645cf15e5 tempest-VolumesActionsTest-4714917 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:56:49 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-9f43fa2d-cce0-4b70-bbed-b12645cf15e5 tempest-VolumesActionsTest-4714917 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:56:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9f43fa2d-cce0-4b70-bbed-b12645cf15e5 tempest-VolumesActionsTest-4714917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7f4f21ce-37b5-40ec-8944-52b424b5da40 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:56:49 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-34517df6-0806-4f94-8dcb-b7e1be29ee36 tempest-AttachVolumeShelveTestJSON-1130860107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87016194-d274-44c6-aaa2-d9c5bfe91f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-391c7c53-9752-48ce-80cf-5a132a172ed0', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:56:49 devstack sudo[97410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7f4f21ce-37b5-40ec-8944-52b424b5da40 1073741824 Sep 04 17:56:49 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-34517df6-0806-4f94-8dcb-b7e1be29ee36 tempest-AttachVolumeShelveTestJSON-1130860107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da9560bd-3cd6-4663-937f-793efba6e26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:56:49 devstack sudo[97410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:56:49 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-34517df6-0806-4f94-8dcb-b7e1be29ee36 tempest-AttachVolumeShelveTestJSON-1130860107 None] Volume volume-391c7c53-9752-48ce-80cf-5a132a172ed0 (391c7c53-9752-48ce-80cf-5a132a172ed0): created successfully Sep 04 17:56:49 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-34517df6-0806-4f94-8dcb-b7e1be29ee36 tempest-AttachVolumeShelveTestJSON-1130860107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da9560bd-3cd6-4663-937f-793efba6e26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:56:49 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-34517df6-0806-4f94-8dcb-b7e1be29ee36 tempest-AttachVolumeShelveTestJSON-1130860107 None] Flow 'volume_create_manager' (cdc72883-405a-40c0-a8f1-3aad0664f593) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:56:49 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-34517df6-0806-4f94-8dcb-b7e1be29ee36 tempest-AttachVolumeShelveTestJSON-1130860107 None] Created volume successfully. Sep 04 17:56:50 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-e64f4521-c528-4e59-8e00-69f6f4d18ca9 tempest-GroupSnapshotsTest-1632469284 None] Group tempest-GroupSnapshotsTest-Group-412743158: creating Sep 04 17:56:50 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-e64f4521-c528-4e59-8e00-69f6f4d18ca9 tempest-GroupSnapshotsTest-1632469284 None] Group tempest-GroupSnapshotsTest-Group-412743158: created successfully Sep 04 17:56:50 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-e64f4521-c528-4e59-8e00-69f6f4d18ca9 tempest-GroupSnapshotsTest-1632469284 None] Create group completed successfully. Sep 04 17:56:50 devstack sudo[97410]: pam_unix(sudo:session): session closed for user root Sep 04 17:56:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9f43fa2d-cce0-4b70-bbed-b12645cf15e5 tempest-VolumesActionsTest-4714917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7f4f21ce-37b5-40ec-8944-52b424b5da40 1073741824" returned: 0 in 0.495s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:56:50 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1e3af2a-053d-4e61-8262-caa5dcf5cb21 tempest-SnapshotDependencyTests-1848094913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:56:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a1e3af2a-053d-4e61-8262-caa5dcf5cb21 tempest-SnapshotDependencyTests-1848094913 None] Flow 'volume_create_manager' (b8e66ef3-7b25-4fd1-969e-f4132e2ec6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:56:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a1e3af2a-053d-4e61-8262-caa5dcf5cb21 tempest-SnapshotDependencyTests-1848094913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f93b1cd-472c-4d45-8fdb-677de410040e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:56:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a1e3af2a-053d-4e61-8262-caa5dcf5cb21 tempest-SnapshotDependencyTests-1848094913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f93b1cd-472c-4d45-8fdb-677de410040e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:56:50Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70dd4f87-8b97-48e4-badc-157873398183,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d060d442ced14f99acb17ee5f708a83e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:56:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6bdb2071-2797-4c17-a2bf-48b58bb2e897,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:56:50Z,use_quota=True,user_id='6be7909f142c4e2bad16bb7eaca944ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:56:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a1e3af2a-053d-4e61-8262-caa5dcf5cb21 tempest-SnapshotDependencyTests-1848094913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e27e6f8-eea8-4f10-90dd-41102d9215fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:56:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a1e3af2a-053d-4e61-8262-caa5dcf5cb21 tempest-SnapshotDependencyTests-1848094913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e27e6f8-eea8-4f10-90dd-41102d9215fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:56:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a1e3af2a-053d-4e61-8262-caa5dcf5cb21 tempest-SnapshotDependencyTests-1848094913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9898bcc-81c6-474d-a3c8-c0ae8f41b140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:56:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a1e3af2a-053d-4e61-8262-caa5dcf5cb21 tempest-SnapshotDependencyTests-1848094913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9898bcc-81c6-474d-a3c8-c0ae8f41b140) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '70dd4f87-8b97-48e4-badc-157873398183', 'volume_name': 'volume-70dd4f87-8b97-48e4-badc-157873398183', 'volume_size': 1, 'snapshot_id': '6bdb2071-2797-4c17-a2bf-48b58bb2e897'}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:56:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a1e3af2a-053d-4e61-8262-caa5dcf5cb21 tempest-SnapshotDependencyTests-1848094913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42f0ea8c-1f98-4a26-bdb9-3e0132821fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:56:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a1e3af2a-053d-4e61-8262-caa5dcf5cb21 tempest-SnapshotDependencyTests-1848094913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42f0ea8c-1f98-4a26-bdb9-3e0132821fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:56:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a1e3af2a-053d-4e61-8262-caa5dcf5cb21 tempest-SnapshotDependencyTests-1848094913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff1aedf4-1ced-49a4-9461-5b310a9644c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:56:50 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-a1e3af2a-053d-4e61-8262-caa5dcf5cb21 tempest-SnapshotDependencyTests-1848094913 None] Volume 70dd4f87-8b97-48e4-badc-157873398183: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-70dd4f87-8b97-48e4-badc-157873398183', 'volume_size': 1, 'snapshot_id': '6bdb2071-2797-4c17-a2bf-48b58bb2e897'} Sep 04 17:56:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9f43fa2d-cce0-4b70-bbed-b12645cf15e5 tempest-VolumesActionsTest-4714917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7f4f21ce-37b5-40ec-8944-52b424b5da40 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:56:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a1e3af2a-053d-4e61-8262-caa5dcf5cb21 tempest-SnapshotDependencyTests-1848094913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:56:50 devstack sudo[97417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7f4f21ce-37b5-40ec-8944-52b424b5da40 Sep 04 17:56:50 devstack sudo[97417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:56:50 devstack sudo[97417]: pam_unix(sudo:session): session closed for user root Sep 04 17:56:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9f43fa2d-cce0-4b70-bbed-b12645cf15e5 tempest-VolumesActionsTest-4714917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7f4f21ce-37b5-40ec-8944-52b424b5da40" returned: 0 in 0.249s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:56:50 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9f43fa2d-cce0-4b70-bbed-b12645cf15e5 tempest-VolumesActionsTest-4714917 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:56:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9f43fa2d-cce0-4b70-bbed-b12645cf15e5 tempest-VolumesActionsTest-4714917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:56:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a1e3af2a-053d-4e61-8262-caa5dcf5cb21 tempest-SnapshotDependencyTests-1848094913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.238s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:56:50 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a1e3af2a-053d-4e61-8262-caa5dcf5cb21 tempest-SnapshotDependencyTests-1848094913 None] Acquiring lock "cinder-quobyte-6bdb2071-2797-4c17-a2bf-48b58bb2e897-70dd4f87-8b97-48e4-badc-157873398183" by "_create_volume_from_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:56:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9f43fa2d-cce0-4b70-bbed-b12645cf15e5 tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ef63366-3094-49be-87dc-c346d39a4b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f4f21ce-37b5-40ec-8944-52b424b5da40', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:56:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9f43fa2d-cce0-4b70-bbed-b12645cf15e5 tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e505b96b-4363-4ea5-9c9e-469c6996ac65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:56:50 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a1e3af2a-053d-4e61-8262-caa5dcf5cb21 tempest-SnapshotDependencyTests-1848094913 None] Lock "cinder-quobyte-6bdb2071-2797-4c17-a2bf-48b58bb2e897-70dd4f87-8b97-48e4-badc-157873398183" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:56:50 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a1e3af2a-053d-4e61-8262-caa5dcf5cb21 tempest-SnapshotDependencyTests-1848094913 None] Creating volume 70dd4f87-8b97-48e4-badc-157873398183 from snapshot 6bdb2071-2797-4c17-a2bf-48b58bb2e897 {{(pid=87314) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 04 17:56:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a1e3af2a-053d-4e61-8262-caa5dcf5cb21 tempest-SnapshotDependencyTests-1848094913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:56:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a1e3af2a-053d-4e61-8262-caa5dcf5cb21 tempest-SnapshotDependencyTests-1848094913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:56:50 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a1e3af2a-053d-4e61-8262-caa5dcf5cb21 tempest-SnapshotDependencyTests-1848094913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:56:50 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a1e3af2a-053d-4e61-8262-caa5dcf5cb21 tempest-SnapshotDependencyTests-1848094913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:56:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a1e3af2a-053d-4e61-8262-caa5dcf5cb21 tempest-SnapshotDependencyTests-1848094913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:56:50 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a1e3af2a-053d-4e61-8262-caa5dcf5cb21 tempest-SnapshotDependencyTests-1848094913 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:56:50 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a1e3af2a-053d-4e61-8262-caa5dcf5cb21 tempest-SnapshotDependencyTests-1848094913 None] Acquiring lock "cinder-quobyte-70dd4f87-8b97-48e4-badc-157873398183" by "_copy_volume_from_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:56:50 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-9f43fa2d-cce0-4b70-bbed-b12645cf15e5 tempest-VolumesActionsTest-4714917 None] Volume volume-7f4f21ce-37b5-40ec-8944-52b424b5da40 (7f4f21ce-37b5-40ec-8944-52b424b5da40): created successfully Sep 04 17:56:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9f43fa2d-cce0-4b70-bbed-b12645cf15e5 tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e505b96b-4363-4ea5-9c9e-469c6996ac65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:56:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9f43fa2d-cce0-4b70-bbed-b12645cf15e5 tempest-VolumesActionsTest-4714917 None] Flow 'volume_create_manager' (5f9f359d-9007-4a11-b2a7-998976dcdf60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:56:50 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a1e3af2a-053d-4e61-8262-caa5dcf5cb21 tempest-SnapshotDependencyTests-1848094913 None] Lock "cinder-quobyte-70dd4f87-8b97-48e4-badc-157873398183" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:56:50 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a1e3af2a-053d-4e61-8262-caa5dcf5cb21 tempest-SnapshotDependencyTests-1848094913 None] snapshot: 6bdb2071-2797-4c17-a2bf-48b58bb2e897, volume: 70dd4f87-8b97-48e4-badc-157873398183, {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 04 17:56:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a1e3af2a-053d-4e61-8262-caa5dcf5cb21 tempest-SnapshotDependencyTests-1848094913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:56:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a1e3af2a-053d-4e61-8262-caa5dcf5cb21 tempest-SnapshotDependencyTests-1848094913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:56:50 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a1e3af2a-053d-4e61-8262-caa5dcf5cb21 tempest-SnapshotDependencyTests-1848094913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:56:50 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a1e3af2a-053d-4e61-8262-caa5dcf5cb21 tempest-SnapshotDependencyTests-1848094913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:56:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a1e3af2a-053d-4e61-8262-caa5dcf5cb21 tempest-SnapshotDependencyTests-1848094913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:56:50 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-9f43fa2d-cce0-4b70-bbed-b12645cf15e5 tempest-VolumesActionsTest-4714917 None] Created volume successfully. Sep 04 17:56:50 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86c04ed-b835-49c2-b980-d6923385135a]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:56:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a1e3af2a-053d-4e61-8262-caa5dcf5cb21 tempest-SnapshotDependencyTests-1848094913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0ea1f76-83e8-493d-825b-a47c6f642af4.6bdb2071-2797-4c17-a2bf-48b58bb2e897 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:56:50 devstack sudo[97420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0ea1f76-83e8-493d-825b-a47c6f642af4.6bdb2071-2797-4c17-a2bf-48b58bb2e897 Sep 04 17:56:50 devstack sudo[97420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:56:51 devstack sudo[97420]: pam_unix(sudo:session): session closed for user root Sep 04 17:56:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a1e3af2a-053d-4e61-8262-caa5dcf5cb21 tempest-SnapshotDependencyTests-1848094913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0ea1f76-83e8-493d-825b-a47c6f642af4.6bdb2071-2797-4c17-a2bf-48b58bb2e897" returned: 0 in 0.385s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:56:51 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-a1e3af2a-053d-4e61-8262-caa5dcf5cb21 tempest-SnapshotDependencyTests-1848094913 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0ea1f76-83e8-493d-825b-a47c6f642af4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 17:56:51 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7c1052-3527-4e93-88a6-0e3b1d4cf120]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:56:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a1e3af2a-053d-4e61-8262-caa5dcf5cb21 tempest-SnapshotDependencyTests-1848094913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0ea1f76-83e8-493d-825b-a47c6f642af4 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:56:51 devstack sudo[97429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0ea1f76-83e8-493d-825b-a47c6f642af4 Sep 04 17:56:51 devstack sudo[97429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:56:51 devstack sudo[97429]: pam_unix(sudo:session): session closed for user root Sep 04 17:56:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a1e3af2a-053d-4e61-8262-caa5dcf5cb21 tempest-SnapshotDependencyTests-1848094913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0ea1f76-83e8-493d-825b-a47c6f642af4" returned: 0 in 0.513s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:56:51 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a1e3af2a-053d-4e61-8262-caa5dcf5cb21 tempest-SnapshotDependencyTests-1848094913 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0ea1f76-83e8-493d-825b-a47c6f642af4 {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 04 17:56:51 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a1e3af2a-053d-4e61-8262-caa5dcf5cb21 tempest-SnapshotDependencyTests-1848094913 None] Creating direct copy from snapshot {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 04 17:56:51 devstack cinder-volume[87314]: DEBUG cinder.utils [None req-a1e3af2a-053d-4e61-8262-caa5dcf5cb21 tempest-SnapshotDependencyTests-1848094913 None] Path /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-70dd4f87-8b97-48e4-badc-157873398183 not found in is_blk_device check {{(pid=87314) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 04 17:56:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a1e3af2a-053d-4e61-8262-caa5dcf5cb21 tempest-SnapshotDependencyTests-1848094913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0ea1f76-83e8-493d-825b-a47c6f642af4 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-70dd4f87-8b97-48e4-badc-157873398183 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:56:51 devstack sudo[97434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0ea1f76-83e8-493d-825b-a47c6f642af4 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-70dd4f87-8b97-48e4-badc-157873398183 Sep 04 17:56:51 devstack sudo[97434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:56:51 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-d663a836-825c-45af-b08d-2a644e106851 tempest-GroupSnapshotsTest-1632469284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:56:51 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d663a836-825c-45af-b08d-2a644e106851 tempest-GroupSnapshotsTest-1632469284 None] Flow 'volume_create_manager' (c0bacb68-2e29-46f7-b99e-6fecf4b65781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:56:51 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d663a836-825c-45af-b08d-2a644e106851 tempest-GroupSnapshotsTest-1632469284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4098c7da-2626-4043-b936-2b8ff0a49a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:56:51 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d663a836-825c-45af-b08d-2a644e106851 tempest-GroupSnapshotsTest-1632469284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4098c7da-2626-4043-b936-2b8ff0a49a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:56:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-3931188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b9706474-f7bd-47ee-8397-62b120c81c16,host='devstack@QuobyteHD#QuobyteHD',id=6727c47f-2920-4a08-b13c-b35a469a5134,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b90a7a1d394b4293aa22af639974cdd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:56:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:56:52Z,use_quota=True,user_id='2deecbeab20243e89090df54531c8db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1b5c55c3-ba23-4468-b997-75fd857bce0c),volume_type_id=1b5c55c3-ba23-4468-b997-75fd857bce0c)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:56:52 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d663a836-825c-45af-b08d-2a644e106851 tempest-GroupSnapshotsTest-1632469284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (446b99a1-2428-4100-bf4b-f46856bd88e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:56:52 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d663a836-825c-45af-b08d-2a644e106851 tempest-GroupSnapshotsTest-1632469284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (446b99a1-2428-4100-bf4b-f46856bd88e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:56:52 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d663a836-825c-45af-b08d-2a644e106851 tempest-GroupSnapshotsTest-1632469284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b57b2c1-4ef7-4f63-9aae-65fb7f30d1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:56:52 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d663a836-825c-45af-b08d-2a644e106851 tempest-GroupSnapshotsTest-1632469284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b57b2c1-4ef7-4f63-9aae-65fb7f30d1eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6727c47f-2920-4a08-b13c-b35a469a5134', 'volume_name': 'volume-6727c47f-2920-4a08-b13c-b35a469a5134', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:56:52 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d663a836-825c-45af-b08d-2a644e106851 tempest-GroupSnapshotsTest-1632469284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a952176e-0d36-4643-b0b4-43c4af2704a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:56:52 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d663a836-825c-45af-b08d-2a644e106851 tempest-GroupSnapshotsTest-1632469284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a952176e-0d36-4643-b0b4-43c4af2704a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:56:52 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d663a836-825c-45af-b08d-2a644e106851 tempest-GroupSnapshotsTest-1632469284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1428325-1618-4c14-8642-93b5568c0d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:56:52 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-d663a836-825c-45af-b08d-2a644e106851 tempest-GroupSnapshotsTest-1632469284 None] Volume 6727c47f-2920-4a08-b13c-b35a469a5134: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6727c47f-2920-4a08-b13c-b35a469a5134', 'volume_size': 1} Sep 04 17:56:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d663a836-825c-45af-b08d-2a644e106851 tempest-GroupSnapshotsTest-1632469284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:56:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f6ea6c2d-9838-4f18-bf5a-381eac14d5e2 tempest-VolumesActionsTest-852108199 None] Acquiring lock "cinder-7f4f21ce-37b5-40ec-8944-52b424b5da40-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:56:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f6ea6c2d-9838-4f18-bf5a-381eac14d5e2 tempest-VolumesActionsTest-852108199 None] Lock "cinder-7f4f21ce-37b5-40ec-8944-52b424b5da40-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:56:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f6ea6c2d-9838-4f18-bf5a-381eac14d5e2 tempest-VolumesActionsTest-852108199 None] Acquiring lock "cinder-quobyte-7f4f21ce-37b5-40ec-8944-52b424b5da40" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:56:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f6ea6c2d-9838-4f18-bf5a-381eac14d5e2 tempest-VolumesActionsTest-852108199 None] Lock "cinder-quobyte-7f4f21ce-37b5-40ec-8944-52b424b5da40" acquired by "delete_volume" :: waited 0.017s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:56:52 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[333f8f26-793e-4a37-b43c-136128f857fd]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:56:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f6ea6c2d-9838-4f18-bf5a-381eac14d5e2 tempest-VolumesActionsTest-852108199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7f4f21ce-37b5-40ec-8944-52b424b5da40 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:56:52 devstack sudo[97439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7f4f21ce-37b5-40ec-8944-52b424b5da40 Sep 04 17:56:52 devstack sudo[97439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:56:52 devstack sudo[97439]: pam_unix(sudo:session): session closed for user root Sep 04 17:56:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f6ea6c2d-9838-4f18-bf5a-381eac14d5e2 tempest-VolumesActionsTest-852108199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7f4f21ce-37b5-40ec-8944-52b424b5da40" returned: 0 in 0.830s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:56:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f6ea6c2d-9838-4f18-bf5a-381eac14d5e2 tempest-VolumesActionsTest-852108199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7f4f21ce-37b5-40ec-8944-52b424b5da40 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:56:53 devstack sudo[97456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7f4f21ce-37b5-40ec-8944-52b424b5da40 Sep 04 17:56:53 devstack sudo[97456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:56:53 devstack sudo[97456]: pam_unix(sudo:session): session closed for user root Sep 04 17:56:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f6ea6c2d-9838-4f18-bf5a-381eac14d5e2 tempest-VolumesActionsTest-852108199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7f4f21ce-37b5-40ec-8944-52b424b5da40" returned: 0 in 0.572s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:56:53 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f6ea6c2d-9838-4f18-bf5a-381eac14d5e2 tempest-VolumesActionsTest-852108199 None] Lock "cinder-quobyte-7f4f21ce-37b5-40ec-8944-52b424b5da40" released by "delete_volume" :: held 1.482s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:56:53 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-f6ea6c2d-9838-4f18-bf5a-381eac14d5e2 tempest-VolumesActionsTest-852108199 None] Created reservations ['3a75eee1-0865-4712-91b4-5d80b8a59336', 'e477bc3d-a280-4e7d-b40e-e4ccf9363c5a', 'a66f2ac6-92ee-4997-b1af-2b16b106c7d8', 'd8eaadc0-389a-4a2f-9ddc-6dedfabf11a9'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:56:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f6ea6c2d-9838-4f18-bf5a-381eac14d5e2 tempest-VolumesActionsTest-852108199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:56:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f6ea6c2d-9838-4f18-bf5a-381eac14d5e2 tempest-VolumesActionsTest-852108199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:56:54 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f6ea6c2d-9838-4f18-bf5a-381eac14d5e2 tempest-VolumesActionsTest-852108199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:56:54 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f6ea6c2d-9838-4f18-bf5a-381eac14d5e2 tempest-VolumesActionsTest-852108199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:56:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f6ea6c2d-9838-4f18-bf5a-381eac14d5e2 tempest-VolumesActionsTest-852108199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:56:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f6ea6c2d-9838-4f18-bf5a-381eac14d5e2 tempest-VolumesActionsTest-852108199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:56:54 devstack sudo[97466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:56:54 devstack sudo[97466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:56:54 devstack sudo[97466]: pam_unix(sudo:session): session closed for user root Sep 04 17:56:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f6ea6c2d-9838-4f18-bf5a-381eac14d5e2 tempest-VolumesActionsTest-852108199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.728s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:56:54 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-f6ea6c2d-9838-4f18-bf5a-381eac14d5e2 tempest-VolumesActionsTest-852108199 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:56:54 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-f6ea6c2d-9838-4f18-bf5a-381eac14d5e2 tempest-VolumesActionsTest-852108199 None] Deleted volume successfully. Sep 04 17:56:54 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f6ea6c2d-9838-4f18-bf5a-381eac14d5e2 tempest-VolumesActionsTest-852108199 None] Lock "cinder-7f4f21ce-37b5-40ec-8944-52b424b5da40-delete_volume" released by "delete_volume" :: held 2.763s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:56:55 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-62e62d9e-042a-420f-8b89-6b30d13fcfed tempest-VolumesActionsTest-4714917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:56:55 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-62e62d9e-042a-420f-8b89-6b30d13fcfed tempest-VolumesActionsTest-4714917 None] Flow 'volume_create_manager' (34f3bfad-6134-4a5a-aace-e916ff28f1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:56:55 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-62e62d9e-042a-420f-8b89-6b30d13fcfed tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b258185-d0a0-4261-a580-a79242c2d7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:56:55 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-62e62d9e-042a-420f-8b89-6b30d13fcfed tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b258185-d0a0-4261-a580-a79242c2d7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:56:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1731546493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=225f3fd5-1a36-4834-95ef-9f3309d85737,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38378c3abbf14ff4955c45d1c327ad3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:56:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:56:56Z,use_quota=True,user_id='875b51464a33490b8c4a2405e23a4980',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:56:55 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-62e62d9e-042a-420f-8b89-6b30d13fcfed tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3976195a-e54a-43ad-80a5-9a9c9b44524a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:56:55 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-62e62d9e-042a-420f-8b89-6b30d13fcfed tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3976195a-e54a-43ad-80a5-9a9c9b44524a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:56:55 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-62e62d9e-042a-420f-8b89-6b30d13fcfed tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6c349ad-5217-49eb-b9de-ada8a16da3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:56:55 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-62e62d9e-042a-420f-8b89-6b30d13fcfed tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6c349ad-5217-49eb-b9de-ada8a16da3ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '225f3fd5-1a36-4834-95ef-9f3309d85737', 'volume_name': 'volume-225f3fd5-1a36-4834-95ef-9f3309d85737', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:56:55 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-62e62d9e-042a-420f-8b89-6b30d13fcfed tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65a5705f-66cb-4016-8fca-d036d2e43c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:56:55 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-62e62d9e-042a-420f-8b89-6b30d13fcfed tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65a5705f-66cb-4016-8fca-d036d2e43c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:56:55 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-62e62d9e-042a-420f-8b89-6b30d13fcfed tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (340ba064-17c6-4b84-a445-2a9619e77b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:56:55 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-62e62d9e-042a-420f-8b89-6b30d13fcfed tempest-VolumesActionsTest-4714917 None] Volume 225f3fd5-1a36-4834-95ef-9f3309d85737: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-225f3fd5-1a36-4834-95ef-9f3309d85737', 'volume_size': 1} Sep 04 17:56:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-62e62d9e-042a-420f-8b89-6b30d13fcfed tempest-VolumesActionsTest-4714917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:56:57 devstack sudo[97434]: pam_unix(sudo:session): session closed for user root Sep 04 17:56:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a1e3af2a-053d-4e61-8262-caa5dcf5cb21 tempest-SnapshotDependencyTests-1848094913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0ea1f76-83e8-493d-825b-a47c6f642af4 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-70dd4f87-8b97-48e4-badc-157873398183" returned: 0 in 5.959s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:56:57 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-a1e3af2a-053d-4e61-8262-caa5dcf5cb21 tempest-SnapshotDependencyTests-1848094913 None] Image conversion details: src /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0ea1f76-83e8-493d-825b-a47c6f642af4, size 1024.00 MB, duration 5.96 sec, destination /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-70dd4f87-8b97-48e4-badc-157873398183 {{(pid=87314) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 17:56:57 devstack cinder-volume[87314]: INFO cinder.image.image_utils [None req-a1e3af2a-053d-4e61-8262-caa5dcf5cb21 tempest-SnapshotDependencyTests-1848094913 None] Converted 1024.00 MB image at 171.82 MB/s Sep 04 17:56:57 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-a1e3af2a-053d-4e61-8262-caa5dcf5cb21 tempest-SnapshotDependencyTests-1848094913 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-70dd4f87-8b97-48e4-badc-157873398183 is being set with open permissions: ugo+rw Sep 04 17:56:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a1e3af2a-053d-4e61-8262-caa5dcf5cb21 tempest-SnapshotDependencyTests-1848094913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-70dd4f87-8b97-48e4-badc-157873398183 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:56:57 devstack sudo[97471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-70dd4f87-8b97-48e4-badc-157873398183 Sep 04 17:56:57 devstack sudo[97471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:56:58 devstack sudo[97471]: pam_unix(sudo:session): session closed for user root Sep 04 17:56:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a1e3af2a-053d-4e61-8262-caa5dcf5cb21 tempest-SnapshotDependencyTests-1848094913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-70dd4f87-8b97-48e4-badc-157873398183" returned: 0 in 0.242s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:56:58 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a1e3af2a-053d-4e61-8262-caa5dcf5cb21 tempest-SnapshotDependencyTests-1848094913 None] Lock "cinder-quobyte-70dd4f87-8b97-48e4-badc-157873398183" released by "_copy_volume_from_snapshot" :: held 7.200s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:56:58 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a1e3af2a-053d-4e61-8262-caa5dcf5cb21 tempest-SnapshotDependencyTests-1848094913 None] Lock "cinder-quobyte-6bdb2071-2797-4c17-a2bf-48b58bb2e897-70dd4f87-8b97-48e4-badc-157873398183" released by "_create_volume_from_snapshot" :: held 7.271s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:56:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a1e3af2a-053d-4e61-8262-caa5dcf5cb21 tempest-SnapshotDependencyTests-1848094913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.303s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:56:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d663a836-825c-45af-b08d-2a644e106851 tempest-GroupSnapshotsTest-1632469284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.015s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:56:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d663a836-825c-45af-b08d-2a644e106851 tempest-GroupSnapshotsTest-1632469284 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b9706474-f7bd-47ee-8397-62b120c81c16,created_at=2026-09-04T15:56:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-3931188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b9706474-f7bd-47ee-8397-62b120c81c16,host='devstack@QuobyteHD#QuobyteHD',id=6727c47f-2920-4a08-b13c-b35a469a5134,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b90a7a1d394b4293aa22af639974cdd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:56:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:56:52Z,use_quota=True,user_id='2deecbeab20243e89090df54531c8db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1b5c55c3-ba23-4468-b997-75fd857bce0c),volume_type_id=1b5c55c3-ba23-4468-b997-75fd857bce0c)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:56:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-d663a836-825c-45af-b08d-2a644e106851 tempest-GroupSnapshotsTest-1632469284 None] Creating volume 6727c47f-2920-4a08-b13c-b35a469a5134 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:56:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d663a836-825c-45af-b08d-2a644e106851 tempest-GroupSnapshotsTest-1632469284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:56:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d663a836-825c-45af-b08d-2a644e106851 tempest-GroupSnapshotsTest-1632469284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:56:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d663a836-825c-45af-b08d-2a644e106851 tempest-GroupSnapshotsTest-1632469284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:56:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d663a836-825c-45af-b08d-2a644e106851 tempest-GroupSnapshotsTest-1632469284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:56:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d663a836-825c-45af-b08d-2a644e106851 tempest-GroupSnapshotsTest-1632469284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:56:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d663a836-825c-45af-b08d-2a644e106851 tempest-GroupSnapshotsTest-1632469284 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:56:58 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-d663a836-825c-45af-b08d-2a644e106851 tempest-GroupSnapshotsTest-1632469284 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:56:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d663a836-825c-45af-b08d-2a644e106851 tempest-GroupSnapshotsTest-1632469284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6727c47f-2920-4a08-b13c-b35a469a5134 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:56:58 devstack sudo[97474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6727c47f-2920-4a08-b13c-b35a469a5134 1073741824 Sep 04 17:56:58 devstack sudo[97474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:56:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a1e3af2a-053d-4e61-8262-caa5dcf5cb21 tempest-SnapshotDependencyTests-1848094913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff1aedf4-1ced-49a4-9461-5b310a9644c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70dd4f87-8b97-48e4-badc-157873398183', 'volume_size': 1, 'snapshot_id': '6bdb2071-2797-4c17-a2bf-48b58bb2e897'}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:56:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a1e3af2a-053d-4e61-8262-caa5dcf5cb21 tempest-SnapshotDependencyTests-1848094913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46ded497-8ce0-4da3-9647-ced4eb5f3bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:56:58 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-a1e3af2a-053d-4e61-8262-caa5dcf5cb21 tempest-SnapshotDependencyTests-1848094913 None] Volume volume-70dd4f87-8b97-48e4-badc-157873398183 (70dd4f87-8b97-48e4-badc-157873398183): created successfully Sep 04 17:56:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a1e3af2a-053d-4e61-8262-caa5dcf5cb21 tempest-SnapshotDependencyTests-1848094913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46ded497-8ce0-4da3-9647-ced4eb5f3bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:56:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a1e3af2a-053d-4e61-8262-caa5dcf5cb21 tempest-SnapshotDependencyTests-1848094913 None] Flow 'volume_create_manager' (b8e66ef3-7b25-4fd1-969e-f4132e2ec6fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:56:58 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-a1e3af2a-053d-4e61-8262-caa5dcf5cb21 tempest-SnapshotDependencyTests-1848094913 None] Created volume successfully. Sep 04 17:56:58 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2f948ec7-1df1-4e27-8002-5fcf2baff63c tempest-SnapshotDependencyTests-1848094913 None] Acquiring lock "cinder-6bdb2071-2797-4c17-a2bf-48b58bb2e897-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:56:58 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2f948ec7-1df1-4e27-8002-5fcf2baff63c tempest-SnapshotDependencyTests-1848094913 None] Lock "cinder-6bdb2071-2797-4c17-a2bf-48b58bb2e897-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:56:58 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2f948ec7-1df1-4e27-8002-5fcf2baff63c tempest-SnapshotDependencyTests-1848094913 None] Acquiring lock "cinder-quobyte-a0ea1f76-83e8-493d-825b-a47c6f642af4" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:56:58 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2f948ec7-1df1-4e27-8002-5fcf2baff63c tempest-SnapshotDependencyTests-1848094913 None] Lock "cinder-quobyte-a0ea1f76-83e8-493d-825b-a47c6f642af4" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:56:58 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2f948ec7-1df1-4e27-8002-5fcf2baff63c tempest-SnapshotDependencyTests-1848094913 None] Acquiring lock "cinder-quobyte-6bdb2071-2797-4c17-a2bf-48b58bb2e897" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:56:58 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2f948ec7-1df1-4e27-8002-5fcf2baff63c tempest-SnapshotDependencyTests-1848094913 None] Lock "cinder-quobyte-6bdb2071-2797-4c17-a2bf-48b58bb2e897" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:56:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-2f948ec7-1df1-4e27-8002-5fcf2baff63c tempest-SnapshotDependencyTests-1848094913 None] Deleting offline snapshot 6bdb2071-2797-4c17-a2bf-48b58bb2e897 of volume a0ea1f76-83e8-493d-825b-a47c6f642af4 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 17:56:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-2f948ec7-1df1-4e27-8002-5fcf2baff63c tempest-SnapshotDependencyTests-1848094913 None] snapshot_file for this snap is: volume-a0ea1f76-83e8-493d-825b-a47c6f642af4.6bdb2071-2797-4c17-a2bf-48b58bb2e897 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 17:56:58 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1705e8-74ed-4ba8-9d74-9a8fa3ed680e]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:56:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2f948ec7-1df1-4e27-8002-5fcf2baff63c tempest-SnapshotDependencyTests-1848094913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0ea1f76-83e8-493d-825b-a47c6f642af4.6bdb2071-2797-4c17-a2bf-48b58bb2e897 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:56:58 devstack sudo[97474]: pam_unix(sudo:session): session closed for user root Sep 04 17:56:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d663a836-825c-45af-b08d-2a644e106851 tempest-GroupSnapshotsTest-1632469284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6727c47f-2920-4a08-b13c-b35a469a5134 1073741824" returned: 0 in 0.603s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:56:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d663a836-825c-45af-b08d-2a644e106851 tempest-GroupSnapshotsTest-1632469284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6727c47f-2920-4a08-b13c-b35a469a5134 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:56:58 devstack sudo[97480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0ea1f76-83e8-493d-825b-a47c6f642af4.6bdb2071-2797-4c17-a2bf-48b58bb2e897 Sep 04 17:56:58 devstack sudo[97480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:56:58 devstack sudo[97481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6727c47f-2920-4a08-b13c-b35a469a5134 Sep 04 17:56:58 devstack sudo[97481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:56:59 devstack sudo[97481]: pam_unix(sudo:session): session closed for user root Sep 04 17:56:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d663a836-825c-45af-b08d-2a644e106851 tempest-GroupSnapshotsTest-1632469284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6727c47f-2920-4a08-b13c-b35a469a5134" returned: 0 in 0.300s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:56:59 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d663a836-825c-45af-b08d-2a644e106851 tempest-GroupSnapshotsTest-1632469284 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:56:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d663a836-825c-45af-b08d-2a644e106851 tempest-GroupSnapshotsTest-1632469284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:56:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-62e62d9e-042a-420f-8b89-6b30d13fcfed tempest-VolumesActionsTest-4714917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.238s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:56:59 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-62e62d9e-042a-420f-8b89-6b30d13fcfed tempest-VolumesActionsTest-4714917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:56:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1731546493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=225f3fd5-1a36-4834-95ef-9f3309d85737,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38378c3abbf14ff4955c45d1c327ad3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:56:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:56:56Z,use_quota=True,user_id='875b51464a33490b8c4a2405e23a4980',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:56:59 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-62e62d9e-042a-420f-8b89-6b30d13fcfed tempest-VolumesActionsTest-4714917 None] Creating volume 225f3fd5-1a36-4834-95ef-9f3309d85737 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:56:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-62e62d9e-042a-420f-8b89-6b30d13fcfed tempest-VolumesActionsTest-4714917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:56:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-62e62d9e-042a-420f-8b89-6b30d13fcfed tempest-VolumesActionsTest-4714917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:56:59 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-62e62d9e-042a-420f-8b89-6b30d13fcfed tempest-VolumesActionsTest-4714917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:56:59 devstack sudo[97480]: pam_unix(sudo:session): session closed for user root Sep 04 17:56:59 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-62e62d9e-042a-420f-8b89-6b30d13fcfed tempest-VolumesActionsTest-4714917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:56:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-62e62d9e-042a-420f-8b89-6b30d13fcfed tempest-VolumesActionsTest-4714917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:56:59 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-62e62d9e-042a-420f-8b89-6b30d13fcfed tempest-VolumesActionsTest-4714917 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:56:59 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-62e62d9e-042a-420f-8b89-6b30d13fcfed tempest-VolumesActionsTest-4714917 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:56:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-62e62d9e-042a-420f-8b89-6b30d13fcfed tempest-VolumesActionsTest-4714917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-225f3fd5-1a36-4834-95ef-9f3309d85737 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:56:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2f948ec7-1df1-4e27-8002-5fcf2baff63c tempest-SnapshotDependencyTests-1848094913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0ea1f76-83e8-493d-825b-a47c6f642af4.6bdb2071-2797-4c17-a2bf-48b58bb2e897" returned: 0 in 0.475s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:56:59 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-2f948ec7-1df1-4e27-8002-5fcf2baff63c tempest-SnapshotDependencyTests-1848094913 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0ea1f76-83e8-493d-825b-a47c6f642af4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 17:56:59 devstack sudo[97489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-225f3fd5-1a36-4834-95ef-9f3309d85737 1073741824 Sep 04 17:56:59 devstack sudo[97489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:56:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d663a836-825c-45af-b08d-2a644e106851 tempest-GroupSnapshotsTest-1632469284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1428325-1618-4c14-8642-93b5568c0d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6727c47f-2920-4a08-b13c-b35a469a5134', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:56:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d663a836-825c-45af-b08d-2a644e106851 tempest-GroupSnapshotsTest-1632469284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a889e62-a96f-4ddd-9271-3233ab32d9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:56:59 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[38845557-49b9-4e36-a833-ffe7e4d5432d]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:56:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2f948ec7-1df1-4e27-8002-5fcf2baff63c tempest-SnapshotDependencyTests-1848094913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0ea1f76-83e8-493d-825b-a47c6f642af4 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:56:59 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-d663a836-825c-45af-b08d-2a644e106851 tempest-GroupSnapshotsTest-1632469284 None] Volume volume-6727c47f-2920-4a08-b13c-b35a469a5134 (6727c47f-2920-4a08-b13c-b35a469a5134): created successfully Sep 04 17:56:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d663a836-825c-45af-b08d-2a644e106851 tempest-GroupSnapshotsTest-1632469284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a889e62-a96f-4ddd-9271-3233ab32d9dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:56:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d663a836-825c-45af-b08d-2a644e106851 tempest-GroupSnapshotsTest-1632469284 None] Flow 'volume_create_manager' (c0bacb68-2e29-46f7-b99e-6fecf4b65781) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:56:59 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-d663a836-825c-45af-b08d-2a644e106851 tempest-GroupSnapshotsTest-1632469284 None] Created volume successfully. Sep 04 17:56:59 devstack sudo[97491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0ea1f76-83e8-493d-825b-a47c6f642af4 Sep 04 17:56:59 devstack sudo[97491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:56:59 devstack sudo[97489]: pam_unix(sudo:session): session closed for user root Sep 04 17:56:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-62e62d9e-042a-420f-8b89-6b30d13fcfed tempest-VolumesActionsTest-4714917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-225f3fd5-1a36-4834-95ef-9f3309d85737 1073741824" returned: 0 in 0.485s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:56:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-62e62d9e-042a-420f-8b89-6b30d13fcfed tempest-VolumesActionsTest-4714917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-225f3fd5-1a36-4834-95ef-9f3309d85737 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:56:59 devstack sudo[97498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-225f3fd5-1a36-4834-95ef-9f3309d85737 Sep 04 17:56:59 devstack sudo[97498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:56:59 devstack sudo[97491]: pam_unix(sudo:session): session closed for user root Sep 04 17:56:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2f948ec7-1df1-4e27-8002-5fcf2baff63c tempest-SnapshotDependencyTests-1848094913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0ea1f76-83e8-493d-825b-a47c6f642af4" returned: 0 in 0.591s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:56:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2f948ec7-1df1-4e27-8002-5fcf2baff63c tempest-SnapshotDependencyTests-1848094913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0ea1f76-83e8-493d-825b-a47c6f642af4.6bdb2071-2797-4c17-a2bf-48b58bb2e897 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:56:59 devstack sudo[97502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0ea1f76-83e8-493d-825b-a47c6f642af4.6bdb2071-2797-4c17-a2bf-48b58bb2e897 Sep 04 17:56:59 devstack sudo[97502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:56:59 devstack sudo[97498]: pam_unix(sudo:session): session closed for user root Sep 04 17:56:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-62e62d9e-042a-420f-8b89-6b30d13fcfed tempest-VolumesActionsTest-4714917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-225f3fd5-1a36-4834-95ef-9f3309d85737" returned: 0 in 0.275s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:56:59 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-62e62d9e-042a-420f-8b89-6b30d13fcfed tempest-VolumesActionsTest-4714917 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:56:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-62e62d9e-042a-420f-8b89-6b30d13fcfed tempest-VolumesActionsTest-4714917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:56:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-62e62d9e-042a-420f-8b89-6b30d13fcfed tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (340ba064-17c6-4b84-a445-2a9619e77b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-225f3fd5-1a36-4834-95ef-9f3309d85737', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:56:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-62e62d9e-042a-420f-8b89-6b30d13fcfed tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8359525f-1f3e-4238-98a2-04141a33c438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:56:59 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-62e62d9e-042a-420f-8b89-6b30d13fcfed tempest-VolumesActionsTest-4714917 None] Volume volume-225f3fd5-1a36-4834-95ef-9f3309d85737 (225f3fd5-1a36-4834-95ef-9f3309d85737): created successfully Sep 04 17:56:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-62e62d9e-042a-420f-8b89-6b30d13fcfed tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8359525f-1f3e-4238-98a2-04141a33c438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:56:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-62e62d9e-042a-420f-8b89-6b30d13fcfed tempest-VolumesActionsTest-4714917 None] Flow 'volume_create_manager' (34f3bfad-6134-4a5a-aace-e916ff28f1d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:56:59 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-62e62d9e-042a-420f-8b89-6b30d13fcfed tempest-VolumesActionsTest-4714917 None] Created volume successfully. Sep 04 17:57:00 devstack sudo[97502]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2f948ec7-1df1-4e27-8002-5fcf2baff63c tempest-SnapshotDependencyTests-1848094913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0ea1f76-83e8-493d-825b-a47c6f642af4.6bdb2071-2797-4c17-a2bf-48b58bb2e897" returned: 0 in 0.418s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2f948ec7-1df1-4e27-8002-5fcf2baff63c tempest-SnapshotDependencyTests-1848094913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0ea1f76-83e8-493d-825b-a47c6f642af4.6bdb2071-2797-4c17-a2bf-48b58bb2e897 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:00 devstack sudo[97514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0ea1f76-83e8-493d-825b-a47c6f642af4.6bdb2071-2797-4c17-a2bf-48b58bb2e897 Sep 04 17:57:00 devstack sudo[97514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:00 devstack sudo[97514]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2f948ec7-1df1-4e27-8002-5fcf2baff63c tempest-SnapshotDependencyTests-1848094913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0ea1f76-83e8-493d-825b-a47c6f642af4.6bdb2071-2797-4c17-a2bf-48b58bb2e897" returned: 0 in 0.369s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:00 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2f948ec7-1df1-4e27-8002-5fcf2baff63c tempest-SnapshotDependencyTests-1848094913 None] Lock "cinder-quobyte-6bdb2071-2797-4c17-a2bf-48b58bb2e897" released by "_delete_snapshot" :: held 2.018s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:57:00 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2f948ec7-1df1-4e27-8002-5fcf2baff63c tempest-SnapshotDependencyTests-1848094913 None] Lock "cinder-quobyte-a0ea1f76-83e8-493d-825b-a47c6f642af4" released by "delete_snapshot" :: held 2.042s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:57:00 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-2f948ec7-1df1-4e27-8002-5fcf2baff63c tempest-SnapshotDependencyTests-1848094913 None] Created reservations ['ff7a579f-5d91-41c0-af00-a3b3ea2d55da', '24ccc07f-59cd-4fe1-8da2-0d09e9458607', 'bc3cb22f-cb20-486b-9489-4e5b38be362f', 'bf2b2ee9-c9ab-4a6a-a6b9-795bf7100ee9'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:57:00 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-2f948ec7-1df1-4e27-8002-5fcf2baff63c tempest-SnapshotDependencyTests-1848094913 None] Delete snapshot completed successfully. Sep 04 17:57:00 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2f948ec7-1df1-4e27-8002-5fcf2baff63c tempest-SnapshotDependencyTests-1848094913 None] Lock "cinder-6bdb2071-2797-4c17-a2bf-48b58bb2e897-delete_snapshot" released by "delete_snapshot" :: held 2.218s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:57:00 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-eeefa640-c98c-4ddb-abe1-2b4b66dce3dc tempest-GroupSnapshotsTest-1632469284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:57:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-eeefa640-c98c-4ddb-abe1-2b4b66dce3dc tempest-GroupSnapshotsTest-1632469284 None] Flow 'volume_create_manager' (b8c7988e-76cc-47e1-bdd5-cb92416d6fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:57:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-eeefa640-c98c-4ddb-abe1-2b4b66dce3dc tempest-GroupSnapshotsTest-1632469284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eb69e49-0aad-4cf4-90e4-bdeb3e3644f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:57:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-eeefa640-c98c-4ddb-abe1-2b4b66dce3dc tempest-GroupSnapshotsTest-1632469284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eb69e49-0aad-4cf4-90e4-bdeb3e3644f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1840342143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b9706474-f7bd-47ee-8397-62b120c81c16,host='devstack@QuobyteHD#QuobyteHD',id=33acfbd2-5942-4502-aeb5-3e32123e63ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b90a7a1d394b4293aa22af639974cdd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:57:01Z,use_quota=True,user_id='2deecbeab20243e89090df54531c8db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1b5c55c3-ba23-4468-b997-75fd857bce0c),volume_type_id=1b5c55c3-ba23-4468-b997-75fd857bce0c)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:57:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-eeefa640-c98c-4ddb-abe1-2b4b66dce3dc tempest-GroupSnapshotsTest-1632469284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6509c4d8-78d8-4ed2-b494-a828b55e891a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:57:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-eeefa640-c98c-4ddb-abe1-2b4b66dce3dc tempest-GroupSnapshotsTest-1632469284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6509c4d8-78d8-4ed2-b494-a828b55e891a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:57:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-eeefa640-c98c-4ddb-abe1-2b4b66dce3dc tempest-GroupSnapshotsTest-1632469284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f3c6914-6860-4afc-a5f4-b7f4e5fd92dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:57:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-eeefa640-c98c-4ddb-abe1-2b4b66dce3dc tempest-GroupSnapshotsTest-1632469284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f3c6914-6860-4afc-a5f4-b7f4e5fd92dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33acfbd2-5942-4502-aeb5-3e32123e63ef', 'volume_name': 'volume-33acfbd2-5942-4502-aeb5-3e32123e63ef', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:57:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-eeefa640-c98c-4ddb-abe1-2b4b66dce3dc tempest-GroupSnapshotsTest-1632469284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7faeb0b-c422-4e34-98ae-f2baa4fd372d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:57:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-eeefa640-c98c-4ddb-abe1-2b4b66dce3dc tempest-GroupSnapshotsTest-1632469284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7faeb0b-c422-4e34-98ae-f2baa4fd372d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:57:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-eeefa640-c98c-4ddb-abe1-2b4b66dce3dc tempest-GroupSnapshotsTest-1632469284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7efd5f72-066e-42d5-aaa8-179776412480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:57:00 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-eeefa640-c98c-4ddb-abe1-2b4b66dce3dc tempest-GroupSnapshotsTest-1632469284 None] Volume 33acfbd2-5942-4502-aeb5-3e32123e63ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33acfbd2-5942-4502-aeb5-3e32123e63ef', 'volume_size': 1} Sep 04 17:57:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-eeefa640-c98c-4ddb-abe1-2b4b66dce3dc tempest-GroupSnapshotsTest-1632469284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:57:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-eeefa640-c98c-4ddb-abe1-2b4b66dce3dc tempest-GroupSnapshotsTest-1632469284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:57:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-eeefa640-c98c-4ddb-abe1-2b4b66dce3dc tempest-GroupSnapshotsTest-1632469284 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b9706474-f7bd-47ee-8397-62b120c81c16,created_at=2026-09-04T15:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1840342143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b9706474-f7bd-47ee-8397-62b120c81c16,host='devstack@QuobyteHD#QuobyteHD',id=33acfbd2-5942-4502-aeb5-3e32123e63ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b90a7a1d394b4293aa22af639974cdd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:57:01Z,use_quota=True,user_id='2deecbeab20243e89090df54531c8db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1b5c55c3-ba23-4468-b997-75fd857bce0c),volume_type_id=1b5c55c3-ba23-4468-b997-75fd857bce0c)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:57:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-eeefa640-c98c-4ddb-abe1-2b4b66dce3dc tempest-GroupSnapshotsTest-1632469284 None] Creating volume 33acfbd2-5942-4502-aeb5-3e32123e63ef {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:57:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-eeefa640-c98c-4ddb-abe1-2b4b66dce3dc tempest-GroupSnapshotsTest-1632469284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:57:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-eeefa640-c98c-4ddb-abe1-2b4b66dce3dc tempest-GroupSnapshotsTest-1632469284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:57:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-eeefa640-c98c-4ddb-abe1-2b4b66dce3dc tempest-GroupSnapshotsTest-1632469284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:57:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-eeefa640-c98c-4ddb-abe1-2b4b66dce3dc tempest-GroupSnapshotsTest-1632469284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:57:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-eeefa640-c98c-4ddb-abe1-2b4b66dce3dc tempest-GroupSnapshotsTest-1632469284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:57:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-eeefa640-c98c-4ddb-abe1-2b4b66dce3dc tempest-GroupSnapshotsTest-1632469284 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:57:00 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-eeefa640-c98c-4ddb-abe1-2b4b66dce3dc tempest-GroupSnapshotsTest-1632469284 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:57:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-eeefa640-c98c-4ddb-abe1-2b4b66dce3dc tempest-GroupSnapshotsTest-1632469284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-33acfbd2-5942-4502-aeb5-3e32123e63ef 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:00 devstack sudo[97518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-33acfbd2-5942-4502-aeb5-3e32123e63ef 1073741824 Sep 04 17:57:00 devstack sudo[97518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-860223cd-e5a2-4c4b-836c-cdb5701557f7 tempest-VolumesActionsTest-852108199 None] Acquiring lock "cinder-225f3fd5-1a36-4834-95ef-9f3309d85737-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:57:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-860223cd-e5a2-4c4b-836c-cdb5701557f7 tempest-VolumesActionsTest-852108199 None] Lock "cinder-225f3fd5-1a36-4834-95ef-9f3309d85737-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:57:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-860223cd-e5a2-4c4b-836c-cdb5701557f7 tempest-VolumesActionsTest-852108199 None] Acquiring lock "cinder-quobyte-225f3fd5-1a36-4834-95ef-9f3309d85737" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:57:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-860223cd-e5a2-4c4b-836c-cdb5701557f7 tempest-VolumesActionsTest-852108199 None] Lock "cinder-quobyte-225f3fd5-1a36-4834-95ef-9f3309d85737" acquired by "delete_volume" :: waited 0.030s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:57:01 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d870a1-cc3a-41c3-938d-43be3017b5e0]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:57:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-860223cd-e5a2-4c4b-836c-cdb5701557f7 tempest-VolumesActionsTest-852108199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-225f3fd5-1a36-4834-95ef-9f3309d85737 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:01 devstack sudo[97518]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-eeefa640-c98c-4ddb-abe1-2b4b66dce3dc tempest-GroupSnapshotsTest-1632469284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-33acfbd2-5942-4502-aeb5-3e32123e63ef 1073741824" returned: 0 in 0.700s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:01 devstack sudo[97534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-225f3fd5-1a36-4834-95ef-9f3309d85737 Sep 04 17:57:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-eeefa640-c98c-4ddb-abe1-2b4b66dce3dc tempest-GroupSnapshotsTest-1632469284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-33acfbd2-5942-4502-aeb5-3e32123e63ef {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:01 devstack sudo[97534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:01 devstack sudo[97544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-33acfbd2-5942-4502-aeb5-3e32123e63ef Sep 04 17:57:01 devstack sudo[97544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-da135d83-8ddc-46a6-9158-15e66593593f tempest-SnapshotDependencyTests-1848094913 None] Acquiring lock "cinder-a0ea1f76-83e8-493d-825b-a47c6f642af4-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:57:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-da135d83-8ddc-46a6-9158-15e66593593f tempest-SnapshotDependencyTests-1848094913 None] Lock "cinder-a0ea1f76-83e8-493d-825b-a47c6f642af4-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:57:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-da135d83-8ddc-46a6-9158-15e66593593f tempest-SnapshotDependencyTests-1848094913 None] Acquiring lock "cinder-quobyte-a0ea1f76-83e8-493d-825b-a47c6f642af4" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:57:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-da135d83-8ddc-46a6-9158-15e66593593f tempest-SnapshotDependencyTests-1848094913 None] Lock "cinder-quobyte-a0ea1f76-83e8-493d-825b-a47c6f642af4" acquired by "delete_volume" :: waited 0.029s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:57:02 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd3d4e3-114b-468b-9193-2877ff5d62cd]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:57:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-da135d83-8ddc-46a6-9158-15e66593593f tempest-SnapshotDependencyTests-1848094913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0ea1f76-83e8-493d-825b-a47c6f642af4 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:02 devstack sudo[97544]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-eeefa640-c98c-4ddb-abe1-2b4b66dce3dc tempest-GroupSnapshotsTest-1632469284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-33acfbd2-5942-4502-aeb5-3e32123e63ef" returned: 0 in 0.460s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:02 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-eeefa640-c98c-4ddb-abe1-2b4b66dce3dc tempest-GroupSnapshotsTest-1632469284 None] <== create_volume: return (1242ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:57:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-eeefa640-c98c-4ddb-abe1-2b4b66dce3dc tempest-GroupSnapshotsTest-1632469284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.246s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:57:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-eeefa640-c98c-4ddb-abe1-2b4b66dce3dc tempest-GroupSnapshotsTest-1632469284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7efd5f72-066e-42d5-aaa8-179776412480) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33acfbd2-5942-4502-aeb5-3e32123e63ef', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:57:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-eeefa640-c98c-4ddb-abe1-2b4b66dce3dc tempest-GroupSnapshotsTest-1632469284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ad66d13-b1cd-4e90-93bc-8df5d0f462f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:57:02 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-eeefa640-c98c-4ddb-abe1-2b4b66dce3dc tempest-GroupSnapshotsTest-1632469284 None] Volume volume-33acfbd2-5942-4502-aeb5-3e32123e63ef (33acfbd2-5942-4502-aeb5-3e32123e63ef): created successfully Sep 04 17:57:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-eeefa640-c98c-4ddb-abe1-2b4b66dce3dc tempest-GroupSnapshotsTest-1632469284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ad66d13-b1cd-4e90-93bc-8df5d0f462f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:57:02 devstack sudo[97534]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-eeefa640-c98c-4ddb-abe1-2b4b66dce3dc tempest-GroupSnapshotsTest-1632469284 None] Flow 'volume_create_manager' (b8c7988e-76cc-47e1-bdd5-cb92416d6fee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:57:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-860223cd-e5a2-4c4b-836c-cdb5701557f7 tempest-VolumesActionsTest-852108199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-225f3fd5-1a36-4834-95ef-9f3309d85737" returned: 0 in 0.728s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-860223cd-e5a2-4c4b-836c-cdb5701557f7 tempest-VolumesActionsTest-852108199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-225f3fd5-1a36-4834-95ef-9f3309d85737 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:02 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-eeefa640-c98c-4ddb-abe1-2b4b66dce3dc tempest-GroupSnapshotsTest-1632469284 None] Created volume successfully. Sep 04 17:57:02 devstack sudo[97552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-225f3fd5-1a36-4834-95ef-9f3309d85737 Sep 04 17:57:02 devstack sudo[97552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:02 devstack sudo[97550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0ea1f76-83e8-493d-825b-a47c6f642af4 Sep 04 17:57:02 devstack sudo[97550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:02 devstack sudo[97552]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-860223cd-e5a2-4c4b-836c-cdb5701557f7 tempest-VolumesActionsTest-852108199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-225f3fd5-1a36-4834-95ef-9f3309d85737" returned: 0 in 0.306s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:02 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-860223cd-e5a2-4c4b-836c-cdb5701557f7 tempest-VolumesActionsTest-852108199 None] Lock "cinder-quobyte-225f3fd5-1a36-4834-95ef-9f3309d85737" released by "delete_volume" :: held 1.111s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:57:02 devstack sudo[97550]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:02 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-860223cd-e5a2-4c4b-836c-cdb5701557f7 tempest-VolumesActionsTest-852108199 None] Created reservations ['4c135c30-460b-41b2-ab92-fe687cea3b3a', '62622c7f-6f14-42ee-9977-8ce18ddf2d76', 'b0e28b26-5e83-4b77-99f2-5c30c76247fd', '678b6fad-3a30-460d-b7aa-bc8b585392e4'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:57:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-da135d83-8ddc-46a6-9158-15e66593593f tempest-SnapshotDependencyTests-1848094913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0ea1f76-83e8-493d-825b-a47c6f642af4" returned: 0 in 0.534s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-da135d83-8ddc-46a6-9158-15e66593593f tempest-SnapshotDependencyTests-1848094913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0ea1f76-83e8-493d-825b-a47c6f642af4 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:02 devstack sudo[97561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0ea1f76-83e8-493d-825b-a47c6f642af4 Sep 04 17:57:02 devstack sudo[97561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-860223cd-e5a2-4c4b-836c-cdb5701557f7 tempest-VolumesActionsTest-852108199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:57:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-860223cd-e5a2-4c4b-836c-cdb5701557f7 tempest-VolumesActionsTest-852108199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:57:02 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-860223cd-e5a2-4c4b-836c-cdb5701557f7 tempest-VolumesActionsTest-852108199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:57:02 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-860223cd-e5a2-4c4b-836c-cdb5701557f7 tempest-VolumesActionsTest-852108199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:57:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-860223cd-e5a2-4c4b-836c-cdb5701557f7 tempest-VolumesActionsTest-852108199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:57:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-860223cd-e5a2-4c4b-836c-cdb5701557f7 tempest-VolumesActionsTest-852108199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:02 devstack sudo[97565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:57:02 devstack sudo[97565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:02 devstack sudo[97561]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-da135d83-8ddc-46a6-9158-15e66593593f tempest-SnapshotDependencyTests-1848094913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0ea1f76-83e8-493d-825b-a47c6f642af4" returned: 0 in 0.251s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:02 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-da135d83-8ddc-46a6-9158-15e66593593f tempest-SnapshotDependencyTests-1848094913 None] Lock "cinder-quobyte-a0ea1f76-83e8-493d-825b-a47c6f642af4" released by "delete_volume" :: held 0.888s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:57:02 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-da135d83-8ddc-46a6-9158-15e66593593f tempest-SnapshotDependencyTests-1848094913 None] Created reservations ['ae0811c2-90d8-484f-b476-f00912e98c32', '4fefa64b-fa93-4ebf-bf2e-7a7237e1ed8c', '0a771365-9df2-4fa0-be54-6a3feca30d9c', 'bbf8da4d-92af-434b-9ddf-7f95031cab5c'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:57:02 devstack sudo[97565]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-860223cd-e5a2-4c4b-836c-cdb5701557f7 tempest-VolumesActionsTest-852108199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.253s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:02 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-860223cd-e5a2-4c4b-836c-cdb5701557f7 tempest-VolumesActionsTest-852108199 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:57:02 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-860223cd-e5a2-4c4b-836c-cdb5701557f7 tempest-VolumesActionsTest-852108199 None] Deleted volume successfully. Sep 04 17:57:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-da135d83-8ddc-46a6-9158-15e66593593f tempest-SnapshotDependencyTests-1848094913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:57:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-da135d83-8ddc-46a6-9158-15e66593593f tempest-SnapshotDependencyTests-1848094913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:57:02 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-da135d83-8ddc-46a6-9158-15e66593593f tempest-SnapshotDependencyTests-1848094913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:57:02 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-da135d83-8ddc-46a6-9158-15e66593593f tempest-SnapshotDependencyTests-1848094913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:57:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-da135d83-8ddc-46a6-9158-15e66593593f tempest-SnapshotDependencyTests-1848094913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:57:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-da135d83-8ddc-46a6-9158-15e66593593f tempest-SnapshotDependencyTests-1848094913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:02 devstack sudo[97569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:57:02 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-860223cd-e5a2-4c4b-836c-cdb5701557f7 tempest-VolumesActionsTest-852108199 None] Lock "cinder-225f3fd5-1a36-4834-95ef-9f3309d85737-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:57:02 devstack sudo[97569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:03 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ec75056e-84fb-41c4-a33f-a04efc41ac16 tempest-SnapshotDependencyTests-1848094913 None] Acquiring lock "cinder-70dd4f87-8b97-48e4-badc-157873398183-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:57:03 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ec75056e-84fb-41c4-a33f-a04efc41ac16 tempest-SnapshotDependencyTests-1848094913 None] Lock "cinder-70dd4f87-8b97-48e4-badc-157873398183-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:57:03 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ec75056e-84fb-41c4-a33f-a04efc41ac16 tempest-SnapshotDependencyTests-1848094913 None] Acquiring lock "cinder-quobyte-70dd4f87-8b97-48e4-badc-157873398183" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:57:03 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ec75056e-84fb-41c4-a33f-a04efc41ac16 tempest-SnapshotDependencyTests-1848094913 None] Lock "cinder-quobyte-70dd4f87-8b97-48e4-badc-157873398183" acquired by "delete_volume" :: waited 0.032s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:57:03 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[4948895e-39e9-4fab-a191-6d9dbc7f2f65]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:57:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ec75056e-84fb-41c4-a33f-a04efc41ac16 tempest-SnapshotDependencyTests-1848094913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-70dd4f87-8b97-48e4-badc-157873398183 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:03 devstack sudo[97569]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-da135d83-8ddc-46a6-9158-15e66593593f tempest-SnapshotDependencyTests-1848094913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.326s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:03 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-da135d83-8ddc-46a6-9158-15e66593593f tempest-SnapshotDependencyTests-1848094913 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:57:03 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-da135d83-8ddc-46a6-9158-15e66593593f tempest-SnapshotDependencyTests-1848094913 None] Deleted volume successfully. Sep 04 17:57:03 devstack sudo[97571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-70dd4f87-8b97-48e4-badc-157873398183 Sep 04 17:57:03 devstack sudo[97571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:03 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-da135d83-8ddc-46a6-9158-15e66593593f tempest-SnapshotDependencyTests-1848094913 None] Lock "cinder-a0ea1f76-83e8-493d-825b-a47c6f642af4-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:57:03 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-2be75050-50c7-4b07-b7c4-d55299181464 tempest-GroupSnapshotsTest-1632469284 None] Update group completed successfully. Sep 04 17:57:03 devstack sudo[97571]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ec75056e-84fb-41c4-a33f-a04efc41ac16 tempest-SnapshotDependencyTests-1848094913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-70dd4f87-8b97-48e4-badc-157873398183" returned: 0 in 0.491s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ec75056e-84fb-41c4-a33f-a04efc41ac16 tempest-SnapshotDependencyTests-1848094913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-70dd4f87-8b97-48e4-badc-157873398183 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:03 devstack sudo[97578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-70dd4f87-8b97-48e4-badc-157873398183 Sep 04 17:57:03 devstack sudo[97578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:03 devstack sudo[97578]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ec75056e-84fb-41c4-a33f-a04efc41ac16 tempest-SnapshotDependencyTests-1848094913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-70dd4f87-8b97-48e4-badc-157873398183" returned: 0 in 0.268s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:03 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ec75056e-84fb-41c4-a33f-a04efc41ac16 tempest-SnapshotDependencyTests-1848094913 None] Lock "cinder-quobyte-70dd4f87-8b97-48e4-badc-157873398183" released by "delete_volume" :: held 0.826s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:57:04 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-ec75056e-84fb-41c4-a33f-a04efc41ac16 tempest-SnapshotDependencyTests-1848094913 None] Created reservations ['6c6c3d1a-ef7d-44e0-9f08-843f6bb1c679', 'df440529-edf0-4ca1-aafc-7a3bb1665acb', '9ef8cc28-5c3c-4b2a-9632-4ebf0d4c4081', '0e74c3c0-96ce-4569-b322-996c74a8dfe5'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:57:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ec75056e-84fb-41c4-a33f-a04efc41ac16 tempest-SnapshotDependencyTests-1848094913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:57:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ec75056e-84fb-41c4-a33f-a04efc41ac16 tempest-SnapshotDependencyTests-1848094913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:57:04 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ec75056e-84fb-41c4-a33f-a04efc41ac16 tempest-SnapshotDependencyTests-1848094913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:57:04 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ec75056e-84fb-41c4-a33f-a04efc41ac16 tempest-SnapshotDependencyTests-1848094913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:57:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ec75056e-84fb-41c4-a33f-a04efc41ac16 tempest-SnapshotDependencyTests-1848094913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:57:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ec75056e-84fb-41c4-a33f-a04efc41ac16 tempest-SnapshotDependencyTests-1848094913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:04 devstack sudo[97581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:57:04 devstack sudo[97581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:04 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8220c62-15fd-49ca-b1c5-e86f400e312c tempest-VolumesActionsTest-4714917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:57:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d8220c62-15fd-49ca-b1c5-e86f400e312c tempest-VolumesActionsTest-4714917 None] Flow 'volume_create_manager' (24036e70-715a-48e5-a136-46aea82dff83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:57:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d8220c62-15fd-49ca-b1c5-e86f400e312c tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ccf88a5-68c8-4e14-a07e-813dd8d0df81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:57:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d8220c62-15fd-49ca-b1c5-e86f400e312c tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ccf88a5-68c8-4e14-a07e-813dd8d0df81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:57:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1102856564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00ae4da1-6290-43ec-b486-24e81ce8ea8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38378c3abbf14ff4955c45d1c327ad3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:57:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:57:04Z,use_quota=True,user_id='875b51464a33490b8c4a2405e23a4980',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:57:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d8220c62-15fd-49ca-b1c5-e86f400e312c tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (294b30e3-f393-4771-b3a9-38b85eb01eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:57:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d8220c62-15fd-49ca-b1c5-e86f400e312c tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (294b30e3-f393-4771-b3a9-38b85eb01eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:57:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d8220c62-15fd-49ca-b1c5-e86f400e312c tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24bf6425-3cd0-4c34-b71f-f201252ee381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:57:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d8220c62-15fd-49ca-b1c5-e86f400e312c tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24bf6425-3cd0-4c34-b71f-f201252ee381) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00ae4da1-6290-43ec-b486-24e81ce8ea8d', 'volume_name': 'volume-00ae4da1-6290-43ec-b486-24e81ce8ea8d', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:57:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d8220c62-15fd-49ca-b1c5-e86f400e312c tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ea4011a-7283-41fc-bf5c-562836674997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:57:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d8220c62-15fd-49ca-b1c5-e86f400e312c tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ea4011a-7283-41fc-bf5c-562836674997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:57:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d8220c62-15fd-49ca-b1c5-e86f400e312c tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ed78fbd-0ac1-4fbd-b4d8-30eb70732a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:57:04 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-d8220c62-15fd-49ca-b1c5-e86f400e312c tempest-VolumesActionsTest-4714917 None] Volume 00ae4da1-6290-43ec-b486-24e81ce8ea8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00ae4da1-6290-43ec-b486-24e81ce8ea8d', 'volume_size': 1} Sep 04 17:57:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d8220c62-15fd-49ca-b1c5-e86f400e312c tempest-VolumesActionsTest-4714917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:57:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d8220c62-15fd-49ca-b1c5-e86f400e312c tempest-VolumesActionsTest-4714917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:57:04 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d8220c62-15fd-49ca-b1c5-e86f400e312c tempest-VolumesActionsTest-4714917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:57:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1102856564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00ae4da1-6290-43ec-b486-24e81ce8ea8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38378c3abbf14ff4955c45d1c327ad3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:57:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:57:04Z,use_quota=True,user_id='875b51464a33490b8c4a2405e23a4980',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:57:04 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-d8220c62-15fd-49ca-b1c5-e86f400e312c tempest-VolumesActionsTest-4714917 None] Creating volume 00ae4da1-6290-43ec-b486-24e81ce8ea8d {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:57:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d8220c62-15fd-49ca-b1c5-e86f400e312c tempest-VolumesActionsTest-4714917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:57:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d8220c62-15fd-49ca-b1c5-e86f400e312c tempest-VolumesActionsTest-4714917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:57:04 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d8220c62-15fd-49ca-b1c5-e86f400e312c tempest-VolumesActionsTest-4714917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:57:04 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d8220c62-15fd-49ca-b1c5-e86f400e312c tempest-VolumesActionsTest-4714917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:57:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d8220c62-15fd-49ca-b1c5-e86f400e312c tempest-VolumesActionsTest-4714917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:57:04 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d8220c62-15fd-49ca-b1c5-e86f400e312c tempest-VolumesActionsTest-4714917 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:57:04 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-d8220c62-15fd-49ca-b1c5-e86f400e312c tempest-VolumesActionsTest-4714917 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:57:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d8220c62-15fd-49ca-b1c5-e86f400e312c tempest-VolumesActionsTest-4714917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-00ae4da1-6290-43ec-b486-24e81ce8ea8d 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-476f6b02-e0d5-48da-b774-de38ad51b5c5 req-46184030-5d28-4b35-9a0b-620e920e288b tempest-AttachVolumeShelveTestJSON-1130860107 None] No connector for attachment 44a7e131-fc74-41aa-a97a-5e32866cf26d; skipping storage backend terminate_connection call. {{(pid=87314) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 04 17:57:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-476f6b02-e0d5-48da-b774-de38ad51b5c5 req-46184030-5d28-4b35-9a0b-620e920e288b tempest-AttachVolumeShelveTestJSON-1130860107 None] Deleting attachment 44a7e131-fc74-41aa-a97a-5e32866cf26d. {{(pid=87314) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 17:57:04 devstack sudo[97583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-00ae4da1-6290-43ec-b486-24e81ce8ea8d 1073741824 Sep 04 17:57:04 devstack sudo[97583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:04 devstack sudo[97581]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ec75056e-84fb-41c4-a33f-a04efc41ac16 tempest-SnapshotDependencyTests-1848094913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.294s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:04 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-ec75056e-84fb-41c4-a33f-a04efc41ac16 tempest-SnapshotDependencyTests-1848094913 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:57:04 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-ec75056e-84fb-41c4-a33f-a04efc41ac16 tempest-SnapshotDependencyTests-1848094913 None] Deleted volume successfully. Sep 04 17:57:04 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ec75056e-84fb-41c4-a33f-a04efc41ac16 tempest-SnapshotDependencyTests-1848094913 None] Lock "cinder-70dd4f87-8b97-48e4-badc-157873398183-delete_volume" released by "delete_volume" :: held 1.413s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:57:04 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-04c18e4d-cb68-4481-828a-8330f4c15f75 tempest-GroupSnapshotsTest-1632469284 None] Update group completed successfully. Sep 04 17:57:04 devstack sudo[97583]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d8220c62-15fd-49ca-b1c5-e86f400e312c tempest-VolumesActionsTest-4714917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-00ae4da1-6290-43ec-b486-24e81ce8ea8d 1073741824" returned: 0 in 0.602s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d8220c62-15fd-49ca-b1c5-e86f400e312c tempest-VolumesActionsTest-4714917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-00ae4da1-6290-43ec-b486-24e81ce8ea8d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:04 devstack sudo[97591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-00ae4da1-6290-43ec-b486-24e81ce8ea8d Sep 04 17:57:04 devstack sudo[97591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:05 devstack sudo[97591]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d8220c62-15fd-49ca-b1c5-e86f400e312c tempest-VolumesActionsTest-4714917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-00ae4da1-6290-43ec-b486-24e81ce8ea8d" returned: 0 in 0.313s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:05 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d8220c62-15fd-49ca-b1c5-e86f400e312c tempest-VolumesActionsTest-4714917 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:57:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d8220c62-15fd-49ca-b1c5-e86f400e312c tempest-VolumesActionsTest-4714917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:57:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d8220c62-15fd-49ca-b1c5-e86f400e312c tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ed78fbd-0ac1-4fbd-b4d8-30eb70732a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00ae4da1-6290-43ec-b486-24e81ce8ea8d', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:57:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d8220c62-15fd-49ca-b1c5-e86f400e312c tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff1fe152-c8d4-4d9c-95b5-89d13a8a2c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:57:05 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-d8220c62-15fd-49ca-b1c5-e86f400e312c tempest-VolumesActionsTest-4714917 None] Volume volume-00ae4da1-6290-43ec-b486-24e81ce8ea8d (00ae4da1-6290-43ec-b486-24e81ce8ea8d): created successfully Sep 04 17:57:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d8220c62-15fd-49ca-b1c5-e86f400e312c tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff1fe152-c8d4-4d9c-95b5-89d13a8a2c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:57:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d8220c62-15fd-49ca-b1c5-e86f400e312c tempest-VolumesActionsTest-4714917 None] Flow 'volume_create_manager' (24036e70-715a-48e5-a136-46aea82dff83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:57:05 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-d8220c62-15fd-49ca-b1c5-e86f400e312c tempest-VolumesActionsTest-4714917 None] Created volume successfully. Sep 04 17:57:05 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-2878d1f1-d781-4bc9-90c7-7d869be4df87 tempest-GroupSnapshotsTest-1632469284 None] Update group completed successfully. Sep 04 17:57:06 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-58d18c3b-e033-44e0-9553-22f972819cb6 tempest-VolumesActionsTest-852108199 None] Acquiring lock "cinder-00ae4da1-6290-43ec-b486-24e81ce8ea8d-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:57:06 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-58d18c3b-e033-44e0-9553-22f972819cb6 tempest-VolumesActionsTest-852108199 None] Lock "cinder-00ae4da1-6290-43ec-b486-24e81ce8ea8d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:57:06 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-58d18c3b-e033-44e0-9553-22f972819cb6 tempest-VolumesActionsTest-852108199 None] Acquiring lock "cinder-quobyte-00ae4da1-6290-43ec-b486-24e81ce8ea8d" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:57:06 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-58d18c3b-e033-44e0-9553-22f972819cb6 tempest-VolumesActionsTest-852108199 None] Lock "cinder-quobyte-00ae4da1-6290-43ec-b486-24e81ce8ea8d" acquired by "delete_volume" :: waited 0.027s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:57:06 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[f69c4ab9-c59f-4809-b77d-a9de5d784f34]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:57:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-58d18c3b-e033-44e0-9553-22f972819cb6 tempest-VolumesActionsTest-852108199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-00ae4da1-6290-43ec-b486-24e81ce8ea8d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:06 devstack sudo[97597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-00ae4da1-6290-43ec-b486-24e81ce8ea8d Sep 04 17:57:06 devstack sudo[97597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:06 devstack sudo[97597]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-58d18c3b-e033-44e0-9553-22f972819cb6 tempest-VolumesActionsTest-852108199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-00ae4da1-6290-43ec-b486-24e81ce8ea8d" returned: 0 in 0.433s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-58d18c3b-e033-44e0-9553-22f972819cb6 tempest-VolumesActionsTest-852108199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-00ae4da1-6290-43ec-b486-24e81ce8ea8d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:07 devstack sudo[97602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-00ae4da1-6290-43ec-b486-24e81ce8ea8d Sep 04 17:57:07 devstack sudo[97602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:07 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-f6f6f0bc-b3d6-4cf9-a68f-2d5fe7e58572 tempest-GroupSnapshotsTest-1632469284 None] Update group completed successfully. Sep 04 17:57:07 devstack sudo[97602]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-58d18c3b-e033-44e0-9553-22f972819cb6 tempest-VolumesActionsTest-852108199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-00ae4da1-6290-43ec-b486-24e81ce8ea8d" returned: 0 in 0.335s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:07 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-58d18c3b-e033-44e0-9553-22f972819cb6 tempest-VolumesActionsTest-852108199 None] Lock "cinder-quobyte-00ae4da1-6290-43ec-b486-24e81ce8ea8d" released by "delete_volume" :: held 0.819s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:57:07 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-58d18c3b-e033-44e0-9553-22f972819cb6 tempest-VolumesActionsTest-852108199 None] Created reservations ['9afd5cb8-ba71-4650-ba1e-dcba1fbc0db6', 'bd1708cd-16e2-4891-9207-8ab1fa7f0f7f', '5099fc77-3e8b-4a2a-8f59-20abbb293a5e', 'c2657724-4163-4bec-88e1-203d8eef9207'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:57:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-58d18c3b-e033-44e0-9553-22f972819cb6 tempest-VolumesActionsTest-852108199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:57:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-58d18c3b-e033-44e0-9553-22f972819cb6 tempest-VolumesActionsTest-852108199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:57:07 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-58d18c3b-e033-44e0-9553-22f972819cb6 tempest-VolumesActionsTest-852108199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:57:07 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-58d18c3b-e033-44e0-9553-22f972819cb6 tempest-VolumesActionsTest-852108199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:57:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-58d18c3b-e033-44e0-9553-22f972819cb6 tempest-VolumesActionsTest-852108199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:57:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-58d18c3b-e033-44e0-9553-22f972819cb6 tempest-VolumesActionsTest-852108199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:07 devstack sudo[97605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:57:07 devstack sudo[97605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:07 devstack sudo[97605]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-58d18c3b-e033-44e0-9553-22f972819cb6 tempest-VolumesActionsTest-852108199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.263s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:07 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-58d18c3b-e033-44e0-9553-22f972819cb6 tempest-VolumesActionsTest-852108199 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:57:07 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-58d18c3b-e033-44e0-9553-22f972819cb6 tempest-VolumesActionsTest-852108199 None] Deleted volume successfully. Sep 04 17:57:07 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-58d18c3b-e033-44e0-9553-22f972819cb6 tempest-VolumesActionsTest-852108199 None] Lock "cinder-00ae4da1-6290-43ec-b486-24e81ce8ea8d-delete_volume" released by "delete_volume" :: held 1.398s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:57:08 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-73fed7ce-4134-4a28-a983-f6df17332395 tempest-VolumesActionsTest-4714917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:57:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-73fed7ce-4134-4a28-a983-f6df17332395 tempest-VolumesActionsTest-4714917 None] Flow 'volume_create_manager' (891cdd70-0893-47c1-9602-247011653b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:57:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-73fed7ce-4134-4a28-a983-f6df17332395 tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d75422c8-d920-4ae0-a18e-282beec501c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:57:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-73fed7ce-4134-4a28-a983-f6df17332395 tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d75422c8-d920-4ae0-a18e-282beec501c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:57:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2114442887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cca1066-6fef-4ea4-9730-a03996ec22ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38378c3abbf14ff4955c45d1c327ad3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:57:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:57:08Z,use_quota=True,user_id='875b51464a33490b8c4a2405e23a4980',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:57:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-73fed7ce-4134-4a28-a983-f6df17332395 tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae13cd8e-e368-4004-941b-7e07ff9a4dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:57:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-73fed7ce-4134-4a28-a983-f6df17332395 tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae13cd8e-e368-4004-941b-7e07ff9a4dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:57:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-73fed7ce-4134-4a28-a983-f6df17332395 tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a75b335-e24e-4087-a4de-684d05d01602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:57:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-73fed7ce-4134-4a28-a983-f6df17332395 tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a75b335-e24e-4087-a4de-684d05d01602) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cca1066-6fef-4ea4-9730-a03996ec22ec', 'volume_name': 'volume-9cca1066-6fef-4ea4-9730-a03996ec22ec', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:57:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-73fed7ce-4134-4a28-a983-f6df17332395 tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc4987c1-4306-43d5-94f5-850a4d2da2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:57:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-73fed7ce-4134-4a28-a983-f6df17332395 tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc4987c1-4306-43d5-94f5-850a4d2da2b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:57:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-73fed7ce-4134-4a28-a983-f6df17332395 tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5011d377-1bfc-4de8-a934-cfab3d40d904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:57:08 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-73fed7ce-4134-4a28-a983-f6df17332395 tempest-VolumesActionsTest-4714917 None] Volume 9cca1066-6fef-4ea4-9730-a03996ec22ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cca1066-6fef-4ea4-9730-a03996ec22ec', 'volume_size': 1} Sep 04 17:57:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-73fed7ce-4134-4a28-a983-f6df17332395 tempest-VolumesActionsTest-4714917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:57:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-73fed7ce-4134-4a28-a983-f6df17332395 tempest-VolumesActionsTest-4714917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:57:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-73fed7ce-4134-4a28-a983-f6df17332395 tempest-VolumesActionsTest-4714917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:57:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2114442887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cca1066-6fef-4ea4-9730-a03996ec22ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38378c3abbf14ff4955c45d1c327ad3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:57:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:57:08Z,use_quota=True,user_id='875b51464a33490b8c4a2405e23a4980',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:57:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-73fed7ce-4134-4a28-a983-f6df17332395 tempest-VolumesActionsTest-4714917 None] Creating volume 9cca1066-6fef-4ea4-9730-a03996ec22ec {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:57:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-73fed7ce-4134-4a28-a983-f6df17332395 tempest-VolumesActionsTest-4714917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:57:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-73fed7ce-4134-4a28-a983-f6df17332395 tempest-VolumesActionsTest-4714917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:57:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-73fed7ce-4134-4a28-a983-f6df17332395 tempest-VolumesActionsTest-4714917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:57:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-73fed7ce-4134-4a28-a983-f6df17332395 tempest-VolumesActionsTest-4714917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:57:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-73fed7ce-4134-4a28-a983-f6df17332395 tempest-VolumesActionsTest-4714917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:57:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-73fed7ce-4134-4a28-a983-f6df17332395 tempest-VolumesActionsTest-4714917 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:57:08 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-73fed7ce-4134-4a28-a983-f6df17332395 tempest-VolumesActionsTest-4714917 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:57:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-73fed7ce-4134-4a28-a983-f6df17332395 tempest-VolumesActionsTest-4714917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9cca1066-6fef-4ea4-9730-a03996ec22ec 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:08 devstack sudo[97609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9cca1066-6fef-4ea4-9730-a03996ec22ec 1073741824 Sep 04 17:57:08 devstack sudo[97609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:08 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-32fc8316-4ad7-4223-b5a4-ba74203e48ab tempest-GroupSnapshotsTest-1632469284 None] GroupSnapshot fbb2631d-45a8-4578-a5bc-9df09ef82980: creating. Sep 04 17:57:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-32fc8316-4ad7-4223-b5a4-ba74203e48ab tempest-GroupSnapshotsTest-1632469284 None] Group snapshot fbb2631d-45a8-4578-a5bc-9df09ef82980: creating. {{(pid=87314) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 04 17:57:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-32fc8316-4ad7-4223-b5a4-ba74203e48ab tempest-GroupSnapshotsTest-1632469284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:57:09 devstack sudo[97609]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-73fed7ce-4134-4a28-a983-f6df17332395 tempest-VolumesActionsTest-4714917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9cca1066-6fef-4ea4-9730-a03996ec22ec 1073741824" returned: 0 in 0.747s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-73fed7ce-4134-4a28-a983-f6df17332395 tempest-VolumesActionsTest-4714917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9cca1066-6fef-4ea4-9730-a03996ec22ec {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:09 devstack sudo[97616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9cca1066-6fef-4ea4-9730-a03996ec22ec Sep 04 17:57:09 devstack sudo[97616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:09 devstack sudo[97616]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-73fed7ce-4134-4a28-a983-f6df17332395 tempest-VolumesActionsTest-4714917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9cca1066-6fef-4ea4-9730-a03996ec22ec" returned: 0 in 0.341s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:09 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-73fed7ce-4134-4a28-a983-f6df17332395 tempest-VolumesActionsTest-4714917 None] <== create_volume: return (1167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:57:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-73fed7ce-4134-4a28-a983-f6df17332395 tempest-VolumesActionsTest-4714917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.170s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:57:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-32fc8316-4ad7-4223-b5a4-ba74203e48ab tempest-GroupSnapshotsTest-1632469284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.584s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:57:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-73fed7ce-4134-4a28-a983-f6df17332395 tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5011d377-1bfc-4de8-a934-cfab3d40d904) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cca1066-6fef-4ea4-9730-a03996ec22ec', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:57:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-73fed7ce-4134-4a28-a983-f6df17332395 tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aace644-10a4-4440-a480-ee3f8ac970e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:57:09 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-32fc8316-4ad7-4223-b5a4-ba74203e48ab tempest-GroupSnapshotsTest-1632469284 None] Creating offline snapshot c3fc4ebe-0f0e-4f80-a19e-e93235928266 of volume 33acfbd2-5942-4502-aeb5-3e32123e63ef {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 17:57:09 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-73fed7ce-4134-4a28-a983-f6df17332395 tempest-VolumesActionsTest-4714917 None] Volume volume-9cca1066-6fef-4ea4-9730-a03996ec22ec (9cca1066-6fef-4ea4-9730-a03996ec22ec): created successfully Sep 04 17:57:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-73fed7ce-4134-4a28-a983-f6df17332395 tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aace644-10a4-4440-a480-ee3f8ac970e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:57:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-73fed7ce-4134-4a28-a983-f6df17332395 tempest-VolumesActionsTest-4714917 None] Flow 'volume_create_manager' (891cdd70-0893-47c1-9602-247011653b91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:57:09 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3e08b6-05c0-4653-8447-2fcfc58485cb]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:57:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-32fc8316-4ad7-4223-b5a4-ba74203e48ab tempest-GroupSnapshotsTest-1632469284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-33acfbd2-5942-4502-aeb5-3e32123e63ef {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:09 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-73fed7ce-4134-4a28-a983-f6df17332395 tempest-VolumesActionsTest-4714917 None] Created volume successfully. Sep 04 17:57:09 devstack sudo[97620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-33acfbd2-5942-4502-aeb5-3e32123e63ef Sep 04 17:57:09 devstack sudo[97620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:10 devstack sudo[97620]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-32fc8316-4ad7-4223-b5a4-ba74203e48ab tempest-GroupSnapshotsTest-1632469284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-33acfbd2-5942-4502-aeb5-3e32123e63ef" returned: 0 in 0.454s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-32fc8316-4ad7-4223-b5a4-ba74203e48ab tempest-GroupSnapshotsTest-1632469284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-33acfbd2-5942-4502-aeb5-3e32123e63ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-33acfbd2-5942-4502-aeb5-3e32123e63ef.c3fc4ebe-0f0e-4f80-a19e-e93235928266 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:10 devstack sudo[97625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-33acfbd2-5942-4502-aeb5-3e32123e63ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-33acfbd2-5942-4502-aeb5-3e32123e63ef.c3fc4ebe-0f0e-4f80-a19e-e93235928266 1G Sep 04 17:57:10 devstack sudo[97625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:10 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-bf00817c-58b3-46b8-b4c2-eae2e8cc28ce tempest-VolumesActionsTest-852108199 None] Acquiring lock "cinder-9cca1066-6fef-4ea4-9730-a03996ec22ec-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:57:10 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-bf00817c-58b3-46b8-b4c2-eae2e8cc28ce tempest-VolumesActionsTest-852108199 None] Lock "cinder-9cca1066-6fef-4ea4-9730-a03996ec22ec-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:57:10 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-bf00817c-58b3-46b8-b4c2-eae2e8cc28ce tempest-VolumesActionsTest-852108199 None] Acquiring lock "cinder-quobyte-9cca1066-6fef-4ea4-9730-a03996ec22ec" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:57:10 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-bf00817c-58b3-46b8-b4c2-eae2e8cc28ce tempest-VolumesActionsTest-852108199 None] Lock "cinder-quobyte-9cca1066-6fef-4ea4-9730-a03996ec22ec" acquired by "delete_volume" :: waited 0.026s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:57:10 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f72e8ab-c756-43d6-8535-b5d086c08d8c]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:57:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bf00817c-58b3-46b8-b4c2-eae2e8cc28ce tempest-VolumesActionsTest-852108199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9cca1066-6fef-4ea4-9730-a03996ec22ec {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:10 devstack sudo[97625]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-32fc8316-4ad7-4223-b5a4-ba74203e48ab tempest-GroupSnapshotsTest-1632469284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-33acfbd2-5942-4502-aeb5-3e32123e63ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-33acfbd2-5942-4502-aeb5-3e32123e63ef.c3fc4ebe-0f0e-4f80-a19e-e93235928266 1G" returned: 0 in 0.686s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-32fc8316-4ad7-4223-b5a4-ba74203e48ab tempest-GroupSnapshotsTest-1632469284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33acfbd2-5942-4502-aeb5-3e32123e63ef -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-33acfbd2-5942-4502-aeb5-3e32123e63ef.c3fc4ebe-0f0e-4f80-a19e-e93235928266 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:10 devstack sudo[97643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33acfbd2-5942-4502-aeb5-3e32123e63ef -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-33acfbd2-5942-4502-aeb5-3e32123e63ef.c3fc4ebe-0f0e-4f80-a19e-e93235928266 Sep 04 17:57:10 devstack sudo[97643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:10 devstack sudo[97642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9cca1066-6fef-4ea4-9730-a03996ec22ec Sep 04 17:57:10 devstack sudo[97642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:11 devstack sudo[97643]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-32fc8316-4ad7-4223-b5a4-ba74203e48ab tempest-GroupSnapshotsTest-1632469284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33acfbd2-5942-4502-aeb5-3e32123e63ef -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-33acfbd2-5942-4502-aeb5-3e32123e63ef.c3fc4ebe-0f0e-4f80-a19e-e93235928266" returned: 0 in 0.339s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:11 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-32fc8316-4ad7-4223-b5a4-ba74203e48ab tempest-GroupSnapshotsTest-1632469284 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-33acfbd2-5942-4502-aeb5-3e32123e63ef.c3fc4ebe-0f0e-4f80-a19e-e93235928266 is being set with open permissions: ugo+rw: NotImplementedError Sep 04 17:57:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-32fc8316-4ad7-4223-b5a4-ba74203e48ab tempest-GroupSnapshotsTest-1632469284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-33acfbd2-5942-4502-aeb5-3e32123e63ef.c3fc4ebe-0f0e-4f80-a19e-e93235928266 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:11 devstack sudo[97659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-33acfbd2-5942-4502-aeb5-3e32123e63ef.c3fc4ebe-0f0e-4f80-a19e-e93235928266 Sep 04 17:57:11 devstack sudo[97659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:11 devstack sudo[97642]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bf00817c-58b3-46b8-b4c2-eae2e8cc28ce tempest-VolumesActionsTest-852108199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9cca1066-6fef-4ea4-9730-a03996ec22ec" returned: 0 in 0.449s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bf00817c-58b3-46b8-b4c2-eae2e8cc28ce tempest-VolumesActionsTest-852108199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9cca1066-6fef-4ea4-9730-a03996ec22ec {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:11 devstack sudo[97662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9cca1066-6fef-4ea4-9730-a03996ec22ec Sep 04 17:57:11 devstack sudo[97662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:11 devstack sudo[97659]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-32fc8316-4ad7-4223-b5a4-ba74203e48ab tempest-GroupSnapshotsTest-1632469284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-33acfbd2-5942-4502-aeb5-3e32123e63ef.c3fc4ebe-0f0e-4f80-a19e-e93235928266" returned: 0 in 0.299s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-32fc8316-4ad7-4223-b5a4-ba74203e48ab tempest-GroupSnapshotsTest-1632469284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-33acfbd2-5942-4502-aeb5-3e32123e63ef.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:11 devstack sudo[97662]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:11 devstack sudo[97675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-33acfbd2-5942-4502-aeb5-3e32123e63ef.info Sep 04 17:57:11 devstack sudo[97675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bf00817c-58b3-46b8-b4c2-eae2e8cc28ce tempest-VolumesActionsTest-852108199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9cca1066-6fef-4ea4-9730-a03996ec22ec" returned: 0 in 0.365s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:11 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-bf00817c-58b3-46b8-b4c2-eae2e8cc28ce tempest-VolumesActionsTest-852108199 None] Lock "cinder-quobyte-9cca1066-6fef-4ea4-9730-a03996ec22ec" released by "delete_volume" :: held 0.876s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:57:11 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-bf00817c-58b3-46b8-b4c2-eae2e8cc28ce tempest-VolumesActionsTest-852108199 None] Created reservations ['6cbb37a4-2581-4cd4-b584-ec68a493cae3', '923edea2-1f4a-442b-8772-bae4dacab5c5', '3e4d163b-2f91-48a2-80a4-3ac615887ca4', 'a1c089c1-58b2-4fc1-966e-db876498866c'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:57:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bf00817c-58b3-46b8-b4c2-eae2e8cc28ce tempest-VolumesActionsTest-852108199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:57:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bf00817c-58b3-46b8-b4c2-eae2e8cc28ce tempest-VolumesActionsTest-852108199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:57:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-bf00817c-58b3-46b8-b4c2-eae2e8cc28ce tempest-VolumesActionsTest-852108199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:57:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-bf00817c-58b3-46b8-b4c2-eae2e8cc28ce tempest-VolumesActionsTest-852108199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:57:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bf00817c-58b3-46b8-b4c2-eae2e8cc28ce tempest-VolumesActionsTest-852108199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:57:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bf00817c-58b3-46b8-b4c2-eae2e8cc28ce tempest-VolumesActionsTest-852108199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:11 devstack sudo[97680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:57:11 devstack sudo[97680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:11 devstack sudo[97675]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-32fc8316-4ad7-4223-b5a4-ba74203e48ab tempest-GroupSnapshotsTest-1632469284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-33acfbd2-5942-4502-aeb5-3e32123e63ef.info" returned: 0 in 0.417s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:11 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-32fc8316-4ad7-4223-b5a4-ba74203e48ab tempest-GroupSnapshotsTest-1632469284 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-33acfbd2-5942-4502-aeb5-3e32123e63ef.info is being set with open permissions: ugo+rw: NotImplementedError Sep 04 17:57:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-32fc8316-4ad7-4223-b5a4-ba74203e48ab tempest-GroupSnapshotsTest-1632469284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-33acfbd2-5942-4502-aeb5-3e32123e63ef.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:11 devstack sudo[97692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-33acfbd2-5942-4502-aeb5-3e32123e63ef.info Sep 04 17:57:11 devstack sudo[97692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:12 devstack sudo[97680]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bf00817c-58b3-46b8-b4c2-eae2e8cc28ce tempest-VolumesActionsTest-852108199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.325s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:12 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-bf00817c-58b3-46b8-b4c2-eae2e8cc28ce tempest-VolumesActionsTest-852108199 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:57:12 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-bf00817c-58b3-46b8-b4c2-eae2e8cc28ce tempest-VolumesActionsTest-852108199 None] Deleted volume successfully. Sep 04 17:57:12 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-bf00817c-58b3-46b8-b4c2-eae2e8cc28ce tempest-VolumesActionsTest-852108199 None] Lock "cinder-9cca1066-6fef-4ea4-9730-a03996ec22ec-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:57:12 devstack sudo[97692]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-32fc8316-4ad7-4223-b5a4-ba74203e48ab tempest-GroupSnapshotsTest-1632469284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-33acfbd2-5942-4502-aeb5-3e32123e63ef.info" returned: 0 in 0.388s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-32fc8316-4ad7-4223-b5a4-ba74203e48ab tempest-GroupSnapshotsTest-1632469284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.765s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:57:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-32fc8316-4ad7-4223-b5a4-ba74203e48ab tempest-GroupSnapshotsTest-1632469284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:57:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-32fc8316-4ad7-4223-b5a4-ba74203e48ab tempest-GroupSnapshotsTest-1632469284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:57:12 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-32fc8316-4ad7-4223-b5a4-ba74203e48ab tempest-GroupSnapshotsTest-1632469284 None] Creating offline snapshot d2adbe9c-f279-4239-a672-57dd50be5c3f of volume 6727c47f-2920-4a08-b13c-b35a469a5134 {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 17:57:12 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9c6761-d7d3-42c5-8e42-ef65f10b77d0]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:57:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-32fc8316-4ad7-4223-b5a4-ba74203e48ab tempest-GroupSnapshotsTest-1632469284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6727c47f-2920-4a08-b13c-b35a469a5134 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:12 devstack sudo[97696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6727c47f-2920-4a08-b13c-b35a469a5134 Sep 04 17:57:12 devstack sudo[97696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:12 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-c27a7d23-29b7-44b6-bf5f-c2de0b783b61 tempest-VolumesActionsTest-4714917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:57:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c27a7d23-29b7-44b6-bf5f-c2de0b783b61 tempest-VolumesActionsTest-4714917 None] Flow 'volume_create_manager' (a514ab8d-13d1-4f0a-a51d-16589d9e941f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:57:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c27a7d23-29b7-44b6-bf5f-c2de0b783b61 tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (493b724c-7383-4bf5-b552-b3447f61318f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:57:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c27a7d23-29b7-44b6-bf5f-c2de0b783b61 tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (493b724c-7383-4bf5-b552-b3447f61318f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:57:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1695381455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49287090-0094-4be5-b643-df5b7757ed5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38378c3abbf14ff4955c45d1c327ad3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:57:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:57:13Z,use_quota=True,user_id='875b51464a33490b8c4a2405e23a4980',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:57:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c27a7d23-29b7-44b6-bf5f-c2de0b783b61 tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15f2006b-b0ce-4209-a1a3-7348c64cf411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:57:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c27a7d23-29b7-44b6-bf5f-c2de0b783b61 tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15f2006b-b0ce-4209-a1a3-7348c64cf411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:57:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c27a7d23-29b7-44b6-bf5f-c2de0b783b61 tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7be43a6b-3972-4dc9-871c-d57695b92305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:57:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c27a7d23-29b7-44b6-bf5f-c2de0b783b61 tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7be43a6b-3972-4dc9-871c-d57695b92305) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49287090-0094-4be5-b643-df5b7757ed5c', 'volume_name': 'volume-49287090-0094-4be5-b643-df5b7757ed5c', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:57:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c27a7d23-29b7-44b6-bf5f-c2de0b783b61 tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2beae9e6-1b6f-481d-a0b0-75035e342b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:57:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c27a7d23-29b7-44b6-bf5f-c2de0b783b61 tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2beae9e6-1b6f-481d-a0b0-75035e342b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:57:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c27a7d23-29b7-44b6-bf5f-c2de0b783b61 tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e07eef9-e5e4-42fd-80e6-701f5f22d43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:57:12 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-c27a7d23-29b7-44b6-bf5f-c2de0b783b61 tempest-VolumesActionsTest-4714917 None] Volume 49287090-0094-4be5-b643-df5b7757ed5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49287090-0094-4be5-b643-df5b7757ed5c', 'volume_size': 1} Sep 04 17:57:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c27a7d23-29b7-44b6-bf5f-c2de0b783b61 tempest-VolumesActionsTest-4714917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:57:12 devstack sudo[97696]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-32fc8316-4ad7-4223-b5a4-ba74203e48ab tempest-GroupSnapshotsTest-1632469284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6727c47f-2920-4a08-b13c-b35a469a5134" returned: 0 in 0.470s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-32fc8316-4ad7-4223-b5a4-ba74203e48ab tempest-GroupSnapshotsTest-1632469284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6727c47f-2920-4a08-b13c-b35a469a5134,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6727c47f-2920-4a08-b13c-b35a469a5134.d2adbe9c-f279-4239-a672-57dd50be5c3f 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:12 devstack sudo[97702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6727c47f-2920-4a08-b13c-b35a469a5134,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6727c47f-2920-4a08-b13c-b35a469a5134.d2adbe9c-f279-4239-a672-57dd50be5c3f 1G Sep 04 17:57:12 devstack sudo[97702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:13 devstack sudo[97702]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-32fc8316-4ad7-4223-b5a4-ba74203e48ab tempest-GroupSnapshotsTest-1632469284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6727c47f-2920-4a08-b13c-b35a469a5134,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6727c47f-2920-4a08-b13c-b35a469a5134.d2adbe9c-f279-4239-a672-57dd50be5c3f 1G" returned: 0 in 0.517s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-32fc8316-4ad7-4223-b5a4-ba74203e48ab tempest-GroupSnapshotsTest-1632469284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6727c47f-2920-4a08-b13c-b35a469a5134 -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6727c47f-2920-4a08-b13c-b35a469a5134.d2adbe9c-f279-4239-a672-57dd50be5c3f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:13 devstack sudo[97709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6727c47f-2920-4a08-b13c-b35a469a5134 -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6727c47f-2920-4a08-b13c-b35a469a5134.d2adbe9c-f279-4239-a672-57dd50be5c3f Sep 04 17:57:13 devstack sudo[97709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:13 devstack sudo[97709]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-32fc8316-4ad7-4223-b5a4-ba74203e48ab tempest-GroupSnapshotsTest-1632469284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6727c47f-2920-4a08-b13c-b35a469a5134 -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6727c47f-2920-4a08-b13c-b35a469a5134.d2adbe9c-f279-4239-a672-57dd50be5c3f" returned: 0 in 0.324s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:13 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-32fc8316-4ad7-4223-b5a4-ba74203e48ab tempest-GroupSnapshotsTest-1632469284 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6727c47f-2920-4a08-b13c-b35a469a5134.d2adbe9c-f279-4239-a672-57dd50be5c3f is being set with open permissions: ugo+rw: NotImplementedError Sep 04 17:57:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-32fc8316-4ad7-4223-b5a4-ba74203e48ab tempest-GroupSnapshotsTest-1632469284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6727c47f-2920-4a08-b13c-b35a469a5134.d2adbe9c-f279-4239-a672-57dd50be5c3f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:13 devstack sudo[97714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6727c47f-2920-4a08-b13c-b35a469a5134.d2adbe9c-f279-4239-a672-57dd50be5c3f Sep 04 17:57:13 devstack sudo[97714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:14 devstack sudo[97714]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-32fc8316-4ad7-4223-b5a4-ba74203e48ab tempest-GroupSnapshotsTest-1632469284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6727c47f-2920-4a08-b13c-b35a469a5134.d2adbe9c-f279-4239-a672-57dd50be5c3f" returned: 0 in 0.461s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-32fc8316-4ad7-4223-b5a4-ba74203e48ab tempest-GroupSnapshotsTest-1632469284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6727c47f-2920-4a08-b13c-b35a469a5134.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:14 devstack sudo[97736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6727c47f-2920-4a08-b13c-b35a469a5134.info Sep 04 17:57:14 devstack sudo[97736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:14 devstack sudo[97736]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-32fc8316-4ad7-4223-b5a4-ba74203e48ab tempest-GroupSnapshotsTest-1632469284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6727c47f-2920-4a08-b13c-b35a469a5134.info" returned: 0 in 0.488s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:14 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-32fc8316-4ad7-4223-b5a4-ba74203e48ab tempest-GroupSnapshotsTest-1632469284 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6727c47f-2920-4a08-b13c-b35a469a5134.info is being set with open permissions: ugo+rw: NotImplementedError Sep 04 17:57:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-32fc8316-4ad7-4223-b5a4-ba74203e48ab tempest-GroupSnapshotsTest-1632469284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6727c47f-2920-4a08-b13c-b35a469a5134.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:14 devstack sudo[97776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6727c47f-2920-4a08-b13c-b35a469a5134.info Sep 04 17:57:14 devstack sudo[97776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:15 devstack sudo[97776]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-32fc8316-4ad7-4223-b5a4-ba74203e48ab tempest-GroupSnapshotsTest-1632469284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6727c47f-2920-4a08-b13c-b35a469a5134.info" returned: 0 in 0.366s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-32fc8316-4ad7-4223-b5a4-ba74203e48ab tempest-GroupSnapshotsTest-1632469284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.756s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:57:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c27a7d23-29b7-44b6-bf5f-c2de0b783b61 tempest-VolumesActionsTest-4714917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.350s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:57:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c27a7d23-29b7-44b6-bf5f-c2de0b783b61 tempest-VolumesActionsTest-4714917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:57:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1695381455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49287090-0094-4be5-b643-df5b7757ed5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38378c3abbf14ff4955c45d1c327ad3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:57:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:57:13Z,use_quota=True,user_id='875b51464a33490b8c4a2405e23a4980',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:57:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-c27a7d23-29b7-44b6-bf5f-c2de0b783b61 tempest-VolumesActionsTest-4714917 None] Creating volume 49287090-0094-4be5-b643-df5b7757ed5c {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:57:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c27a7d23-29b7-44b6-bf5f-c2de0b783b61 tempest-VolumesActionsTest-4714917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:57:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c27a7d23-29b7-44b6-bf5f-c2de0b783b61 tempest-VolumesActionsTest-4714917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:57:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c27a7d23-29b7-44b6-bf5f-c2de0b783b61 tempest-VolumesActionsTest-4714917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:57:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c27a7d23-29b7-44b6-bf5f-c2de0b783b61 tempest-VolumesActionsTest-4714917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:57:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c27a7d23-29b7-44b6-bf5f-c2de0b783b61 tempest-VolumesActionsTest-4714917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:57:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c27a7d23-29b7-44b6-bf5f-c2de0b783b61 tempest-VolumesActionsTest-4714917 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:57:15 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-c27a7d23-29b7-44b6-bf5f-c2de0b783b61 tempest-VolumesActionsTest-4714917 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:57:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c27a7d23-29b7-44b6-bf5f-c2de0b783b61 tempest-VolumesActionsTest-4714917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-49287090-0094-4be5-b643-df5b7757ed5c 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:15 devstack sudo[97787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-49287090-0094-4be5-b643-df5b7757ed5c 1073741824 Sep 04 17:57:15 devstack sudo[97787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:15 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-32fc8316-4ad7-4223-b5a4-ba74203e48ab tempest-GroupSnapshotsTest-1632469284 None] group_snapshot fbb2631d-45a8-4578-a5bc-9df09ef82980: created successfully Sep 04 17:57:15 devstack sudo[97787]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c27a7d23-29b7-44b6-bf5f-c2de0b783b61 tempest-VolumesActionsTest-4714917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-49287090-0094-4be5-b643-df5b7757ed5c 1073741824" returned: 0 in 0.793s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c27a7d23-29b7-44b6-bf5f-c2de0b783b61 tempest-VolumesActionsTest-4714917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-49287090-0094-4be5-b643-df5b7757ed5c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:16 devstack sudo[97798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-49287090-0094-4be5-b643-df5b7757ed5c Sep 04 17:57:16 devstack sudo[97798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:16 devstack sudo[97798]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c27a7d23-29b7-44b6-bf5f-c2de0b783b61 tempest-VolumesActionsTest-4714917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-49287090-0094-4be5-b643-df5b7757ed5c" returned: 0 in 0.323s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:16 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c27a7d23-29b7-44b6-bf5f-c2de0b783b61 tempest-VolumesActionsTest-4714917 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:57:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c27a7d23-29b7-44b6-bf5f-c2de0b783b61 tempest-VolumesActionsTest-4714917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:57:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c27a7d23-29b7-44b6-bf5f-c2de0b783b61 tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e07eef9-e5e4-42fd-80e6-701f5f22d43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49287090-0094-4be5-b643-df5b7757ed5c', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:57:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c27a7d23-29b7-44b6-bf5f-c2de0b783b61 tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68f8e58b-05f8-4bca-9f79-fd2340888158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:57:16 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-c27a7d23-29b7-44b6-bf5f-c2de0b783b61 tempest-VolumesActionsTest-4714917 None] Volume volume-49287090-0094-4be5-b643-df5b7757ed5c (49287090-0094-4be5-b643-df5b7757ed5c): created successfully Sep 04 17:57:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c27a7d23-29b7-44b6-bf5f-c2de0b783b61 tempest-VolumesActionsTest-4714917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68f8e58b-05f8-4bca-9f79-fd2340888158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:57:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c27a7d23-29b7-44b6-bf5f-c2de0b783b61 tempest-VolumesActionsTest-4714917 None] Flow 'volume_create_manager' (a514ab8d-13d1-4f0a-a51d-16589d9e941f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:57:16 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-c27a7d23-29b7-44b6-bf5f-c2de0b783b61 tempest-VolumesActionsTest-4714917 None] Created volume successfully. Sep 04 17:57:16 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-52e64193-b10b-45b9-844f-b4d022c9679b tempest-GroupSnapshotsTest-1632469284 None] group_snapshot fbb2631d-45a8-4578-a5bc-9df09ef82980: deleting Sep 04 17:57:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-52e64193-b10b-45b9-844f-b4d022c9679b tempest-GroupSnapshotsTest-1632469284 None] group_snapshot fbb2631d-45a8-4578-a5bc-9df09ef82980: deleting {{(pid=87314) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 04 17:57:16 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-52e64193-b10b-45b9-844f-b4d022c9679b tempest-GroupSnapshotsTest-1632469284 None] Acquiring lock "cinder-quobyte-33acfbd2-5942-4502-aeb5-3e32123e63ef" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:57:16 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-52e64193-b10b-45b9-844f-b4d022c9679b tempest-GroupSnapshotsTest-1632469284 None] Lock "cinder-quobyte-33acfbd2-5942-4502-aeb5-3e32123e63ef" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:57:16 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-52e64193-b10b-45b9-844f-b4d022c9679b tempest-GroupSnapshotsTest-1632469284 None] Acquiring lock "cinder-quobyte-c3fc4ebe-0f0e-4f80-a19e-e93235928266" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:57:16 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-52e64193-b10b-45b9-844f-b4d022c9679b tempest-GroupSnapshotsTest-1632469284 None] Lock "cinder-quobyte-c3fc4ebe-0f0e-4f80-a19e-e93235928266" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:57:16 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-52e64193-b10b-45b9-844f-b4d022c9679b tempest-GroupSnapshotsTest-1632469284 None] Deleting offline snapshot c3fc4ebe-0f0e-4f80-a19e-e93235928266 of volume 33acfbd2-5942-4502-aeb5-3e32123e63ef {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 17:57:16 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-52e64193-b10b-45b9-844f-b4d022c9679b tempest-GroupSnapshotsTest-1632469284 None] snapshot_file for this snap is: volume-33acfbd2-5942-4502-aeb5-3e32123e63ef.c3fc4ebe-0f0e-4f80-a19e-e93235928266 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 17:57:16 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13aabbd-4be3-432a-9f5c-ca2f59e9e201]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:57:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-52e64193-b10b-45b9-844f-b4d022c9679b tempest-GroupSnapshotsTest-1632469284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-33acfbd2-5942-4502-aeb5-3e32123e63ef.c3fc4ebe-0f0e-4f80-a19e-e93235928266 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:17 devstack sudo[97801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-33acfbd2-5942-4502-aeb5-3e32123e63ef.c3fc4ebe-0f0e-4f80-a19e-e93235928266 Sep 04 17:57:17 devstack sudo[97801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:17 devstack sudo[97801]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-52e64193-b10b-45b9-844f-b4d022c9679b tempest-GroupSnapshotsTest-1632469284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-33acfbd2-5942-4502-aeb5-3e32123e63ef.c3fc4ebe-0f0e-4f80-a19e-e93235928266" returned: 0 in 0.508s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:17 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-52e64193-b10b-45b9-844f-b4d022c9679b tempest-GroupSnapshotsTest-1632469284 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33acfbd2-5942-4502-aeb5-3e32123e63ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 17:57:17 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a23c12b-df50-4b40-8a3b-2a8663d2b053]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:57:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-52e64193-b10b-45b9-844f-b4d022c9679b tempest-GroupSnapshotsTest-1632469284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-33acfbd2-5942-4502-aeb5-3e32123e63ef {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:17 devstack sudo[97807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-33acfbd2-5942-4502-aeb5-3e32123e63ef Sep 04 17:57:17 devstack sudo[97807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:18 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-24a7011c-cfcf-4277-a518-52cc98ef64f1 tempest-VolumesActionsTest-4714917 None] Acquiring lock "cinder-49287090-0094-4be5-b643-df5b7757ed5c-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:57:18 devstack sudo[97807]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-52e64193-b10b-45b9-844f-b4d022c9679b tempest-GroupSnapshotsTest-1632469284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-33acfbd2-5942-4502-aeb5-3e32123e63ef" returned: 0 in 0.737s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-52e64193-b10b-45b9-844f-b4d022c9679b tempest-GroupSnapshotsTest-1632469284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-33acfbd2-5942-4502-aeb5-3e32123e63ef.c3fc4ebe-0f0e-4f80-a19e-e93235928266 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:18 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-24a7011c-cfcf-4277-a518-52cc98ef64f1 tempest-VolumesActionsTest-4714917 None] Lock "cinder-49287090-0094-4be5-b643-df5b7757ed5c-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:57:18 devstack sudo[97812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-33acfbd2-5942-4502-aeb5-3e32123e63ef.c3fc4ebe-0f0e-4f80-a19e-e93235928266 Sep 04 17:57:18 devstack sudo[97812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:18 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-24a7011c-cfcf-4277-a518-52cc98ef64f1 tempest-VolumesActionsTest-4714917 None] Acquiring lock "cinder-quobyte-49287090-0094-4be5-b643-df5b7757ed5c" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:57:18 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-24a7011c-cfcf-4277-a518-52cc98ef64f1 tempest-VolumesActionsTest-4714917 None] Lock "cinder-quobyte-49287090-0094-4be5-b643-df5b7757ed5c" acquired by "delete_volume" :: waited 0.029s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:57:18 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[b065695a-1bb0-4bf5-9e62-e525e8d77e5b]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:57:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-24a7011c-cfcf-4277-a518-52cc98ef64f1 tempest-VolumesActionsTest-4714917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-49287090-0094-4be5-b643-df5b7757ed5c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:18 devstack sudo[97814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-49287090-0094-4be5-b643-df5b7757ed5c Sep 04 17:57:18 devstack sudo[97814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:18 devstack sudo[97812]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-52e64193-b10b-45b9-844f-b4d022c9679b tempest-GroupSnapshotsTest-1632469284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-33acfbd2-5942-4502-aeb5-3e32123e63ef.c3fc4ebe-0f0e-4f80-a19e-e93235928266" returned: 0 in 0.485s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-52e64193-b10b-45b9-844f-b4d022c9679b tempest-GroupSnapshotsTest-1632469284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-33acfbd2-5942-4502-aeb5-3e32123e63ef.c3fc4ebe-0f0e-4f80-a19e-e93235928266 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:18 devstack sudo[97820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-33acfbd2-5942-4502-aeb5-3e32123e63ef.c3fc4ebe-0f0e-4f80-a19e-e93235928266 Sep 04 17:57:18 devstack sudo[97820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:18 devstack sudo[97814]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-24a7011c-cfcf-4277-a518-52cc98ef64f1 tempest-VolumesActionsTest-4714917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-49287090-0094-4be5-b643-df5b7757ed5c" returned: 0 in 0.454s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-24a7011c-cfcf-4277-a518-52cc98ef64f1 tempest-VolumesActionsTest-4714917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-49287090-0094-4be5-b643-df5b7757ed5c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:18 devstack sudo[97825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-49287090-0094-4be5-b643-df5b7757ed5c Sep 04 17:57:18 devstack sudo[97825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:19 devstack sudo[97820]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-52e64193-b10b-45b9-844f-b4d022c9679b tempest-GroupSnapshotsTest-1632469284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-33acfbd2-5942-4502-aeb5-3e32123e63ef.c3fc4ebe-0f0e-4f80-a19e-e93235928266" returned: 0 in 0.261s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:19 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-52e64193-b10b-45b9-844f-b4d022c9679b tempest-GroupSnapshotsTest-1632469284 None] Lock "cinder-quobyte-c3fc4ebe-0f0e-4f80-a19e-e93235928266" released by "_delete_snapshot" :: held 2.154s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:57:19 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-52e64193-b10b-45b9-844f-b4d022c9679b tempest-GroupSnapshotsTest-1632469284 None] Lock "cinder-quobyte-33acfbd2-5942-4502-aeb5-3e32123e63ef" released by "delete_snapshot" :: held 2.183s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:57:19 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-52e64193-b10b-45b9-844f-b4d022c9679b tempest-GroupSnapshotsTest-1632469284 None] Acquiring lock "cinder-quobyte-6727c47f-2920-4a08-b13c-b35a469a5134" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:57:19 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-52e64193-b10b-45b9-844f-b4d022c9679b tempest-GroupSnapshotsTest-1632469284 None] Lock "cinder-quobyte-6727c47f-2920-4a08-b13c-b35a469a5134" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:57:19 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-52e64193-b10b-45b9-844f-b4d022c9679b tempest-GroupSnapshotsTest-1632469284 None] Acquiring lock "cinder-quobyte-d2adbe9c-f279-4239-a672-57dd50be5c3f" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:57:19 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-52e64193-b10b-45b9-844f-b4d022c9679b tempest-GroupSnapshotsTest-1632469284 None] Lock "cinder-quobyte-d2adbe9c-f279-4239-a672-57dd50be5c3f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:57:19 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-52e64193-b10b-45b9-844f-b4d022c9679b tempest-GroupSnapshotsTest-1632469284 None] Deleting offline snapshot d2adbe9c-f279-4239-a672-57dd50be5c3f of volume 6727c47f-2920-4a08-b13c-b35a469a5134 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 17:57:19 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-52e64193-b10b-45b9-844f-b4d022c9679b tempest-GroupSnapshotsTest-1632469284 None] snapshot_file for this snap is: volume-6727c47f-2920-4a08-b13c-b35a469a5134.d2adbe9c-f279-4239-a672-57dd50be5c3f {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 17:57:19 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7e4af8-7a26-41c8-abed-08f1bbce4e76]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:57:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-52e64193-b10b-45b9-844f-b4d022c9679b tempest-GroupSnapshotsTest-1632469284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6727c47f-2920-4a08-b13c-b35a469a5134.d2adbe9c-f279-4239-a672-57dd50be5c3f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:19 devstack sudo[97825]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-24a7011c-cfcf-4277-a518-52cc98ef64f1 tempest-VolumesActionsTest-4714917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-49287090-0094-4be5-b643-df5b7757ed5c" returned: 0 in 0.278s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:19 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-24a7011c-cfcf-4277-a518-52cc98ef64f1 tempest-VolumesActionsTest-4714917 None] Lock "cinder-quobyte-49287090-0094-4be5-b643-df5b7757ed5c" released by "delete_volume" :: held 0.789s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:57:19 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-24a7011c-cfcf-4277-a518-52cc98ef64f1 tempest-VolumesActionsTest-4714917 None] Created reservations ['e445ceea-edc5-42c2-b477-d177c4135491', 'b27ececb-7c78-4074-a5a1-ed6db0f84761', '85d660c7-2dc5-4642-b2e8-202acb93885c', '6bc632f4-4df8-4077-b288-ac304fe011f8'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:57:19 devstack sudo[97829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6727c47f-2920-4a08-b13c-b35a469a5134.d2adbe9c-f279-4239-a672-57dd50be5c3f Sep 04 17:57:19 devstack sudo[97829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-24a7011c-cfcf-4277-a518-52cc98ef64f1 tempest-VolumesActionsTest-4714917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:57:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-24a7011c-cfcf-4277-a518-52cc98ef64f1 tempest-VolumesActionsTest-4714917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:57:19 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-24a7011c-cfcf-4277-a518-52cc98ef64f1 tempest-VolumesActionsTest-4714917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:57:19 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-24a7011c-cfcf-4277-a518-52cc98ef64f1 tempest-VolumesActionsTest-4714917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:57:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-24a7011c-cfcf-4277-a518-52cc98ef64f1 tempest-VolumesActionsTest-4714917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:57:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-24a7011c-cfcf-4277-a518-52cc98ef64f1 tempest-VolumesActionsTest-4714917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:19 devstack sudo[97831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:57:19 devstack sudo[97831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:19 devstack sudo[97831]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-24a7011c-cfcf-4277-a518-52cc98ef64f1 tempest-VolumesActionsTest-4714917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.291s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:19 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-24a7011c-cfcf-4277-a518-52cc98ef64f1 tempest-VolumesActionsTest-4714917 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:57:19 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-24a7011c-cfcf-4277-a518-52cc98ef64f1 tempest-VolumesActionsTest-4714917 None] Deleted volume successfully. Sep 04 17:57:19 devstack sudo[97829]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-52e64193-b10b-45b9-844f-b4d022c9679b tempest-GroupSnapshotsTest-1632469284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6727c47f-2920-4a08-b13c-b35a469a5134.d2adbe9c-f279-4239-a672-57dd50be5c3f" returned: 0 in 0.468s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:19 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-52e64193-b10b-45b9-844f-b4d022c9679b tempest-GroupSnapshotsTest-1632469284 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6727c47f-2920-4a08-b13c-b35a469a5134(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 17:57:19 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[036589d3-01f9-495e-a660-e4a6bf24dac6]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:57:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-52e64193-b10b-45b9-844f-b4d022c9679b tempest-GroupSnapshotsTest-1632469284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6727c47f-2920-4a08-b13c-b35a469a5134 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:19 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-24a7011c-cfcf-4277-a518-52cc98ef64f1 tempest-VolumesActionsTest-4714917 None] Lock "cinder-49287090-0094-4be5-b643-df5b7757ed5c-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:57:19 devstack sudo[97837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6727c47f-2920-4a08-b13c-b35a469a5134 Sep 04 17:57:19 devstack sudo[97837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:20 devstack sudo[97837]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-52e64193-b10b-45b9-844f-b4d022c9679b tempest-GroupSnapshotsTest-1632469284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6727c47f-2920-4a08-b13c-b35a469a5134" returned: 0 in 0.408s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-52e64193-b10b-45b9-844f-b4d022c9679b tempest-GroupSnapshotsTest-1632469284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6727c47f-2920-4a08-b13c-b35a469a5134.d2adbe9c-f279-4239-a672-57dd50be5c3f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:20 devstack sudo[97842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6727c47f-2920-4a08-b13c-b35a469a5134.d2adbe9c-f279-4239-a672-57dd50be5c3f Sep 04 17:57:20 devstack sudo[97842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:20 devstack sudo[97842]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-52e64193-b10b-45b9-844f-b4d022c9679b tempest-GroupSnapshotsTest-1632469284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6727c47f-2920-4a08-b13c-b35a469a5134.d2adbe9c-f279-4239-a672-57dd50be5c3f" returned: 0 in 0.404s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-52e64193-b10b-45b9-844f-b4d022c9679b tempest-GroupSnapshotsTest-1632469284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6727c47f-2920-4a08-b13c-b35a469a5134.d2adbe9c-f279-4239-a672-57dd50be5c3f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:20 devstack sudo[97847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6727c47f-2920-4a08-b13c-b35a469a5134.d2adbe9c-f279-4239-a672-57dd50be5c3f Sep 04 17:57:20 devstack sudo[97847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:20 devstack sudo[97847]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-52e64193-b10b-45b9-844f-b4d022c9679b tempest-GroupSnapshotsTest-1632469284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6727c47f-2920-4a08-b13c-b35a469a5134.d2adbe9c-f279-4239-a672-57dd50be5c3f" returned: 0 in 0.277s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:20 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-52e64193-b10b-45b9-844f-b4d022c9679b tempest-GroupSnapshotsTest-1632469284 None] Lock "cinder-quobyte-d2adbe9c-f279-4239-a672-57dd50be5c3f" released by "_delete_snapshot" :: held 1.666s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:57:20 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-52e64193-b10b-45b9-844f-b4d022c9679b tempest-GroupSnapshotsTest-1632469284 None] Lock "cinder-quobyte-6727c47f-2920-4a08-b13c-b35a469a5134" released by "delete_snapshot" :: held 1.691s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:57:20 devstack cinder-volume[87314]: WARNING cinder.quota [None req-52e64193-b10b-45b9-844f-b4d022c9679b tempest-GroupSnapshotsTest-1632469284 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-774719779 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-774719779, it is now deprecated. Please use the default quota class for default quota. Sep 04 17:57:20 devstack cinder-volume[87314]: WARNING cinder.quota [None req-52e64193-b10b-45b9-844f-b4d022c9679b tempest-GroupSnapshotsTest-1632469284 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-774719779 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-774719779, it is now deprecated. Please use the default quota class for default quota. Sep 04 17:57:20 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-52e64193-b10b-45b9-844f-b4d022c9679b tempest-GroupSnapshotsTest-1632469284 None] Created reservations ['17945c97-4d94-4f5d-bdcf-2f8686193d20', '1fab65bf-a660-476a-96de-2c61da4e9e53', '3b4cae88-c969-42e8-b21b-020bfb2efe74', 'ff52e009-3be3-4d4e-aa13-8e91b7ed3f6b'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:57:21 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-52e64193-b10b-45b9-844f-b4d022c9679b tempest-GroupSnapshotsTest-1632469284 None] Created reservations ['3e5fb691-e7c2-4f90-bff2-32a7c96c15cd', '08fdca73-07a3-4007-9ce6-2d1adff0c167', 'cd366247-c6b1-42a2-9701-cf7b0d38dcea', '161a6ad1-5cfd-40f3-91f8-7e3e2a9e1bcd'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:57:21 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-52e64193-b10b-45b9-844f-b4d022c9679b tempest-GroupSnapshotsTest-1632469284 None] group_snapshot fbb2631d-45a8-4578-a5bc-9df09ef82980: deleted successfully Sep 04 17:57:21 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 17:57:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:57:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:57:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:57:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:57:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:57:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:21 devstack sudo[97851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:57:21 devstack sudo[97851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:21 devstack sudo[97851]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.405s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:21 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:57:21 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running periodic task VolumeManager._thread_info {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 17:57:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] thread count: 28 {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 17:57:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] thread info: [<_MainThread(MainThread, started 139900377723008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 17:57:21 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8a58a292-564e-4cb4-98e2-d6b82326f508 tempest-GroupSnapshotsTest-1632469284 None] Acquiring lock "cinder-quobyte-33acfbd2-5942-4502-aeb5-3e32123e63ef" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:57:21 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8a58a292-564e-4cb4-98e2-d6b82326f508 tempest-GroupSnapshotsTest-1632469284 None] Lock "cinder-quobyte-33acfbd2-5942-4502-aeb5-3e32123e63ef" acquired by "delete_volume" :: waited 0.024s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:57:22 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8279fa-b645-4448-9732-dc2e82df9006]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:57:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8a58a292-564e-4cb4-98e2-d6b82326f508 tempest-GroupSnapshotsTest-1632469284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-33acfbd2-5942-4502-aeb5-3e32123e63ef {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:22 devstack sudo[97854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-33acfbd2-5942-4502-aeb5-3e32123e63ef Sep 04 17:57:22 devstack sudo[97854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:22 devstack sudo[97854]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8a58a292-564e-4cb4-98e2-d6b82326f508 tempest-GroupSnapshotsTest-1632469284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-33acfbd2-5942-4502-aeb5-3e32123e63ef" returned: 0 in 0.433s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8a58a292-564e-4cb4-98e2-d6b82326f508 tempest-GroupSnapshotsTest-1632469284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-33acfbd2-5942-4502-aeb5-3e32123e63ef {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:22 devstack sudo[97859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-33acfbd2-5942-4502-aeb5-3e32123e63ef Sep 04 17:57:22 devstack sudo[97859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:22 devstack sudo[97859]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8a58a292-564e-4cb4-98e2-d6b82326f508 tempest-GroupSnapshotsTest-1632469284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-33acfbd2-5942-4502-aeb5-3e32123e63ef" returned: 0 in 0.273s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:22 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8a58a292-564e-4cb4-98e2-d6b82326f508 tempest-GroupSnapshotsTest-1632469284 None] Lock "cinder-quobyte-33acfbd2-5942-4502-aeb5-3e32123e63ef" released by "delete_volume" :: held 0.782s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:57:22 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8a58a292-564e-4cb4-98e2-d6b82326f508 tempest-GroupSnapshotsTest-1632469284 None] Acquiring lock "cinder-quobyte-6727c47f-2920-4a08-b13c-b35a469a5134" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:57:22 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8a58a292-564e-4cb4-98e2-d6b82326f508 tempest-GroupSnapshotsTest-1632469284 None] Lock "cinder-quobyte-6727c47f-2920-4a08-b13c-b35a469a5134" acquired by "delete_volume" :: waited 0.017s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:57:22 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e65d4e-10a9-4a10-8f40-2da1ca579ba1]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:57:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8a58a292-564e-4cb4-98e2-d6b82326f508 tempest-GroupSnapshotsTest-1632469284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6727c47f-2920-4a08-b13c-b35a469a5134 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:22 devstack sudo[97862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6727c47f-2920-4a08-b13c-b35a469a5134 Sep 04 17:57:22 devstack sudo[97862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:23 devstack sudo[97862]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8a58a292-564e-4cb4-98e2-d6b82326f508 tempest-GroupSnapshotsTest-1632469284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6727c47f-2920-4a08-b13c-b35a469a5134" returned: 0 in 0.574s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8a58a292-564e-4cb4-98e2-d6b82326f508 tempest-GroupSnapshotsTest-1632469284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6727c47f-2920-4a08-b13c-b35a469a5134 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:23 devstack sudo[97868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6727c47f-2920-4a08-b13c-b35a469a5134 Sep 04 17:57:23 devstack sudo[97868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:23 devstack sudo[97868]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8a58a292-564e-4cb4-98e2-d6b82326f508 tempest-GroupSnapshotsTest-1632469284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6727c47f-2920-4a08-b13c-b35a469a5134" returned: 0 in 0.263s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:23 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8a58a292-564e-4cb4-98e2-d6b82326f508 tempest-GroupSnapshotsTest-1632469284 None] Lock "cinder-quobyte-6727c47f-2920-4a08-b13c-b35a469a5134" released by "delete_volume" :: held 0.907s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:57:23 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-8a58a292-564e-4cb4-98e2-d6b82326f508 tempest-GroupSnapshotsTest-1632469284 None] Created reservations ['a09b0f3c-fd5c-44a6-b72e-2e603fbf1201'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:57:23 devstack cinder-volume[87314]: WARNING cinder.quota [None req-8a58a292-564e-4cb4-98e2-d6b82326f508 tempest-GroupSnapshotsTest-1632469284 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-774719779 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-774719779, it is now deprecated. Please use the default quota class for default quota. Sep 04 17:57:23 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-8a58a292-564e-4cb4-98e2-d6b82326f508 tempest-GroupSnapshotsTest-1632469284 None] Created reservations ['8978c2bd-a3b2-4181-928e-09720742e500', 'f2c850e7-c2f5-48fb-8a02-b1590aa4e877', '8f507cfd-59e0-48f9-97c3-2ae6e46c8b65', 'b9c5a0fa-9fbc-4ac0-9f5c-7f8df47b82ad'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:57:23 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-8a58a292-564e-4cb4-98e2-d6b82326f508 tempest-GroupSnapshotsTest-1632469284 None] Created reservations ['dd962e41-2057-4c7a-aac1-0e0eb7695cf8', 'e4b5fbf8-309c-4972-97a9-0c9e95d1337c', '5fdc5377-c5d9-4280-b19f-13f0332f5cd8', '17e2ffad-fd68-4f80-8c80-40c538236b52'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:57:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8a58a292-564e-4cb4-98e2-d6b82326f508 tempest-GroupSnapshotsTest-1632469284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:57:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8a58a292-564e-4cb4-98e2-d6b82326f508 tempest-GroupSnapshotsTest-1632469284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:57:24 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8a58a292-564e-4cb4-98e2-d6b82326f508 tempest-GroupSnapshotsTest-1632469284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:57:24 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8a58a292-564e-4cb4-98e2-d6b82326f508 tempest-GroupSnapshotsTest-1632469284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:57:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8a58a292-564e-4cb4-98e2-d6b82326f508 tempest-GroupSnapshotsTest-1632469284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:57:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8a58a292-564e-4cb4-98e2-d6b82326f508 tempest-GroupSnapshotsTest-1632469284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:24 devstack sudo[97873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:57:24 devstack sudo[97873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:24 devstack sudo[97873]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8a58a292-564e-4cb4-98e2-d6b82326f508 tempest-GroupSnapshotsTest-1632469284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.300s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:24 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-8a58a292-564e-4cb4-98e2-d6b82326f508 tempest-GroupSnapshotsTest-1632469284 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:57:24 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-8a58a292-564e-4cb4-98e2-d6b82326f508 tempest-GroupSnapshotsTest-1632469284 None] Delete group completed successfully. Sep 04 17:57:24 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-d676eb0e-7f64-40d9-9b04-3e5a2924cc47 tempest-GroupSnapshotsTest-1632469284 None] Group tempest-GroupSnapshotsTest-Group-1866936868: creating Sep 04 17:57:24 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-d676eb0e-7f64-40d9-9b04-3e5a2924cc47 tempest-GroupSnapshotsTest-1632469284 None] Group tempest-GroupSnapshotsTest-Group-1866936868: created successfully Sep 04 17:57:24 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-d676eb0e-7f64-40d9-9b04-3e5a2924cc47 tempest-GroupSnapshotsTest-1632469284 None] Create group completed successfully. Sep 04 17:57:26 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d5c685d-dae5-42ef-b00c-ab6fb136a026 tempest-GroupSnapshotsTest-1632469284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:57:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4d5c685d-dae5-42ef-b00c-ab6fb136a026 tempest-GroupSnapshotsTest-1632469284 None] Flow 'volume_create_manager' (895a3822-393f-4598-abc2-62408395dea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:57:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4d5c685d-dae5-42ef-b00c-ab6fb136a026 tempest-GroupSnapshotsTest-1632469284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c390575-239b-4093-bf5d-f4af520bc40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:57:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4d5c685d-dae5-42ef-b00c-ab6fb136a026 tempest-GroupSnapshotsTest-1632469284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c390575-239b-4093-bf5d-f4af520bc40a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:57:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1717629558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c60d1481-2db0-40b3-8063-85703c67214d,host='devstack@QuobyteHD#QuobyteHD',id=9a0dde80-156b-43e4-b066-6f607e186df9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b90a7a1d394b4293aa22af639974cdd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:57:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:57:27Z,use_quota=True,user_id='2deecbeab20243e89090df54531c8db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d09723f-af8b-409b-b9e6-9c6c5546d2f2),volume_type_id=5d09723f-af8b-409b-b9e6-9c6c5546d2f2)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:57:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4d5c685d-dae5-42ef-b00c-ab6fb136a026 tempest-GroupSnapshotsTest-1632469284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ccbf488-e5e9-4fe7-b2ac-fdd154db9692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:57:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4d5c685d-dae5-42ef-b00c-ab6fb136a026 tempest-GroupSnapshotsTest-1632469284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ccbf488-e5e9-4fe7-b2ac-fdd154db9692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:57:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4d5c685d-dae5-42ef-b00c-ab6fb136a026 tempest-GroupSnapshotsTest-1632469284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5b233ee-c3e9-4200-a6d7-20000a0e7f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:57:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4d5c685d-dae5-42ef-b00c-ab6fb136a026 tempest-GroupSnapshotsTest-1632469284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5b233ee-c3e9-4200-a6d7-20000a0e7f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a0dde80-156b-43e4-b066-6f607e186df9', 'volume_name': 'volume-9a0dde80-156b-43e4-b066-6f607e186df9', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:57:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4d5c685d-dae5-42ef-b00c-ab6fb136a026 tempest-GroupSnapshotsTest-1632469284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae8ae114-2001-4a95-b024-aaacf47f6c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:57:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4d5c685d-dae5-42ef-b00c-ab6fb136a026 tempest-GroupSnapshotsTest-1632469284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae8ae114-2001-4a95-b024-aaacf47f6c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:57:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4d5c685d-dae5-42ef-b00c-ab6fb136a026 tempest-GroupSnapshotsTest-1632469284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0baf9bdd-4672-4d18-951a-8a0e6e959233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:57:26 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-4d5c685d-dae5-42ef-b00c-ab6fb136a026 tempest-GroupSnapshotsTest-1632469284 None] Volume 9a0dde80-156b-43e4-b066-6f607e186df9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a0dde80-156b-43e4-b066-6f607e186df9', 'volume_size': 1} Sep 04 17:57:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4d5c685d-dae5-42ef-b00c-ab6fb136a026 tempest-GroupSnapshotsTest-1632469284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:57:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4d5c685d-dae5-42ef-b00c-ab6fb136a026 tempest-GroupSnapshotsTest-1632469284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:57:26 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4d5c685d-dae5-42ef-b00c-ab6fb136a026 tempest-GroupSnapshotsTest-1632469284 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c60d1481-2db0-40b3-8063-85703c67214d,created_at=2026-09-04T15:57:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1717629558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c60d1481-2db0-40b3-8063-85703c67214d,host='devstack@QuobyteHD#QuobyteHD',id=9a0dde80-156b-43e4-b066-6f607e186df9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b90a7a1d394b4293aa22af639974cdd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:57:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:57:27Z,use_quota=True,user_id='2deecbeab20243e89090df54531c8db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d09723f-af8b-409b-b9e6-9c6c5546d2f2),volume_type_id=5d09723f-af8b-409b-b9e6-9c6c5546d2f2)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:57:26 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-4d5c685d-dae5-42ef-b00c-ab6fb136a026 tempest-GroupSnapshotsTest-1632469284 None] Creating volume 9a0dde80-156b-43e4-b066-6f607e186df9 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:57:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4d5c685d-dae5-42ef-b00c-ab6fb136a026 tempest-GroupSnapshotsTest-1632469284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:57:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4d5c685d-dae5-42ef-b00c-ab6fb136a026 tempest-GroupSnapshotsTest-1632469284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:57:26 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4d5c685d-dae5-42ef-b00c-ab6fb136a026 tempest-GroupSnapshotsTest-1632469284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:57:26 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4d5c685d-dae5-42ef-b00c-ab6fb136a026 tempest-GroupSnapshotsTest-1632469284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:57:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4d5c685d-dae5-42ef-b00c-ab6fb136a026 tempest-GroupSnapshotsTest-1632469284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:57:26 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4d5c685d-dae5-42ef-b00c-ab6fb136a026 tempest-GroupSnapshotsTest-1632469284 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:57:26 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-4d5c685d-dae5-42ef-b00c-ab6fb136a026 tempest-GroupSnapshotsTest-1632469284 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:57:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4d5c685d-dae5-42ef-b00c-ab6fb136a026 tempest-GroupSnapshotsTest-1632469284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a0dde80-156b-43e4-b066-6f607e186df9 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:26 devstack sudo[97878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a0dde80-156b-43e4-b066-6f607e186df9 1073741824 Sep 04 17:57:26 devstack sudo[97878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:27 devstack sudo[97878]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4d5c685d-dae5-42ef-b00c-ab6fb136a026 tempest-GroupSnapshotsTest-1632469284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a0dde80-156b-43e4-b066-6f607e186df9 1073741824" returned: 0 in 0.428s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4d5c685d-dae5-42ef-b00c-ab6fb136a026 tempest-GroupSnapshotsTest-1632469284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a0dde80-156b-43e4-b066-6f607e186df9 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:27 devstack sudo[97883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a0dde80-156b-43e4-b066-6f607e186df9 Sep 04 17:57:27 devstack sudo[97883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:27 devstack sudo[97883]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4d5c685d-dae5-42ef-b00c-ab6fb136a026 tempest-GroupSnapshotsTest-1632469284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a0dde80-156b-43e4-b066-6f607e186df9" returned: 0 in 0.243s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:27 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4d5c685d-dae5-42ef-b00c-ab6fb136a026 tempest-GroupSnapshotsTest-1632469284 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:57:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4d5c685d-dae5-42ef-b00c-ab6fb136a026 tempest-GroupSnapshotsTest-1632469284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:57:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4d5c685d-dae5-42ef-b00c-ab6fb136a026 tempest-GroupSnapshotsTest-1632469284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0baf9bdd-4672-4d18-951a-8a0e6e959233) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a0dde80-156b-43e4-b066-6f607e186df9', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:57:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4d5c685d-dae5-42ef-b00c-ab6fb136a026 tempest-GroupSnapshotsTest-1632469284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72bff876-b4b9-459d-aa7f-30055da2eb52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:57:27 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-4d5c685d-dae5-42ef-b00c-ab6fb136a026 tempest-GroupSnapshotsTest-1632469284 None] Volume volume-9a0dde80-156b-43e4-b066-6f607e186df9 (9a0dde80-156b-43e4-b066-6f607e186df9): created successfully Sep 04 17:57:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4d5c685d-dae5-42ef-b00c-ab6fb136a026 tempest-GroupSnapshotsTest-1632469284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72bff876-b4b9-459d-aa7f-30055da2eb52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:57:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4d5c685d-dae5-42ef-b00c-ab6fb136a026 tempest-GroupSnapshotsTest-1632469284 None] Flow 'volume_create_manager' (895a3822-393f-4598-abc2-62408395dea3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:57:27 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-4d5c685d-dae5-42ef-b00c-ab6fb136a026 tempest-GroupSnapshotsTest-1632469284 None] Created volume successfully. Sep 04 17:57:28 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-c241696c-92f1-4c3c-99cc-225fc48f2daf tempest-GroupSnapshotsTest-1632469284 None] GroupSnapshot c636ac71-fbc4-4c6b-89a0-36c37ef92ad6: creating. Sep 04 17:57:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c241696c-92f1-4c3c-99cc-225fc48f2daf tempest-GroupSnapshotsTest-1632469284 None] Group snapshot c636ac71-fbc4-4c6b-89a0-36c37ef92ad6: creating. {{(pid=87314) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 04 17:57:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c241696c-92f1-4c3c-99cc-225fc48f2daf tempest-GroupSnapshotsTest-1632469284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:57:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c241696c-92f1-4c3c-99cc-225fc48f2daf tempest-GroupSnapshotsTest-1632469284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:57:28 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-c241696c-92f1-4c3c-99cc-225fc48f2daf tempest-GroupSnapshotsTest-1632469284 None] Creating offline snapshot e4064047-a157-4295-847b-592e9bdabd45 of volume 9a0dde80-156b-43e4-b066-6f607e186df9 {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 17:57:28 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[771fd0ec-8bae-4202-ae12-20c3ad7d2982]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:57:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c241696c-92f1-4c3c-99cc-225fc48f2daf tempest-GroupSnapshotsTest-1632469284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a0dde80-156b-43e4-b066-6f607e186df9 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:28 devstack sudo[97890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a0dde80-156b-43e4-b066-6f607e186df9 Sep 04 17:57:28 devstack sudo[97890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:28 devstack sudo[97890]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c241696c-92f1-4c3c-99cc-225fc48f2daf tempest-GroupSnapshotsTest-1632469284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a0dde80-156b-43e4-b066-6f607e186df9" returned: 0 in 0.451s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c241696c-92f1-4c3c-99cc-225fc48f2daf tempest-GroupSnapshotsTest-1632469284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a0dde80-156b-43e4-b066-6f607e186df9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a0dde80-156b-43e4-b066-6f607e186df9.e4064047-a157-4295-847b-592e9bdabd45 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:28 devstack sudo[97895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a0dde80-156b-43e4-b066-6f607e186df9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a0dde80-156b-43e4-b066-6f607e186df9.e4064047-a157-4295-847b-592e9bdabd45 1G Sep 04 17:57:28 devstack sudo[97895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:29 devstack sudo[97895]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c241696c-92f1-4c3c-99cc-225fc48f2daf tempest-GroupSnapshotsTest-1632469284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a0dde80-156b-43e4-b066-6f607e186df9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a0dde80-156b-43e4-b066-6f607e186df9.e4064047-a157-4295-847b-592e9bdabd45 1G" returned: 0 in 0.470s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c241696c-92f1-4c3c-99cc-225fc48f2daf tempest-GroupSnapshotsTest-1632469284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a0dde80-156b-43e4-b066-6f607e186df9 -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a0dde80-156b-43e4-b066-6f607e186df9.e4064047-a157-4295-847b-592e9bdabd45 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:29 devstack sudo[97902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a0dde80-156b-43e4-b066-6f607e186df9 -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a0dde80-156b-43e4-b066-6f607e186df9.e4064047-a157-4295-847b-592e9bdabd45 Sep 04 17:57:29 devstack sudo[97902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:29 devstack sudo[97902]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c241696c-92f1-4c3c-99cc-225fc48f2daf tempest-GroupSnapshotsTest-1632469284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a0dde80-156b-43e4-b066-6f607e186df9 -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a0dde80-156b-43e4-b066-6f607e186df9.e4064047-a157-4295-847b-592e9bdabd45" returned: 0 in 0.297s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:29 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-c241696c-92f1-4c3c-99cc-225fc48f2daf tempest-GroupSnapshotsTest-1632469284 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a0dde80-156b-43e4-b066-6f607e186df9.e4064047-a157-4295-847b-592e9bdabd45 is being set with open permissions: ugo+rw: NotImplementedError Sep 04 17:57:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c241696c-92f1-4c3c-99cc-225fc48f2daf tempest-GroupSnapshotsTest-1632469284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a0dde80-156b-43e4-b066-6f607e186df9.e4064047-a157-4295-847b-592e9bdabd45 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:29 devstack sudo[97907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a0dde80-156b-43e4-b066-6f607e186df9.e4064047-a157-4295-847b-592e9bdabd45 Sep 04 17:57:29 devstack sudo[97907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:29 devstack sudo[97907]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c241696c-92f1-4c3c-99cc-225fc48f2daf tempest-GroupSnapshotsTest-1632469284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a0dde80-156b-43e4-b066-6f607e186df9.e4064047-a157-4295-847b-592e9bdabd45" returned: 0 in 0.232s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c241696c-92f1-4c3c-99cc-225fc48f2daf tempest-GroupSnapshotsTest-1632469284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a0dde80-156b-43e4-b066-6f607e186df9.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:29 devstack sudo[97910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a0dde80-156b-43e4-b066-6f607e186df9.info Sep 04 17:57:29 devstack sudo[97910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:30 devstack sudo[97910]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c241696c-92f1-4c3c-99cc-225fc48f2daf tempest-GroupSnapshotsTest-1632469284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a0dde80-156b-43e4-b066-6f607e186df9.info" returned: 0 in 0.257s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:30 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-c241696c-92f1-4c3c-99cc-225fc48f2daf tempest-GroupSnapshotsTest-1632469284 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a0dde80-156b-43e4-b066-6f607e186df9.info is being set with open permissions: ugo+rw: NotImplementedError Sep 04 17:57:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c241696c-92f1-4c3c-99cc-225fc48f2daf tempest-GroupSnapshotsTest-1632469284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a0dde80-156b-43e4-b066-6f607e186df9.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:30 devstack sudo[97913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a0dde80-156b-43e4-b066-6f607e186df9.info Sep 04 17:57:30 devstack sudo[97913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:30 devstack sudo[97913]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c241696c-92f1-4c3c-99cc-225fc48f2daf tempest-GroupSnapshotsTest-1632469284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a0dde80-156b-43e4-b066-6f607e186df9.info" returned: 0 in 0.262s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c241696c-92f1-4c3c-99cc-225fc48f2daf tempest-GroupSnapshotsTest-1632469284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.074s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:57:30 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-c241696c-92f1-4c3c-99cc-225fc48f2daf tempest-GroupSnapshotsTest-1632469284 None] group_snapshot c636ac71-fbc4-4c6b-89a0-36c37ef92ad6: created successfully Sep 04 17:57:31 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-a2589078-8eb0-4c52-8ade-d24afc291e1d tempest-GroupSnapshotsTest-1632469284 None] group_snapshot c636ac71-fbc4-4c6b-89a0-36c37ef92ad6: deleting Sep 04 17:57:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a2589078-8eb0-4c52-8ade-d24afc291e1d tempest-GroupSnapshotsTest-1632469284 None] group_snapshot c636ac71-fbc4-4c6b-89a0-36c37ef92ad6: deleting {{(pid=87314) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 04 17:57:31 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a2589078-8eb0-4c52-8ade-d24afc291e1d tempest-GroupSnapshotsTest-1632469284 None] Acquiring lock "cinder-quobyte-9a0dde80-156b-43e4-b066-6f607e186df9" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:57:31 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a2589078-8eb0-4c52-8ade-d24afc291e1d tempest-GroupSnapshotsTest-1632469284 None] Lock "cinder-quobyte-9a0dde80-156b-43e4-b066-6f607e186df9" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:57:31 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a2589078-8eb0-4c52-8ade-d24afc291e1d tempest-GroupSnapshotsTest-1632469284 None] Acquiring lock "cinder-quobyte-e4064047-a157-4295-847b-592e9bdabd45" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:57:31 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a2589078-8eb0-4c52-8ade-d24afc291e1d tempest-GroupSnapshotsTest-1632469284 None] Lock "cinder-quobyte-e4064047-a157-4295-847b-592e9bdabd45" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:57:31 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-a2589078-8eb0-4c52-8ade-d24afc291e1d tempest-GroupSnapshotsTest-1632469284 None] Deleting offline snapshot e4064047-a157-4295-847b-592e9bdabd45 of volume 9a0dde80-156b-43e4-b066-6f607e186df9 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 17:57:31 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-a2589078-8eb0-4c52-8ade-d24afc291e1d tempest-GroupSnapshotsTest-1632469284 None] snapshot_file for this snap is: volume-9a0dde80-156b-43e4-b066-6f607e186df9.e4064047-a157-4295-847b-592e9bdabd45 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 17:57:31 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c15bb5-077d-4e42-aad3-d1e5238f4593]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:57:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a2589078-8eb0-4c52-8ade-d24afc291e1d tempest-GroupSnapshotsTest-1632469284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a0dde80-156b-43e4-b066-6f607e186df9.e4064047-a157-4295-847b-592e9bdabd45 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:31 devstack sudo[97916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a0dde80-156b-43e4-b066-6f607e186df9.e4064047-a157-4295-847b-592e9bdabd45 Sep 04 17:57:31 devstack sudo[97916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:32 devstack sudo[97916]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a2589078-8eb0-4c52-8ade-d24afc291e1d tempest-GroupSnapshotsTest-1632469284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a0dde80-156b-43e4-b066-6f607e186df9.e4064047-a157-4295-847b-592e9bdabd45" returned: 0 in 0.382s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:32 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-a2589078-8eb0-4c52-8ade-d24afc291e1d tempest-GroupSnapshotsTest-1632469284 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a0dde80-156b-43e4-b066-6f607e186df9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 17:57:32 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea35839-a66e-49ee-975c-f61074faa0bb]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:57:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a2589078-8eb0-4c52-8ade-d24afc291e1d tempest-GroupSnapshotsTest-1632469284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a0dde80-156b-43e4-b066-6f607e186df9 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:32 devstack sudo[97921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a0dde80-156b-43e4-b066-6f607e186df9 Sep 04 17:57:32 devstack sudo[97921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:32 devstack sudo[97921]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a2589078-8eb0-4c52-8ade-d24afc291e1d tempest-GroupSnapshotsTest-1632469284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a0dde80-156b-43e4-b066-6f607e186df9" returned: 0 in 0.378s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a2589078-8eb0-4c52-8ade-d24afc291e1d tempest-GroupSnapshotsTest-1632469284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a0dde80-156b-43e4-b066-6f607e186df9.e4064047-a157-4295-847b-592e9bdabd45 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:32 devstack sudo[97927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a0dde80-156b-43e4-b066-6f607e186df9.e4064047-a157-4295-847b-592e9bdabd45 Sep 04 17:57:32 devstack sudo[97927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:32 devstack sudo[97927]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a2589078-8eb0-4c52-8ade-d24afc291e1d tempest-GroupSnapshotsTest-1632469284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a0dde80-156b-43e4-b066-6f607e186df9.e4064047-a157-4295-847b-592e9bdabd45" returned: 0 in 0.340s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a2589078-8eb0-4c52-8ade-d24afc291e1d tempest-GroupSnapshotsTest-1632469284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a0dde80-156b-43e4-b066-6f607e186df9.e4064047-a157-4295-847b-592e9bdabd45 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:32 devstack sudo[97932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a0dde80-156b-43e4-b066-6f607e186df9.e4064047-a157-4295-847b-592e9bdabd45 Sep 04 17:57:32 devstack sudo[97932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:33 devstack sudo[97932]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a2589078-8eb0-4c52-8ade-d24afc291e1d tempest-GroupSnapshotsTest-1632469284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a0dde80-156b-43e4-b066-6f607e186df9.e4064047-a157-4295-847b-592e9bdabd45" returned: 0 in 0.262s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:33 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a2589078-8eb0-4c52-8ade-d24afc291e1d tempest-GroupSnapshotsTest-1632469284 None] Lock "cinder-quobyte-e4064047-a157-4295-847b-592e9bdabd45" released by "_delete_snapshot" :: held 1.468s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:57:33 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a2589078-8eb0-4c52-8ade-d24afc291e1d tempest-GroupSnapshotsTest-1632469284 None] Lock "cinder-quobyte-9a0dde80-156b-43e4-b066-6f607e186df9" released by "delete_snapshot" :: held 1.502s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:57:33 devstack cinder-volume[87314]: WARNING cinder.quota [None req-a2589078-8eb0-4c52-8ade-d24afc291e1d tempest-GroupSnapshotsTest-1632469284 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1467980012 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1467980012, it is now deprecated. Please use the default quota class for default quota. Sep 04 17:57:33 devstack cinder-volume[87314]: WARNING cinder.quota [None req-a2589078-8eb0-4c52-8ade-d24afc291e1d tempest-GroupSnapshotsTest-1632469284 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1467980012 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1467980012, it is now deprecated. Please use the default quota class for default quota. Sep 04 17:57:33 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-a2589078-8eb0-4c52-8ade-d24afc291e1d tempest-GroupSnapshotsTest-1632469284 None] Created reservations ['b7593540-6e17-45a0-a1a1-d5ba5f14e891', '82e970bc-b4d7-45da-879f-2fd532d44258', '6f987d4b-85fd-419a-b38a-eda4d2cca49a', '7203b50d-b83e-48a3-8676-b8beb187028f'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:57:33 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-a2589078-8eb0-4c52-8ade-d24afc291e1d tempest-GroupSnapshotsTest-1632469284 None] group_snapshot c636ac71-fbc4-4c6b-89a0-36c37ef92ad6: deleted successfully Sep 04 17:57:34 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-dc9e9767-d1b3-4430-b105-b7cd271b69a3 tempest-GroupSnapshotsTest-1632469284 None] Acquiring lock "cinder-quobyte-9a0dde80-156b-43e4-b066-6f607e186df9" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:57:34 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-dc9e9767-d1b3-4430-b105-b7cd271b69a3 tempest-GroupSnapshotsTest-1632469284 None] Lock "cinder-quobyte-9a0dde80-156b-43e4-b066-6f607e186df9" acquired by "delete_volume" :: waited 0.033s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:57:34 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bdf49d2-b9ec-4a80-ae2f-232b8a3ebf11]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:57:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dc9e9767-d1b3-4430-b105-b7cd271b69a3 tempest-GroupSnapshotsTest-1632469284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a0dde80-156b-43e4-b066-6f607e186df9 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:34 devstack sudo[97936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a0dde80-156b-43e4-b066-6f607e186df9 Sep 04 17:57:34 devstack sudo[97936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:34 devstack sudo[97936]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dc9e9767-d1b3-4430-b105-b7cd271b69a3 tempest-GroupSnapshotsTest-1632469284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a0dde80-156b-43e4-b066-6f607e186df9" returned: 0 in 0.383s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dc9e9767-d1b3-4430-b105-b7cd271b69a3 tempest-GroupSnapshotsTest-1632469284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a0dde80-156b-43e4-b066-6f607e186df9 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:34 devstack sudo[97941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a0dde80-156b-43e4-b066-6f607e186df9 Sep 04 17:57:34 devstack sudo[97941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:34 devstack sudo[97941]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dc9e9767-d1b3-4430-b105-b7cd271b69a3 tempest-GroupSnapshotsTest-1632469284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a0dde80-156b-43e4-b066-6f607e186df9" returned: 0 in 0.269s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:35 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-dc9e9767-d1b3-4430-b105-b7cd271b69a3 tempest-GroupSnapshotsTest-1632469284 None] Lock "cinder-quobyte-9a0dde80-156b-43e4-b066-6f607e186df9" released by "delete_volume" :: held 0.729s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:57:35 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-dc9e9767-d1b3-4430-b105-b7cd271b69a3 tempest-GroupSnapshotsTest-1632469284 None] Created reservations ['059bbcee-d37f-4bf9-81ca-251cc879ecf7'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:57:35 devstack cinder-volume[87314]: WARNING cinder.quota [None req-dc9e9767-d1b3-4430-b105-b7cd271b69a3 tempest-GroupSnapshotsTest-1632469284 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1467980012 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1467980012, it is now deprecated. Please use the default quota class for default quota. Sep 04 17:57:35 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-dc9e9767-d1b3-4430-b105-b7cd271b69a3 tempest-GroupSnapshotsTest-1632469284 None] Created reservations ['df5edd11-0018-4b1e-afdd-d55e0a0cb6bc', '54109a57-6d63-402c-99fa-2a3e361e608a', '74fec8bf-aecb-4ff9-8f2a-7647eb91c39c', 'd3b469c2-9653-453d-b49d-6c37f9e659a0'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:57:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-dc9e9767-d1b3-4430-b105-b7cd271b69a3 tempest-GroupSnapshotsTest-1632469284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:57:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-dc9e9767-d1b3-4430-b105-b7cd271b69a3 tempest-GroupSnapshotsTest-1632469284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:57:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-dc9e9767-d1b3-4430-b105-b7cd271b69a3 tempest-GroupSnapshotsTest-1632469284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:57:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-dc9e9767-d1b3-4430-b105-b7cd271b69a3 tempest-GroupSnapshotsTest-1632469284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:57:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-dc9e9767-d1b3-4430-b105-b7cd271b69a3 tempest-GroupSnapshotsTest-1632469284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:57:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dc9e9767-d1b3-4430-b105-b7cd271b69a3 tempest-GroupSnapshotsTest-1632469284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:35 devstack sudo[97944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:57:35 devstack sudo[97944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:35 devstack sudo[97944]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dc9e9767-d1b3-4430-b105-b7cd271b69a3 tempest-GroupSnapshotsTest-1632469284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.298s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:35 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-dc9e9767-d1b3-4430-b105-b7cd271b69a3 tempest-GroupSnapshotsTest-1632469284 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:57:35 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-dc9e9767-d1b3-4430-b105-b7cd271b69a3 tempest-GroupSnapshotsTest-1632469284 None] Delete group completed successfully. Sep 04 17:57:35 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8629bd5-9c36-406f-97ce-2fdcd30d45f2 tempest-AbsoluteLimitsTests-861850908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:57:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b8629bd5-9c36-406f-97ce-2fdcd30d45f2 tempest-AbsoluteLimitsTests-861850908 None] Flow 'volume_create_manager' (7bb48f40-d1db-43f2-b23b-5e1942757a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:57:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b8629bd5-9c36-406f-97ce-2fdcd30d45f2 tempest-AbsoluteLimitsTests-861850908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa4c365a-759f-4966-900d-449c99284147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:57:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b8629bd5-9c36-406f-97ce-2fdcd30d45f2 tempest-AbsoluteLimitsTests-861850908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa4c365a-759f-4966-900d-449c99284147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:57:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1548947705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25fc5212-5a53-4f98-9708-425959d46e47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06771315ebfa453cb4b053e04a5cef2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:57:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:57:36Z,use_quota=True,user_id='4bd3eec8f8504d9c90807815a6b2e6e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:57:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b8629bd5-9c36-406f-97ce-2fdcd30d45f2 tempest-AbsoluteLimitsTests-861850908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27714a02-7859-4e0a-b88d-e3d54aa154be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:57:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b8629bd5-9c36-406f-97ce-2fdcd30d45f2 tempest-AbsoluteLimitsTests-861850908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27714a02-7859-4e0a-b88d-e3d54aa154be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:57:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b8629bd5-9c36-406f-97ce-2fdcd30d45f2 tempest-AbsoluteLimitsTests-861850908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb93c132-8482-4ef5-811d-cb4003ce76c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:57:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b8629bd5-9c36-406f-97ce-2fdcd30d45f2 tempest-AbsoluteLimitsTests-861850908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb93c132-8482-4ef5-811d-cb4003ce76c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25fc5212-5a53-4f98-9708-425959d46e47', 'volume_name': 'volume-25fc5212-5a53-4f98-9708-425959d46e47', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:57:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b8629bd5-9c36-406f-97ce-2fdcd30d45f2 tempest-AbsoluteLimitsTests-861850908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5636a487-50eb-4c04-8bed-f1ea5be667f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:57:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b8629bd5-9c36-406f-97ce-2fdcd30d45f2 tempest-AbsoluteLimitsTests-861850908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5636a487-50eb-4c04-8bed-f1ea5be667f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:57:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b8629bd5-9c36-406f-97ce-2fdcd30d45f2 tempest-AbsoluteLimitsTests-861850908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (879bec14-ecd7-4c3c-9788-bd6046dc7e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:57:35 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-b8629bd5-9c36-406f-97ce-2fdcd30d45f2 tempest-AbsoluteLimitsTests-861850908 None] Volume 25fc5212-5a53-4f98-9708-425959d46e47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25fc5212-5a53-4f98-9708-425959d46e47', 'volume_size': 1} Sep 04 17:57:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b8629bd5-9c36-406f-97ce-2fdcd30d45f2 tempest-AbsoluteLimitsTests-861850908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:57:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b8629bd5-9c36-406f-97ce-2fdcd30d45f2 tempest-AbsoluteLimitsTests-861850908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:57:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b8629bd5-9c36-406f-97ce-2fdcd30d45f2 tempest-AbsoluteLimitsTests-861850908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:57:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1548947705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25fc5212-5a53-4f98-9708-425959d46e47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06771315ebfa453cb4b053e04a5cef2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:57:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:57:36Z,use_quota=True,user_id='4bd3eec8f8504d9c90807815a6b2e6e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:57:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-b8629bd5-9c36-406f-97ce-2fdcd30d45f2 tempest-AbsoluteLimitsTests-861850908 None] Creating volume 25fc5212-5a53-4f98-9708-425959d46e47 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:57:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b8629bd5-9c36-406f-97ce-2fdcd30d45f2 tempest-AbsoluteLimitsTests-861850908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:57:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b8629bd5-9c36-406f-97ce-2fdcd30d45f2 tempest-AbsoluteLimitsTests-861850908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:57:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b8629bd5-9c36-406f-97ce-2fdcd30d45f2 tempest-AbsoluteLimitsTests-861850908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:57:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b8629bd5-9c36-406f-97ce-2fdcd30d45f2 tempest-AbsoluteLimitsTests-861850908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:57:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b8629bd5-9c36-406f-97ce-2fdcd30d45f2 tempest-AbsoluteLimitsTests-861850908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:57:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b8629bd5-9c36-406f-97ce-2fdcd30d45f2 tempest-AbsoluteLimitsTests-861850908 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:57:35 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-b8629bd5-9c36-406f-97ce-2fdcd30d45f2 tempest-AbsoluteLimitsTests-861850908 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:57:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b8629bd5-9c36-406f-97ce-2fdcd30d45f2 tempest-AbsoluteLimitsTests-861850908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-25fc5212-5a53-4f98-9708-425959d46e47 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:35 devstack sudo[97947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-25fc5212-5a53-4f98-9708-425959d46e47 1073741824 Sep 04 17:57:35 devstack sudo[97947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:36 devstack sudo[97947]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b8629bd5-9c36-406f-97ce-2fdcd30d45f2 tempest-AbsoluteLimitsTests-861850908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-25fc5212-5a53-4f98-9708-425959d46e47 1073741824" returned: 0 in 0.440s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b8629bd5-9c36-406f-97ce-2fdcd30d45f2 tempest-AbsoluteLimitsTests-861850908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-25fc5212-5a53-4f98-9708-425959d46e47 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:36 devstack sudo[97952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-25fc5212-5a53-4f98-9708-425959d46e47 Sep 04 17:57:36 devstack sudo[97952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:36 devstack sudo[97952]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b8629bd5-9c36-406f-97ce-2fdcd30d45f2 tempest-AbsoluteLimitsTests-861850908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-25fc5212-5a53-4f98-9708-425959d46e47" returned: 0 in 0.261s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b8629bd5-9c36-406f-97ce-2fdcd30d45f2 tempest-AbsoluteLimitsTests-861850908 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:57:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b8629bd5-9c36-406f-97ce-2fdcd30d45f2 tempest-AbsoluteLimitsTests-861850908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:57:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b8629bd5-9c36-406f-97ce-2fdcd30d45f2 tempest-AbsoluteLimitsTests-861850908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (879bec14-ecd7-4c3c-9788-bd6046dc7e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25fc5212-5a53-4f98-9708-425959d46e47', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:57:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b8629bd5-9c36-406f-97ce-2fdcd30d45f2 tempest-AbsoluteLimitsTests-861850908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fb3c316-2b36-4f1f-b9d0-1f6c6ab5c3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:57:36 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-b8629bd5-9c36-406f-97ce-2fdcd30d45f2 tempest-AbsoluteLimitsTests-861850908 None] Volume volume-25fc5212-5a53-4f98-9708-425959d46e47 (25fc5212-5a53-4f98-9708-425959d46e47): created successfully Sep 04 17:57:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b8629bd5-9c36-406f-97ce-2fdcd30d45f2 tempest-AbsoluteLimitsTests-861850908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fb3c316-2b36-4f1f-b9d0-1f6c6ab5c3fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:57:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b8629bd5-9c36-406f-97ce-2fdcd30d45f2 tempest-AbsoluteLimitsTests-861850908 None] Flow 'volume_create_manager' (7bb48f40-d1db-43f2-b23b-5e1942757a9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:57:36 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-b8629bd5-9c36-406f-97ce-2fdcd30d45f2 tempest-AbsoluteLimitsTests-861850908 None] Created volume successfully. Sep 04 17:57:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f9a00905-08be-4ef3-94ea-1f7da132d151 tempest-AbsoluteLimitsTests-861850908 None] Acquiring lock "cinder-25fc5212-5a53-4f98-9708-425959d46e47-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:57:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f9a00905-08be-4ef3-94ea-1f7da132d151 tempest-AbsoluteLimitsTests-861850908 None] Lock "cinder-25fc5212-5a53-4f98-9708-425959d46e47-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:57:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f9a00905-08be-4ef3-94ea-1f7da132d151 tempest-AbsoluteLimitsTests-861850908 None] Acquiring lock "cinder-quobyte-25fc5212-5a53-4f98-9708-425959d46e47" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:57:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f9a00905-08be-4ef3-94ea-1f7da132d151 tempest-AbsoluteLimitsTests-861850908 None] Lock "cinder-quobyte-25fc5212-5a53-4f98-9708-425959d46e47" acquired by "delete_volume" :: waited 0.031s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:57:38 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7cd143-da24-4093-a0c8-ee6075bd6740]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:57:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f9a00905-08be-4ef3-94ea-1f7da132d151 tempest-AbsoluteLimitsTests-861850908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-25fc5212-5a53-4f98-9708-425959d46e47 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:38 devstack sudo[97957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-25fc5212-5a53-4f98-9708-425959d46e47 Sep 04 17:57:38 devstack sudo[97957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:38 devstack sudo[97957]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f9a00905-08be-4ef3-94ea-1f7da132d151 tempest-AbsoluteLimitsTests-861850908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-25fc5212-5a53-4f98-9708-425959d46e47" returned: 0 in 0.441s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f9a00905-08be-4ef3-94ea-1f7da132d151 tempest-AbsoluteLimitsTests-861850908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-25fc5212-5a53-4f98-9708-425959d46e47 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:38 devstack sudo[97963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-25fc5212-5a53-4f98-9708-425959d46e47 Sep 04 17:57:38 devstack sudo[97963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:38 devstack sudo[97963]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f9a00905-08be-4ef3-94ea-1f7da132d151 tempest-AbsoluteLimitsTests-861850908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-25fc5212-5a53-4f98-9708-425959d46e47" returned: 0 in 0.393s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f9a00905-08be-4ef3-94ea-1f7da132d151 tempest-AbsoluteLimitsTests-861850908 None] Lock "cinder-quobyte-25fc5212-5a53-4f98-9708-425959d46e47" released by "delete_volume" :: held 0.891s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:57:38 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:UPDATE=210,cinder:SELECT=182,cinder:INSERT=42,cinder:DELETE=14 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 17:57:38 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-f9a00905-08be-4ef3-94ea-1f7da132d151 tempest-AbsoluteLimitsTests-861850908 None] Created reservations ['53889564-5dd2-4a79-b67b-a07a6436d921', '493ee9ba-bc60-4679-bbc1-9426fd716913', 'a93ff2a7-b53a-4505-b0b3-9acfa96593fd', 'd13f8f0c-bbc9-483b-8ef7-5a38d6f1b225'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:57:38 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=178,cinder:UPDATE=197,cinder:INSERT=58,cinder:DELETE=8 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 17:57:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f9a00905-08be-4ef3-94ea-1f7da132d151 tempest-AbsoluteLimitsTests-861850908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:57:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f9a00905-08be-4ef3-94ea-1f7da132d151 tempest-AbsoluteLimitsTests-861850908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:57:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f9a00905-08be-4ef3-94ea-1f7da132d151 tempest-AbsoluteLimitsTests-861850908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:57:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f9a00905-08be-4ef3-94ea-1f7da132d151 tempest-AbsoluteLimitsTests-861850908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:57:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f9a00905-08be-4ef3-94ea-1f7da132d151 tempest-AbsoluteLimitsTests-861850908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:57:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f9a00905-08be-4ef3-94ea-1f7da132d151 tempest-AbsoluteLimitsTests-861850908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:39 devstack sudo[97985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:57:39 devstack sudo[97985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:39 devstack sudo[97985]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f9a00905-08be-4ef3-94ea-1f7da132d151 tempest-AbsoluteLimitsTests-861850908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.352s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:39 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-f9a00905-08be-4ef3-94ea-1f7da132d151 tempest-AbsoluteLimitsTests-861850908 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:57:39 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-f9a00905-08be-4ef3-94ea-1f7da132d151 tempest-AbsoluteLimitsTests-861850908 None] Deleted volume successfully. Sep 04 17:57:39 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f9a00905-08be-4ef3-94ea-1f7da132d151 tempest-AbsoluteLimitsTests-861850908 None] Lock "cinder-25fc5212-5a53-4f98-9708-425959d46e47-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:57:41 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-391a996b-bc10-4301-9607-e7704084700c tempest-GroupSnapshotsV319Test-2030846502 None] Group tempest-GroupSnapshotsV319Test-Group-1991263521: creating Sep 04 17:57:41 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-391a996b-bc10-4301-9607-e7704084700c tempest-GroupSnapshotsV319Test-2030846502 None] Group tempest-GroupSnapshotsV319Test-Group-1991263521: created successfully Sep 04 17:57:41 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-391a996b-bc10-4301-9607-e7704084700c tempest-GroupSnapshotsV319Test-2030846502 None] Create group completed successfully. Sep 04 17:57:42 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2310c1b8-cc13-4e5b-9205-8884b94557da tempest-AttachVolumeShelveTestJSON-1130860107 None] Acquiring lock "cinder-391c7c53-9752-48ce-80cf-5a132a172ed0-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:57:42 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2310c1b8-cc13-4e5b-9205-8884b94557da tempest-AttachVolumeShelveTestJSON-1130860107 None] Lock "cinder-391c7c53-9752-48ce-80cf-5a132a172ed0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:57:42 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2310c1b8-cc13-4e5b-9205-8884b94557da tempest-AttachVolumeShelveTestJSON-1130860107 None] Acquiring lock "cinder-quobyte-391c7c53-9752-48ce-80cf-5a132a172ed0" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:57:42 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2310c1b8-cc13-4e5b-9205-8884b94557da tempest-AttachVolumeShelveTestJSON-1130860107 None] Lock "cinder-quobyte-391c7c53-9752-48ce-80cf-5a132a172ed0" acquired by "delete_volume" :: waited 0.020s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:57:42 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[4864bd82-591f-4441-8bfe-290cc89e908d]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:57:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2310c1b8-cc13-4e5b-9205-8884b94557da tempest-AttachVolumeShelveTestJSON-1130860107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-391c7c53-9752-48ce-80cf-5a132a172ed0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:42 devstack sudo[98028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-391c7c53-9752-48ce-80cf-5a132a172ed0 Sep 04 17:57:42 devstack sudo[98028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:42 devstack sudo[98028]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2310c1b8-cc13-4e5b-9205-8884b94557da tempest-AttachVolumeShelveTestJSON-1130860107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-391c7c53-9752-48ce-80cf-5a132a172ed0" returned: 0 in 0.396s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2310c1b8-cc13-4e5b-9205-8884b94557da tempest-AttachVolumeShelveTestJSON-1130860107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-391c7c53-9752-48ce-80cf-5a132a172ed0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:42 devstack sudo[98034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-391c7c53-9752-48ce-80cf-5a132a172ed0 Sep 04 17:57:42 devstack sudo[98034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:43 devstack sudo[98034]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2310c1b8-cc13-4e5b-9205-8884b94557da tempest-AttachVolumeShelveTestJSON-1130860107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-391c7c53-9752-48ce-80cf-5a132a172ed0" returned: 0 in 0.287s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:43 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2310c1b8-cc13-4e5b-9205-8884b94557da tempest-AttachVolumeShelveTestJSON-1130860107 None] Lock "cinder-quobyte-391c7c53-9752-48ce-80cf-5a132a172ed0" released by "delete_volume" :: held 0.731s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:57:43 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-2310c1b8-cc13-4e5b-9205-8884b94557da tempest-AttachVolumeShelveTestJSON-1130860107 None] Created reservations ['a6ab55b3-cc18-4734-9a83-a71f29e3dc4c', '61880aa0-4f9e-496e-b855-2ff382209f29', '22670926-eb1d-4fe6-94a2-28ace9d250b0', '9eb3d990-c738-4fdc-9198-e13ec0278607'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:57:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-2310c1b8-cc13-4e5b-9205-8884b94557da tempest-AttachVolumeShelveTestJSON-1130860107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:57:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-2310c1b8-cc13-4e5b-9205-8884b94557da tempest-AttachVolumeShelveTestJSON-1130860107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:57:43 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-2310c1b8-cc13-4e5b-9205-8884b94557da tempest-AttachVolumeShelveTestJSON-1130860107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:57:43 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-2310c1b8-cc13-4e5b-9205-8884b94557da tempest-AttachVolumeShelveTestJSON-1130860107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:57:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-2310c1b8-cc13-4e5b-9205-8884b94557da tempest-AttachVolumeShelveTestJSON-1130860107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:57:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2310c1b8-cc13-4e5b-9205-8884b94557da tempest-AttachVolumeShelveTestJSON-1130860107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:43 devstack sudo[98037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:57:43 devstack sudo[98037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:43 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-abaa43f3-ab43-486c-986f-731015194d0b tempest-GroupSnapshotsV319Test-2030846502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:57:43 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-abaa43f3-ab43-486c-986f-731015194d0b tempest-GroupSnapshotsV319Test-2030846502 None] Flow 'volume_create_manager' (7a50fe4d-193e-48fd-8a6d-1e643c82a15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:57:43 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-abaa43f3-ab43-486c-986f-731015194d0b tempest-GroupSnapshotsV319Test-2030846502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce98c0dc-e329-4faf-9ede-0cd2cd964bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:57:43 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-abaa43f3-ab43-486c-986f-731015194d0b tempest-GroupSnapshotsV319Test-2030846502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce98c0dc-e329-4faf-9ede-0cd2cd964bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:57:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1759983814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2434811d-40db-4bc3-8098-ecb80b3d9e2c,host='devstack@QuobyteHD#QuobyteHD',id=76a4ea30-813f-49ab-ac54-d785c4603d40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3bf4dd59a454f18955e0c1437380a50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:57:43Z,use_quota=True,user_id='9017c61065b04e0882af0065bac0b835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(26f1486a-eea0-4f15-8909-425eb17e3f79),volume_type_id=26f1486a-eea0-4f15-8909-425eb17e3f79)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:57:43 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-abaa43f3-ab43-486c-986f-731015194d0b tempest-GroupSnapshotsV319Test-2030846502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9562bd07-8472-4e1d-a616-05cf917e8f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:57:43 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-abaa43f3-ab43-486c-986f-731015194d0b tempest-GroupSnapshotsV319Test-2030846502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9562bd07-8472-4e1d-a616-05cf917e8f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:57:43 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-abaa43f3-ab43-486c-986f-731015194d0b tempest-GroupSnapshotsV319Test-2030846502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d9556ca-d38c-4673-bca7-a2bb8460fb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:57:43 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-abaa43f3-ab43-486c-986f-731015194d0b tempest-GroupSnapshotsV319Test-2030846502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d9556ca-d38c-4673-bca7-a2bb8460fb3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76a4ea30-813f-49ab-ac54-d785c4603d40', 'volume_name': 'volume-76a4ea30-813f-49ab-ac54-d785c4603d40', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:57:43 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-abaa43f3-ab43-486c-986f-731015194d0b tempest-GroupSnapshotsV319Test-2030846502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7a7f9db-8353-4755-b395-e2508db033cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:57:43 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-abaa43f3-ab43-486c-986f-731015194d0b tempest-GroupSnapshotsV319Test-2030846502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7a7f9db-8353-4755-b395-e2508db033cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:57:43 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-abaa43f3-ab43-486c-986f-731015194d0b tempest-GroupSnapshotsV319Test-2030846502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c59f8a49-551f-465f-a9f2-0405564ed1aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:57:43 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-abaa43f3-ab43-486c-986f-731015194d0b tempest-GroupSnapshotsV319Test-2030846502 None] Volume 76a4ea30-813f-49ab-ac54-d785c4603d40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76a4ea30-813f-49ab-ac54-d785c4603d40', 'volume_size': 1} Sep 04 17:57:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-abaa43f3-ab43-486c-986f-731015194d0b tempest-GroupSnapshotsV319Test-2030846502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:57:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-abaa43f3-ab43-486c-986f-731015194d0b tempest-GroupSnapshotsV319Test-2030846502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:57:43 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-abaa43f3-ab43-486c-986f-731015194d0b tempest-GroupSnapshotsV319Test-2030846502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2434811d-40db-4bc3-8098-ecb80b3d9e2c,created_at=2026-09-04T15:57:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1759983814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2434811d-40db-4bc3-8098-ecb80b3d9e2c,host='devstack@QuobyteHD#QuobyteHD',id=76a4ea30-813f-49ab-ac54-d785c4603d40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3bf4dd59a454f18955e0c1437380a50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:57:43Z,use_quota=True,user_id='9017c61065b04e0882af0065bac0b835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(26f1486a-eea0-4f15-8909-425eb17e3f79),volume_type_id=26f1486a-eea0-4f15-8909-425eb17e3f79)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:57:43 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-abaa43f3-ab43-486c-986f-731015194d0b tempest-GroupSnapshotsV319Test-2030846502 None] Creating volume 76a4ea30-813f-49ab-ac54-d785c4603d40 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:57:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-abaa43f3-ab43-486c-986f-731015194d0b tempest-GroupSnapshotsV319Test-2030846502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:57:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-abaa43f3-ab43-486c-986f-731015194d0b tempest-GroupSnapshotsV319Test-2030846502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:57:43 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-abaa43f3-ab43-486c-986f-731015194d0b tempest-GroupSnapshotsV319Test-2030846502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:57:43 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-abaa43f3-ab43-486c-986f-731015194d0b tempest-GroupSnapshotsV319Test-2030846502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:57:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-abaa43f3-ab43-486c-986f-731015194d0b tempest-GroupSnapshotsV319Test-2030846502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:57:43 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-abaa43f3-ab43-486c-986f-731015194d0b tempest-GroupSnapshotsV319Test-2030846502 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:57:43 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-abaa43f3-ab43-486c-986f-731015194d0b tempest-GroupSnapshotsV319Test-2030846502 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:57:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-abaa43f3-ab43-486c-986f-731015194d0b tempest-GroupSnapshotsV319Test-2030846502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-76a4ea30-813f-49ab-ac54-d785c4603d40 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:43 devstack sudo[98037]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2310c1b8-cc13-4e5b-9205-8884b94557da tempest-AttachVolumeShelveTestJSON-1130860107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.302s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:43 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-2310c1b8-cc13-4e5b-9205-8884b94557da tempest-AttachVolumeShelveTestJSON-1130860107 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:57:43 devstack sudo[98041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-76a4ea30-813f-49ab-ac54-d785c4603d40 1073741824 Sep 04 17:57:43 devstack sudo[98041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:43 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-2310c1b8-cc13-4e5b-9205-8884b94557da tempest-AttachVolumeShelveTestJSON-1130860107 None] Deleted volume successfully. Sep 04 17:57:43 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2310c1b8-cc13-4e5b-9205-8884b94557da tempest-AttachVolumeShelveTestJSON-1130860107 None] Lock "cinder-391c7c53-9752-48ce-80cf-5a132a172ed0-delete_volume" released by "delete_volume" :: held 1.308s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:57:43 devstack sudo[98041]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-abaa43f3-ab43-486c-986f-731015194d0b tempest-GroupSnapshotsV319Test-2030846502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-76a4ea30-813f-49ab-ac54-d785c4603d40 1073741824" returned: 0 in 0.500s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-abaa43f3-ab43-486c-986f-731015194d0b tempest-GroupSnapshotsV319Test-2030846502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-76a4ea30-813f-49ab-ac54-d785c4603d40 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:44 devstack sudo[98048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-76a4ea30-813f-49ab-ac54-d785c4603d40 Sep 04 17:57:44 devstack sudo[98048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:44 devstack sudo[98048]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-abaa43f3-ab43-486c-986f-731015194d0b tempest-GroupSnapshotsV319Test-2030846502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-76a4ea30-813f-49ab-ac54-d785c4603d40" returned: 0 in 0.254s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:44 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-abaa43f3-ab43-486c-986f-731015194d0b tempest-GroupSnapshotsV319Test-2030846502 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:57:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-abaa43f3-ab43-486c-986f-731015194d0b tempest-GroupSnapshotsV319Test-2030846502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:57:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-abaa43f3-ab43-486c-986f-731015194d0b tempest-GroupSnapshotsV319Test-2030846502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c59f8a49-551f-465f-a9f2-0405564ed1aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76a4ea30-813f-49ab-ac54-d785c4603d40', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:57:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-abaa43f3-ab43-486c-986f-731015194d0b tempest-GroupSnapshotsV319Test-2030846502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b1974da-b5f6-4fdf-8b44-252ca64e34cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:57:44 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-abaa43f3-ab43-486c-986f-731015194d0b tempest-GroupSnapshotsV319Test-2030846502 None] Volume volume-76a4ea30-813f-49ab-ac54-d785c4603d40 (76a4ea30-813f-49ab-ac54-d785c4603d40): created successfully Sep 04 17:57:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-abaa43f3-ab43-486c-986f-731015194d0b tempest-GroupSnapshotsV319Test-2030846502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b1974da-b5f6-4fdf-8b44-252ca64e34cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:57:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-abaa43f3-ab43-486c-986f-731015194d0b tempest-GroupSnapshotsV319Test-2030846502 None] Flow 'volume_create_manager' (7a50fe4d-193e-48fd-8a6d-1e643c82a15a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:57:44 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-abaa43f3-ab43-486c-986f-731015194d0b tempest-GroupSnapshotsV319Test-2030846502 None] Created volume successfully. Sep 04 17:57:44 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-25db7f27-47b0-4fc2-9646-eecd8af43a2c tempest-GroupSnapshotsV319Test-2030846502 None] GroupSnapshot 202f5a0b-1930-4347-ad05-aa737ca7cf14: creating. Sep 04 17:57:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-25db7f27-47b0-4fc2-9646-eecd8af43a2c tempest-GroupSnapshotsV319Test-2030846502 None] Group snapshot 202f5a0b-1930-4347-ad05-aa737ca7cf14: creating. {{(pid=87314) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 04 17:57:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-25db7f27-47b0-4fc2-9646-eecd8af43a2c tempest-GroupSnapshotsV319Test-2030846502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:57:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-25db7f27-47b0-4fc2-9646-eecd8af43a2c tempest-GroupSnapshotsV319Test-2030846502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:57:44 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-4774a0d3-463a-491c-a4e8-3d426c68adf1 tempest-VolumesDeleteCascade-1318752930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:57:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4774a0d3-463a-491c-a4e8-3d426c68adf1 tempest-VolumesDeleteCascade-1318752930 None] Flow 'volume_create_manager' (605746e4-a809-434a-90a2-65dbbcb0c231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:57:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4774a0d3-463a-491c-a4e8-3d426c68adf1 tempest-VolumesDeleteCascade-1318752930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (056565b0-b200-4151-b15e-f8499c1a6961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:57:44 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-25db7f27-47b0-4fc2-9646-eecd8af43a2c tempest-GroupSnapshotsV319Test-2030846502 None] Creating offline snapshot 07614341-0660-4bdc-a572-c6272300c6bb of volume 76a4ea30-813f-49ab-ac54-d785c4603d40 {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 17:57:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4774a0d3-463a-491c-a4e8-3d426c68adf1 tempest-VolumesDeleteCascade-1318752930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (056565b0-b200-4151-b15e-f8499c1a6961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-95074916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4aed2bf2-c689-4a62-aa88-d38295c05bc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6144acfe25745c1b312316309354a28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:57:45Z,use_quota=True,user_id='926bd8f8538b48b2ba82592baeee78fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:57:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4774a0d3-463a-491c-a4e8-3d426c68adf1 tempest-VolumesDeleteCascade-1318752930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be451def-c603-494c-bd94-f2b843863002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:57:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4774a0d3-463a-491c-a4e8-3d426c68adf1 tempest-VolumesDeleteCascade-1318752930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be451def-c603-494c-bd94-f2b843863002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:57:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4774a0d3-463a-491c-a4e8-3d426c68adf1 tempest-VolumesDeleteCascade-1318752930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72340c5d-a264-45cd-bd60-53e2d0577b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:57:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4774a0d3-463a-491c-a4e8-3d426c68adf1 tempest-VolumesDeleteCascade-1318752930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72340c5d-a264-45cd-bd60-53e2d0577b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4aed2bf2-c689-4a62-aa88-d38295c05bc4', 'volume_name': 'volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:57:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4774a0d3-463a-491c-a4e8-3d426c68adf1 tempest-VolumesDeleteCascade-1318752930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e383038-956a-452c-b669-de0ae66e352c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:57:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4774a0d3-463a-491c-a4e8-3d426c68adf1 tempest-VolumesDeleteCascade-1318752930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e383038-956a-452c-b669-de0ae66e352c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:57:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4774a0d3-463a-491c-a4e8-3d426c68adf1 tempest-VolumesDeleteCascade-1318752930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c8f8046-7541-45c4-a1ea-4fe5312ec82d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:57:44 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-4774a0d3-463a-491c-a4e8-3d426c68adf1 tempest-VolumesDeleteCascade-1318752930 None] Volume 4aed2bf2-c689-4a62-aa88-d38295c05bc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4', 'volume_size': 1} Sep 04 17:57:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4774a0d3-463a-491c-a4e8-3d426c68adf1 tempest-VolumesDeleteCascade-1318752930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:57:44 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05af003-308f-450c-998f-c9de35906587]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:57:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-25db7f27-47b0-4fc2-9646-eecd8af43a2c tempest-GroupSnapshotsV319Test-2030846502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-76a4ea30-813f-49ab-ac54-d785c4603d40 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:45 devstack sudo[98051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-76a4ea30-813f-49ab-ac54-d785c4603d40 Sep 04 17:57:45 devstack sudo[98051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:45 devstack sudo[98051]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-25db7f27-47b0-4fc2-9646-eecd8af43a2c tempest-GroupSnapshotsV319Test-2030846502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-76a4ea30-813f-49ab-ac54-d785c4603d40" returned: 0 in 0.378s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-25db7f27-47b0-4fc2-9646-eecd8af43a2c tempest-GroupSnapshotsV319Test-2030846502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-76a4ea30-813f-49ab-ac54-d785c4603d40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-76a4ea30-813f-49ab-ac54-d785c4603d40.07614341-0660-4bdc-a572-c6272300c6bb 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:45 devstack sudo[98057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-76a4ea30-813f-49ab-ac54-d785c4603d40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-76a4ea30-813f-49ab-ac54-d785c4603d40.07614341-0660-4bdc-a572-c6272300c6bb 1G Sep 04 17:57:45 devstack sudo[98057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:45 devstack sudo[98057]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-25db7f27-47b0-4fc2-9646-eecd8af43a2c tempest-GroupSnapshotsV319Test-2030846502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-76a4ea30-813f-49ab-ac54-d785c4603d40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-76a4ea30-813f-49ab-ac54-d785c4603d40.07614341-0660-4bdc-a572-c6272300c6bb 1G" returned: 0 in 0.396s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-25db7f27-47b0-4fc2-9646-eecd8af43a2c tempest-GroupSnapshotsV319Test-2030846502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76a4ea30-813f-49ab-ac54-d785c4603d40 -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-76a4ea30-813f-49ab-ac54-d785c4603d40.07614341-0660-4bdc-a572-c6272300c6bb {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:45 devstack sudo[98063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76a4ea30-813f-49ab-ac54-d785c4603d40 -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-76a4ea30-813f-49ab-ac54-d785c4603d40.07614341-0660-4bdc-a572-c6272300c6bb Sep 04 17:57:45 devstack sudo[98063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:46 devstack sudo[98063]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-25db7f27-47b0-4fc2-9646-eecd8af43a2c tempest-GroupSnapshotsV319Test-2030846502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76a4ea30-813f-49ab-ac54-d785c4603d40 -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-76a4ea30-813f-49ab-ac54-d785c4603d40.07614341-0660-4bdc-a572-c6272300c6bb" returned: 0 in 0.287s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:46 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-25db7f27-47b0-4fc2-9646-eecd8af43a2c tempest-GroupSnapshotsV319Test-2030846502 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-76a4ea30-813f-49ab-ac54-d785c4603d40.07614341-0660-4bdc-a572-c6272300c6bb is being set with open permissions: ugo+rw: NotImplementedError Sep 04 17:57:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-25db7f27-47b0-4fc2-9646-eecd8af43a2c tempest-GroupSnapshotsV319Test-2030846502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-76a4ea30-813f-49ab-ac54-d785c4603d40.07614341-0660-4bdc-a572-c6272300c6bb {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:46 devstack sudo[98068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-76a4ea30-813f-49ab-ac54-d785c4603d40.07614341-0660-4bdc-a572-c6272300c6bb Sep 04 17:57:46 devstack sudo[98068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:46 devstack sudo[98068]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-25db7f27-47b0-4fc2-9646-eecd8af43a2c tempest-GroupSnapshotsV319Test-2030846502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-76a4ea30-813f-49ab-ac54-d785c4603d40.07614341-0660-4bdc-a572-c6272300c6bb" returned: 0 in 0.257s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-25db7f27-47b0-4fc2-9646-eecd8af43a2c tempest-GroupSnapshotsV319Test-2030846502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-76a4ea30-813f-49ab-ac54-d785c4603d40.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:46 devstack sudo[98071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-76a4ea30-813f-49ab-ac54-d785c4603d40.info Sep 04 17:57:46 devstack sudo[98071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:46 devstack sudo[98071]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-25db7f27-47b0-4fc2-9646-eecd8af43a2c tempest-GroupSnapshotsV319Test-2030846502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-76a4ea30-813f-49ab-ac54-d785c4603d40.info" returned: 0 in 0.241s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:46 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-25db7f27-47b0-4fc2-9646-eecd8af43a2c tempest-GroupSnapshotsV319Test-2030846502 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-76a4ea30-813f-49ab-ac54-d785c4603d40.info is being set with open permissions: ugo+rw: NotImplementedError Sep 04 17:57:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-25db7f27-47b0-4fc2-9646-eecd8af43a2c tempest-GroupSnapshotsV319Test-2030846502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-76a4ea30-813f-49ab-ac54-d785c4603d40.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:46 devstack sudo[98074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-76a4ea30-813f-49ab-ac54-d785c4603d40.info Sep 04 17:57:46 devstack sudo[98074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:46 devstack sudo[98074]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-25db7f27-47b0-4fc2-9646-eecd8af43a2c tempest-GroupSnapshotsV319Test-2030846502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-76a4ea30-813f-49ab-ac54-d785c4603d40.info" returned: 0 in 0.227s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-25db7f27-47b0-4fc2-9646-eecd8af43a2c tempest-GroupSnapshotsV319Test-2030846502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.934s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:57:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4774a0d3-463a-491c-a4e8-3d426c68adf1 tempest-VolumesDeleteCascade-1318752930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.839s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:57:46 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4774a0d3-463a-491c-a4e8-3d426c68adf1 tempest-VolumesDeleteCascade-1318752930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-95074916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4aed2bf2-c689-4a62-aa88-d38295c05bc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6144acfe25745c1b312316309354a28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:57:45Z,use_quota=True,user_id='926bd8f8538b48b2ba82592baeee78fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:57:46 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-4774a0d3-463a-491c-a4e8-3d426c68adf1 tempest-VolumesDeleteCascade-1318752930 None] Creating volume 4aed2bf2-c689-4a62-aa88-d38295c05bc4 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:57:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4774a0d3-463a-491c-a4e8-3d426c68adf1 tempest-VolumesDeleteCascade-1318752930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:57:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4774a0d3-463a-491c-a4e8-3d426c68adf1 tempest-VolumesDeleteCascade-1318752930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:57:46 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4774a0d3-463a-491c-a4e8-3d426c68adf1 tempest-VolumesDeleteCascade-1318752930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:57:46 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4774a0d3-463a-491c-a4e8-3d426c68adf1 tempest-VolumesDeleteCascade-1318752930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:57:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4774a0d3-463a-491c-a4e8-3d426c68adf1 tempest-VolumesDeleteCascade-1318752930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:57:46 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4774a0d3-463a-491c-a4e8-3d426c68adf1 tempest-VolumesDeleteCascade-1318752930 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:57:46 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-4774a0d3-463a-491c-a4e8-3d426c68adf1 tempest-VolumesDeleteCascade-1318752930 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:57:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4774a0d3-463a-491c-a4e8-3d426c68adf1 tempest-VolumesDeleteCascade-1318752930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:46 devstack sudo[98077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4 1073741824 Sep 04 17:57:46 devstack sudo[98077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:46 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-25db7f27-47b0-4fc2-9646-eecd8af43a2c tempest-GroupSnapshotsV319Test-2030846502 None] group_snapshot 202f5a0b-1930-4347-ad05-aa737ca7cf14: created successfully Sep 04 17:57:47 devstack sudo[98077]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4774a0d3-463a-491c-a4e8-3d426c68adf1 tempest-VolumesDeleteCascade-1318752930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4 1073741824" returned: 0 in 0.569s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4774a0d3-463a-491c-a4e8-3d426c68adf1 tempest-VolumesDeleteCascade-1318752930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:47 devstack sudo[98083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4 Sep 04 17:57:47 devstack sudo[98083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:47 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-dc098283-35a5-48c1-85e0-2d292eecc50a tempest-GroupSnapshotsV319Test-2030846502 None] group_snapshot 202f5a0b-1930-4347-ad05-aa737ca7cf14: deleting Sep 04 17:57:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dc098283-35a5-48c1-85e0-2d292eecc50a tempest-GroupSnapshotsV319Test-2030846502 None] group_snapshot 202f5a0b-1930-4347-ad05-aa737ca7cf14: deleting {{(pid=87314) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 04 17:57:47 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-dc098283-35a5-48c1-85e0-2d292eecc50a tempest-GroupSnapshotsV319Test-2030846502 None] Acquiring lock "cinder-quobyte-76a4ea30-813f-49ab-ac54-d785c4603d40" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:57:47 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-dc098283-35a5-48c1-85e0-2d292eecc50a tempest-GroupSnapshotsV319Test-2030846502 None] Lock "cinder-quobyte-76a4ea30-813f-49ab-ac54-d785c4603d40" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:57:47 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-dc098283-35a5-48c1-85e0-2d292eecc50a tempest-GroupSnapshotsV319Test-2030846502 None] Acquiring lock "cinder-quobyte-07614341-0660-4bdc-a572-c6272300c6bb" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:57:47 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-dc098283-35a5-48c1-85e0-2d292eecc50a tempest-GroupSnapshotsV319Test-2030846502 None] Lock "cinder-quobyte-07614341-0660-4bdc-a572-c6272300c6bb" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:57:47 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-dc098283-35a5-48c1-85e0-2d292eecc50a tempest-GroupSnapshotsV319Test-2030846502 None] Deleting offline snapshot 07614341-0660-4bdc-a572-c6272300c6bb of volume 76a4ea30-813f-49ab-ac54-d785c4603d40 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 17:57:47 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-dc098283-35a5-48c1-85e0-2d292eecc50a tempest-GroupSnapshotsV319Test-2030846502 None] snapshot_file for this snap is: volume-76a4ea30-813f-49ab-ac54-d785c4603d40.07614341-0660-4bdc-a572-c6272300c6bb {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 17:57:47 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[68995631-4213-49a8-bbca-025bcd90c73b]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:57:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dc098283-35a5-48c1-85e0-2d292eecc50a tempest-GroupSnapshotsV319Test-2030846502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-76a4ea30-813f-49ab-ac54-d785c4603d40.07614341-0660-4bdc-a572-c6272300c6bb {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:47 devstack sudo[98083]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4774a0d3-463a-491c-a4e8-3d426c68adf1 tempest-VolumesDeleteCascade-1318752930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4" returned: 0 in 0.281s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:47 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4774a0d3-463a-491c-a4e8-3d426c68adf1 tempest-VolumesDeleteCascade-1318752930 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:57:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4774a0d3-463a-491c-a4e8-3d426c68adf1 tempest-VolumesDeleteCascade-1318752930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:57:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4774a0d3-463a-491c-a4e8-3d426c68adf1 tempest-VolumesDeleteCascade-1318752930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c8f8046-7541-45c4-a1ea-4fe5312ec82d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:57:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4774a0d3-463a-491c-a4e8-3d426c68adf1 tempest-VolumesDeleteCascade-1318752930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01a733f7-dbba-47ea-86ef-b14d98a0d062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:57:47 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-4774a0d3-463a-491c-a4e8-3d426c68adf1 tempest-VolumesDeleteCascade-1318752930 None] Volume volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4 (4aed2bf2-c689-4a62-aa88-d38295c05bc4): created successfully Sep 04 17:57:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4774a0d3-463a-491c-a4e8-3d426c68adf1 tempest-VolumesDeleteCascade-1318752930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01a733f7-dbba-47ea-86ef-b14d98a0d062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:57:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4774a0d3-463a-491c-a4e8-3d426c68adf1 tempest-VolumesDeleteCascade-1318752930 None] Flow 'volume_create_manager' (605746e4-a809-434a-90a2-65dbbcb0c231) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:57:47 devstack sudo[98085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-76a4ea30-813f-49ab-ac54-d785c4603d40.07614341-0660-4bdc-a572-c6272300c6bb Sep 04 17:57:47 devstack sudo[98085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:47 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-4774a0d3-463a-491c-a4e8-3d426c68adf1 tempest-VolumesDeleteCascade-1318752930 None] Created volume successfully. Sep 04 17:57:48 devstack sudo[98085]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dc098283-35a5-48c1-85e0-2d292eecc50a tempest-GroupSnapshotsV319Test-2030846502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-76a4ea30-813f-49ab-ac54-d785c4603d40.07614341-0660-4bdc-a572-c6272300c6bb" returned: 0 in 0.457s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:48 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-dc098283-35a5-48c1-85e0-2d292eecc50a tempest-GroupSnapshotsV319Test-2030846502 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76a4ea30-813f-49ab-ac54-d785c4603d40(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 17:57:48 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc0358b-f698-4748-a488-d06b83dda92c]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:57:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dc098283-35a5-48c1-85e0-2d292eecc50a tempest-GroupSnapshotsV319Test-2030846502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-76a4ea30-813f-49ab-ac54-d785c4603d40 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0c855f28-cf55-4fac-b681-e1c937bb7d28 tempest-VolumesDeleteCascade-1318752930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:57:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0c855f28-cf55-4fac-b681-e1c937bb7d28 tempest-VolumesDeleteCascade-1318752930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:57:48 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-0c855f28-cf55-4fac-b681-e1c937bb7d28 tempest-VolumesDeleteCascade-1318752930 None] Creating offline snapshot a4c037d5-e6be-4a03-96d3-58ff9d373da0 of volume 4aed2bf2-c689-4a62-aa88-d38295c05bc4 {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 17:57:48 devstack sudo[98092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-76a4ea30-813f-49ab-ac54-d785c4603d40 Sep 04 17:57:48 devstack sudo[98092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:48 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd98c88-7963-4b33-9cdf-80ab8f8d216c]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:57:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0c855f28-cf55-4fac-b681-e1c937bb7d28 tempest-VolumesDeleteCascade-1318752930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:48 devstack sudo[98094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4 Sep 04 17:57:48 devstack sudo[98094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:48 devstack sudo[98092]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dc098283-35a5-48c1-85e0-2d292eecc50a tempest-GroupSnapshotsV319Test-2030846502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-76a4ea30-813f-49ab-ac54-d785c4603d40" returned: 0 in 0.423s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dc098283-35a5-48c1-85e0-2d292eecc50a tempest-GroupSnapshotsV319Test-2030846502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-76a4ea30-813f-49ab-ac54-d785c4603d40.07614341-0660-4bdc-a572-c6272300c6bb {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:48 devstack sudo[98099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-76a4ea30-813f-49ab-ac54-d785c4603d40.07614341-0660-4bdc-a572-c6272300c6bb Sep 04 17:57:48 devstack sudo[98099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:48 devstack sudo[98094]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0c855f28-cf55-4fac-b681-e1c937bb7d28 tempest-VolumesDeleteCascade-1318752930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4" returned: 0 in 0.424s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0c855f28-cf55-4fac-b681-e1c937bb7d28 tempest-VolumesDeleteCascade-1318752930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4.a4c037d5-e6be-4a03-96d3-58ff9d373da0 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:48 devstack sudo[98104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4.a4c037d5-e6be-4a03-96d3-58ff9d373da0 1G Sep 04 17:57:48 devstack sudo[98104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:48 devstack sudo[98099]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dc098283-35a5-48c1-85e0-2d292eecc50a tempest-GroupSnapshotsV319Test-2030846502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-76a4ea30-813f-49ab-ac54-d785c4603d40.07614341-0660-4bdc-a572-c6272300c6bb" returned: 0 in 0.396s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dc098283-35a5-48c1-85e0-2d292eecc50a tempest-GroupSnapshotsV319Test-2030846502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-76a4ea30-813f-49ab-ac54-d785c4603d40.07614341-0660-4bdc-a572-c6272300c6bb {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:49 devstack sudo[98112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-76a4ea30-813f-49ab-ac54-d785c4603d40.07614341-0660-4bdc-a572-c6272300c6bb Sep 04 17:57:49 devstack sudo[98112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:49 devstack sudo[98104]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0c855f28-cf55-4fac-b681-e1c937bb7d28 tempest-VolumesDeleteCascade-1318752930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4.a4c037d5-e6be-4a03-96d3-58ff9d373da0 1G" returned: 0 in 0.479s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0c855f28-cf55-4fac-b681-e1c937bb7d28 tempest-VolumesDeleteCascade-1318752930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4 -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4.a4c037d5-e6be-4a03-96d3-58ff9d373da0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:49 devstack sudo[98114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4 -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4.a4c037d5-e6be-4a03-96d3-58ff9d373da0 Sep 04 17:57:49 devstack sudo[98114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:49 devstack sudo[98112]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dc098283-35a5-48c1-85e0-2d292eecc50a tempest-GroupSnapshotsV319Test-2030846502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-76a4ea30-813f-49ab-ac54-d785c4603d40.07614341-0660-4bdc-a572-c6272300c6bb" returned: 0 in 0.292s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-dc098283-35a5-48c1-85e0-2d292eecc50a tempest-GroupSnapshotsV319Test-2030846502 None] Lock "cinder-quobyte-07614341-0660-4bdc-a572-c6272300c6bb" released by "_delete_snapshot" :: held 1.697s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:57:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-dc098283-35a5-48c1-85e0-2d292eecc50a tempest-GroupSnapshotsV319Test-2030846502 None] Lock "cinder-quobyte-76a4ea30-813f-49ab-ac54-d785c4603d40" released by "delete_snapshot" :: held 1.722s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:57:49 devstack cinder-volume[87314]: WARNING cinder.quota [None req-dc098283-35a5-48c1-85e0-2d292eecc50a tempest-GroupSnapshotsV319Test-2030846502 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2005996382 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2005996382, it is now deprecated. Please use the default quota class for default quota. Sep 04 17:57:49 devstack cinder-volume[87314]: WARNING cinder.quota [None req-dc098283-35a5-48c1-85e0-2d292eecc50a tempest-GroupSnapshotsV319Test-2030846502 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-2005996382 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-2005996382, it is now deprecated. Please use the default quota class for default quota. Sep 04 17:57:49 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-dc098283-35a5-48c1-85e0-2d292eecc50a tempest-GroupSnapshotsV319Test-2030846502 None] Created reservations ['b9953ee6-87de-4f0a-95d9-e5ab8928c36b', 'c156e5d5-fb70-4071-a467-8b0ddee17669', '2ce7fa4b-56fb-4211-94b7-86f23f8a499a', 'e781066b-9871-4ba6-bc79-63b813758dd4'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:57:49 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-dc098283-35a5-48c1-85e0-2d292eecc50a tempest-GroupSnapshotsV319Test-2030846502 None] group_snapshot 202f5a0b-1930-4347-ad05-aa737ca7cf14: deleted successfully Sep 04 17:57:49 devstack sudo[98114]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0c855f28-cf55-4fac-b681-e1c937bb7d28 tempest-VolumesDeleteCascade-1318752930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4 -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4.a4c037d5-e6be-4a03-96d3-58ff9d373da0" returned: 0 in 0.331s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:49 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-0c855f28-cf55-4fac-b681-e1c937bb7d28 tempest-VolumesDeleteCascade-1318752930 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4.a4c037d5-e6be-4a03-96d3-58ff9d373da0 is being set with open permissions: ugo+rw Sep 04 17:57:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0c855f28-cf55-4fac-b681-e1c937bb7d28 tempest-VolumesDeleteCascade-1318752930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4.a4c037d5-e6be-4a03-96d3-58ff9d373da0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:49 devstack sudo[98121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4.a4c037d5-e6be-4a03-96d3-58ff9d373da0 Sep 04 17:57:49 devstack sudo[98121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:49 devstack sudo[98121]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0c855f28-cf55-4fac-b681-e1c937bb7d28 tempest-VolumesDeleteCascade-1318752930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4.a4c037d5-e6be-4a03-96d3-58ff9d373da0" returned: 0 in 0.258s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0c855f28-cf55-4fac-b681-e1c937bb7d28 tempest-VolumesDeleteCascade-1318752930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:49 devstack sudo[98124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4.info Sep 04 17:57:49 devstack sudo[98124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:50 devstack sudo[98124]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0c855f28-cf55-4fac-b681-e1c937bb7d28 tempest-VolumesDeleteCascade-1318752930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4.info" returned: 0 in 0.265s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:50 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-0c855f28-cf55-4fac-b681-e1c937bb7d28 tempest-VolumesDeleteCascade-1318752930 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4.info is being set with open permissions: ugo+rw Sep 04 17:57:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0c855f28-cf55-4fac-b681-e1c937bb7d28 tempest-VolumesDeleteCascade-1318752930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:50 devstack sudo[98127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4.info Sep 04 17:57:50 devstack sudo[98127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:50 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-bb9ea0a7-8eaa-4f38-b371-4bd29776a902 tempest-GroupSnapshotsV319Test-2030846502 None] Acquiring lock "cinder-quobyte-76a4ea30-813f-49ab-ac54-d785c4603d40" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:57:50 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-bb9ea0a7-8eaa-4f38-b371-4bd29776a902 tempest-GroupSnapshotsV319Test-2030846502 None] Lock "cinder-quobyte-76a4ea30-813f-49ab-ac54-d785c4603d40" acquired by "delete_volume" :: waited 0.017s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:57:50 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[52088958-42cb-4fe6-829c-7ca5a1f80ee5]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:57:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bb9ea0a7-8eaa-4f38-b371-4bd29776a902 tempest-GroupSnapshotsV319Test-2030846502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-76a4ea30-813f-49ab-ac54-d785c4603d40 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:50 devstack sudo[98129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-76a4ea30-813f-49ab-ac54-d785c4603d40 Sep 04 17:57:50 devstack sudo[98129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:50 devstack sudo[98127]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0c855f28-cf55-4fac-b681-e1c937bb7d28 tempest-VolumesDeleteCascade-1318752930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4.info" returned: 0 in 0.291s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0c855f28-cf55-4fac-b681-e1c937bb7d28 tempest-VolumesDeleteCascade-1318752930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.141s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:57:50 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-0c855f28-cf55-4fac-b681-e1c937bb7d28 tempest-VolumesDeleteCascade-1318752930 None] Create snapshot completed successfully Sep 04 17:57:50 devstack sudo[98129]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bb9ea0a7-8eaa-4f38-b371-4bd29776a902 tempest-GroupSnapshotsV319Test-2030846502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-76a4ea30-813f-49ab-ac54-d785c4603d40" returned: 0 in 0.425s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bb9ea0a7-8eaa-4f38-b371-4bd29776a902 tempest-GroupSnapshotsV319Test-2030846502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-76a4ea30-813f-49ab-ac54-d785c4603d40 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:50 devstack sudo[98135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-76a4ea30-813f-49ab-ac54-d785c4603d40 Sep 04 17:57:50 devstack sudo[98135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:50 devstack sudo[98135]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bb9ea0a7-8eaa-4f38-b371-4bd29776a902 tempest-GroupSnapshotsV319Test-2030846502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-76a4ea30-813f-49ab-ac54-d785c4603d40" returned: 0 in 0.251s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:50 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-bb9ea0a7-8eaa-4f38-b371-4bd29776a902 tempest-GroupSnapshotsV319Test-2030846502 None] Lock "cinder-quobyte-76a4ea30-813f-49ab-ac54-d785c4603d40" released by "delete_volume" :: held 0.751s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:57:50 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-bb9ea0a7-8eaa-4f38-b371-4bd29776a902 tempest-GroupSnapshotsV319Test-2030846502 None] Created reservations ['9f9cc070-20b4-45ef-b947-b004d610c9b0'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:57:50 devstack cinder-volume[87314]: WARNING cinder.quota [None req-bb9ea0a7-8eaa-4f38-b371-4bd29776a902 tempest-GroupSnapshotsV319Test-2030846502 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-2005996382 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-2005996382, it is now deprecated. Please use the default quota class for default quota. Sep 04 17:57:51 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-bb9ea0a7-8eaa-4f38-b371-4bd29776a902 tempest-GroupSnapshotsV319Test-2030846502 None] Created reservations ['7ea7c7fd-db5b-4a3d-a32d-a7839cca13a2', 'e3d53f28-1be4-42be-9324-edd3ee36027b', '858fd0b0-a464-436d-b1d8-b51df9a30d4b', '30a33103-2992-40fd-aab5-651ea515b27d'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:57:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bb9ea0a7-8eaa-4f38-b371-4bd29776a902 tempest-GroupSnapshotsV319Test-2030846502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:57:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bb9ea0a7-8eaa-4f38-b371-4bd29776a902 tempest-GroupSnapshotsV319Test-2030846502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:57:51 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-bb9ea0a7-8eaa-4f38-b371-4bd29776a902 tempest-GroupSnapshotsV319Test-2030846502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:57:51 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-bb9ea0a7-8eaa-4f38-b371-4bd29776a902 tempest-GroupSnapshotsV319Test-2030846502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:57:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bb9ea0a7-8eaa-4f38-b371-4bd29776a902 tempest-GroupSnapshotsV319Test-2030846502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:57:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bb9ea0a7-8eaa-4f38-b371-4bd29776a902 tempest-GroupSnapshotsV319Test-2030846502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:51 devstack sudo[98138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:57:51 devstack sudo[98138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:51 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-afea0e2c-4e93-4e75-b890-fa6480c53633 tempest-BackendsCapabilitiesAdminTestsJSON-1834007539 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.743392944336, 'free_capacity_gb': 1773.743392944336, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87314) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 04 17:57:51 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b4587583-0534-49a0-8aab-5559c9316220 tempest-BackendsCapabilitiesAdminTestsJSON-1834007539 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.743392944336, 'free_capacity_gb': 1773.743392944336, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87314) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 04 17:57:51 devstack sudo[98138]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bb9ea0a7-8eaa-4f38-b371-4bd29776a902 tempest-GroupSnapshotsV319Test-2030846502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.288s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:51 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-bb9ea0a7-8eaa-4f38-b371-4bd29776a902 tempest-GroupSnapshotsV319Test-2030846502 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:57:51 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-bb9ea0a7-8eaa-4f38-b371-4bd29776a902 tempest-GroupSnapshotsV319Test-2030846502 None] Delete group completed successfully. Sep 04 17:57:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c5df02d6-7650-4d75-8239-12747811a329 tempest-VolumesDeleteCascade-1318752930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:57:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c5df02d6-7650-4d75-8239-12747811a329 tempest-VolumesDeleteCascade-1318752930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:57:51 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-c5df02d6-7650-4d75-8239-12747811a329 tempest-VolumesDeleteCascade-1318752930 None] Creating offline snapshot 978deed6-ef71-46fa-b46f-7c0d5963c02b of volume 4aed2bf2-c689-4a62-aa88-d38295c05bc4 {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 17:57:51 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[96410e2a-8c49-4e44-969a-488e3e4ee4d7]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:57:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c5df02d6-7650-4d75-8239-12747811a329 tempest-VolumesDeleteCascade-1318752930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4.a4c037d5-e6be-4a03-96d3-58ff9d373da0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:51 devstack sudo[98141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4.a4c037d5-e6be-4a03-96d3-58ff9d373da0 Sep 04 17:57:51 devstack sudo[98141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:52 devstack sudo[98141]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c5df02d6-7650-4d75-8239-12747811a329 tempest-VolumesDeleteCascade-1318752930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4.a4c037d5-e6be-4a03-96d3-58ff9d373da0" returned: 0 in 0.400s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:52 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-c5df02d6-7650-4d75-8239-12747811a329 tempest-VolumesDeleteCascade-1318752930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 17:57:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c5df02d6-7650-4d75-8239-12747811a329 tempest-VolumesDeleteCascade-1318752930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4.a4c037d5-e6be-4a03-96d3-58ff9d373da0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4.978deed6-ef71-46fa-b46f-7c0d5963c02b 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:52 devstack sudo[98146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4.a4c037d5-e6be-4a03-96d3-58ff9d373da0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4.978deed6-ef71-46fa-b46f-7c0d5963c02b 1G Sep 04 17:57:52 devstack sudo[98146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:52 devstack sudo[98146]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c5df02d6-7650-4d75-8239-12747811a329 tempest-VolumesDeleteCascade-1318752930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4.a4c037d5-e6be-4a03-96d3-58ff9d373da0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4.978deed6-ef71-46fa-b46f-7c0d5963c02b 1G" returned: 0 in 0.559s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c5df02d6-7650-4d75-8239-12747811a329 tempest-VolumesDeleteCascade-1318752930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4.a4c037d5-e6be-4a03-96d3-58ff9d373da0 -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4.978deed6-ef71-46fa-b46f-7c0d5963c02b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:52 devstack sudo[98152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4.a4c037d5-e6be-4a03-96d3-58ff9d373da0 -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4.978deed6-ef71-46fa-b46f-7c0d5963c02b Sep 04 17:57:52 devstack sudo[98152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:52 devstack sudo[98152]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c5df02d6-7650-4d75-8239-12747811a329 tempest-VolumesDeleteCascade-1318752930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4.a4c037d5-e6be-4a03-96d3-58ff9d373da0 -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4.978deed6-ef71-46fa-b46f-7c0d5963c02b" returned: 0 in 0.335s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:52 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-c5df02d6-7650-4d75-8239-12747811a329 tempest-VolumesDeleteCascade-1318752930 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4.978deed6-ef71-46fa-b46f-7c0d5963c02b is being set with open permissions: ugo+rw Sep 04 17:57:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c5df02d6-7650-4d75-8239-12747811a329 tempest-VolumesDeleteCascade-1318752930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4.978deed6-ef71-46fa-b46f-7c0d5963c02b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:53 devstack sudo[98157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4.978deed6-ef71-46fa-b46f-7c0d5963c02b Sep 04 17:57:53 devstack sudo[98157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:53 devstack sudo[98157]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c5df02d6-7650-4d75-8239-12747811a329 tempest-VolumesDeleteCascade-1318752930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4.978deed6-ef71-46fa-b46f-7c0d5963c02b" returned: 0 in 0.288s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c5df02d6-7650-4d75-8239-12747811a329 tempest-VolumesDeleteCascade-1318752930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.697s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:57:53 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-c5df02d6-7650-4d75-8239-12747811a329 tempest-VolumesDeleteCascade-1318752930 None] Create snapshot completed successfully Sep 04 17:57:53 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] Acquiring lock "cinder-4aed2bf2-c689-4a62-aa88-d38295c05bc4-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:57:53 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] Lock "cinder-4aed2bf2-c689-4a62-aa88-d38295c05bc4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:57:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] Performing cascade delete. {{(pid=87314) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 04 17:57:53 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] Acquiring lock "cinder-978deed6-ef71-46fa-b46f-7c0d5963c02b-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:57:53 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] Lock "cinder-978deed6-ef71-46fa-b46f-7c0d5963c02b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:57:53 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] Acquiring lock "cinder-quobyte-4aed2bf2-c689-4a62-aa88-d38295c05bc4" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:57:53 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] Lock "cinder-quobyte-4aed2bf2-c689-4a62-aa88-d38295c05bc4" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:57:53 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] Acquiring lock "cinder-quobyte-978deed6-ef71-46fa-b46f-7c0d5963c02b" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:57:53 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] Lock "cinder-quobyte-978deed6-ef71-46fa-b46f-7c0d5963c02b" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:57:53 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] Deleting offline snapshot 978deed6-ef71-46fa-b46f-7c0d5963c02b of volume 4aed2bf2-c689-4a62-aa88-d38295c05bc4 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 17:57:53 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] snapshot_file for this snap is: volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4.978deed6-ef71-46fa-b46f-7c0d5963c02b {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 17:57:53 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed164e2-5c4a-4a26-9f2b-2f9ff2076a88]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:57:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4.978deed6-ef71-46fa-b46f-7c0d5963c02b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:54 devstack sudo[98161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4.978deed6-ef71-46fa-b46f-7c0d5963c02b Sep 04 17:57:54 devstack sudo[98161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:54 devstack sudo[98161]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4.978deed6-ef71-46fa-b46f-7c0d5963c02b" returned: 0 in 0.404s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:54 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 17:57:54 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[c123afe5-18a0-4d0d-8203-e7942f481fa5]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:57:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4.a4c037d5-e6be-4a03-96d3-58ff9d373da0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:54 devstack sudo[98166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4.a4c037d5-e6be-4a03-96d3-58ff9d373da0 Sep 04 17:57:54 devstack sudo[98166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:54 devstack sudo[98166]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4.a4c037d5-e6be-4a03-96d3-58ff9d373da0" returned: 0 in 0.388s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:54 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 17:57:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4.978deed6-ef71-46fa-b46f-7c0d5963c02b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:54 devstack sudo[98171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4.978deed6-ef71-46fa-b46f-7c0d5963c02b Sep 04 17:57:54 devstack sudo[98171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:55 devstack sudo[98171]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4.978deed6-ef71-46fa-b46f-7c0d5963c02b" returned: 0 in 0.408s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4.978deed6-ef71-46fa-b46f-7c0d5963c02b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:55 devstack sudo[98177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4.978deed6-ef71-46fa-b46f-7c0d5963c02b Sep 04 17:57:55 devstack sudo[98177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:55 devstack sudo[98177]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4.978deed6-ef71-46fa-b46f-7c0d5963c02b" returned: 0 in 0.277s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:55 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] Lock "cinder-quobyte-978deed6-ef71-46fa-b46f-7c0d5963c02b" released by "_delete_snapshot" :: held 1.596s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:57:55 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] Lock "cinder-quobyte-4aed2bf2-c689-4a62-aa88-d38295c05bc4" released by "delete_snapshot" :: held 1.625s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:57:55 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] Created reservations ['d5286409-53c4-4954-8969-1a0bc039af27', 'b9c5adb6-dfc5-470d-bf6b-1238d719f534', '43f7d62a-8fa9-409b-8ad7-37f5bf6c9ffa', '6dc9c54e-b0d0-4de2-9a92-056dc704b3af'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:57:55 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] Delete snapshot completed successfully. Sep 04 17:57:55 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] Lock "cinder-978deed6-ef71-46fa-b46f-7c0d5963c02b-delete_snapshot" released by "delete_snapshot" :: held 1.814s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:57:55 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] Acquiring lock "cinder-a4c037d5-e6be-4a03-96d3-58ff9d373da0-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:57:55 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] Lock "cinder-a4c037d5-e6be-4a03-96d3-58ff9d373da0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:57:55 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] Acquiring lock "cinder-quobyte-4aed2bf2-c689-4a62-aa88-d38295c05bc4" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:57:55 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] Lock "cinder-quobyte-4aed2bf2-c689-4a62-aa88-d38295c05bc4" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:57:55 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] Acquiring lock "cinder-quobyte-a4c037d5-e6be-4a03-96d3-58ff9d373da0" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:57:55 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] Lock "cinder-quobyte-a4c037d5-e6be-4a03-96d3-58ff9d373da0" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:57:55 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] Deleting offline snapshot a4c037d5-e6be-4a03-96d3-58ff9d373da0 of volume 4aed2bf2-c689-4a62-aa88-d38295c05bc4 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 17:57:55 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] snapshot_file for this snap is: volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4.a4c037d5-e6be-4a03-96d3-58ff9d373da0 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 17:57:55 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c71337-dbc7-4ca6-9b06-eef7a06ae756]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:57:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4.a4c037d5-e6be-4a03-96d3-58ff9d373da0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:55 devstack sudo[98180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4.a4c037d5-e6be-4a03-96d3-58ff9d373da0 Sep 04 17:57:55 devstack sudo[98180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:56 devstack sudo[98180]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4.a4c037d5-e6be-4a03-96d3-58ff9d373da0" returned: 0 in 0.415s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:56 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 17:57:56 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[9beb114d-8d6c-4112-a76d-be5fc20f1751]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:57:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:56 devstack sudo[98186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4 Sep 04 17:57:56 devstack sudo[98186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:56 devstack sudo[98186]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4" returned: 0 in 0.391s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4.a4c037d5-e6be-4a03-96d3-58ff9d373da0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:56 devstack sudo[98191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4.a4c037d5-e6be-4a03-96d3-58ff9d373da0 Sep 04 17:57:56 devstack sudo[98191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:56 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-2ffb8988-079a-4dcc-872b-80a2bf2ff4b8 tempest-GroupsV314Test-889148083 None] Group tempest-GroupsV314Test-Group-382175132: creating Sep 04 17:57:56 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-2ffb8988-079a-4dcc-872b-80a2bf2ff4b8 tempest-GroupsV314Test-889148083 None] Group tempest-GroupsV314Test-Group-382175132: created successfully Sep 04 17:57:56 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-2ffb8988-079a-4dcc-872b-80a2bf2ff4b8 tempest-GroupsV314Test-889148083 None] Create group completed successfully. Sep 04 17:57:57 devstack sudo[98191]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4.a4c037d5-e6be-4a03-96d3-58ff9d373da0" returned: 0 in 0.367s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4.a4c037d5-e6be-4a03-96d3-58ff9d373da0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:57 devstack sudo[98197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4.a4c037d5-e6be-4a03-96d3-58ff9d373da0 Sep 04 17:57:57 devstack sudo[98197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:57 devstack sudo[98197]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4.a4c037d5-e6be-4a03-96d3-58ff9d373da0" returned: 0 in 0.266s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:57 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] Lock "cinder-quobyte-a4c037d5-e6be-4a03-96d3-58ff9d373da0" released by "_delete_snapshot" :: held 1.534s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:57:57 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] Lock "cinder-quobyte-4aed2bf2-c689-4a62-aa88-d38295c05bc4" released by "delete_snapshot" :: held 1.558s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:57:57 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] Created reservations ['a41cb765-f3af-4769-bc07-83c2124b8b98', 'f17ca20c-4dc2-4998-9134-4bbd7e31d6ff', 'a8fa4ee4-9438-4a14-b20d-491aee772dd3', '44cba717-c874-400f-a8ef-41cfb0ab20a5'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:57:57 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] Delete snapshot completed successfully. Sep 04 17:57:57 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] Lock "cinder-a4c037d5-e6be-4a03-96d3-58ff9d373da0-delete_snapshot" released by "delete_snapshot" :: held 1.716s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:57:57 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] Snapshots deleted, issuing volume delete {{(pid=87314) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 04 17:57:57 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] Acquiring lock "cinder-quobyte-4aed2bf2-c689-4a62-aa88-d38295c05bc4" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:57:57 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] Lock "cinder-quobyte-4aed2bf2-c689-4a62-aa88-d38295c05bc4" acquired by "delete_volume" :: waited 0.019s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:57:57 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5d5eaa-71c6-41da-9269-3bd681998fb8]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:57:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:57 devstack sudo[98200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4 Sep 04 17:57:57 devstack sudo[98200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:57 devstack sudo[98200]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4" returned: 0 in 0.371s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:57 devstack sudo[98205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4 Sep 04 17:57:57 devstack sudo[98205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:58 devstack sudo[98205]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4aed2bf2-c689-4a62-aa88-d38295c05bc4" returned: 0 in 0.286s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:58 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] Lock "cinder-quobyte-4aed2bf2-c689-4a62-aa88-d38295c05bc4" released by "delete_volume" :: held 0.729s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:57:58 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] Created reservations ['3820de6a-33e5-416c-bccf-88909b4661a9', '5a5dd533-9a09-4e9b-9447-6fa44201cd63', '660a515a-f8f4-4f0b-8fed-dc0f3b9ac6af', 'e922d3b4-9ad3-4215-adca-f90ed2650441'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:57:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:57:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:57:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:57:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:57:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:57:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:58 devstack sudo[98208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:57:58 devstack sudo[98208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:58 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-55e57fb8-7697-43df-b4e4-eb891a044c6b tempest-GroupsV314Test-889148083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:57:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-55e57fb8-7697-43df-b4e4-eb891a044c6b tempest-GroupsV314Test-889148083 None] Flow 'volume_create_manager' (c64530a8-e487-4109-b566-e60e9f95b59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:57:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-55e57fb8-7697-43df-b4e4-eb891a044c6b tempest-GroupsV314Test-889148083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9001ab2-9437-43ab-83f8-8774ef888e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:57:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-55e57fb8-7697-43df-b4e4-eb891a044c6b tempest-GroupsV314Test-889148083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9001ab2-9437-43ab-83f8-8774ef888e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1869886983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=020f287e-44d4-4059-994b-e1b06a4e662c,host='devstack@QuobyteHD#QuobyteHD',id=72c3553c-4606-42cb-b0cd-bc45f69f81bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='336bf0ff2cb1455eadeb004b88155798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:57:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:57:59Z,use_quota=True,user_id='65de712c6d9949df950a139aad525d4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd716ea9-ba0f-4ea5-b2c6-b7bf08988605),volume_type_id=dd716ea9-ba0f-4ea5-b2c6-b7bf08988605)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:57:58 devstack sudo[98208]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-55e57fb8-7697-43df-b4e4-eb891a044c6b tempest-GroupsV314Test-889148083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1923e487-327c-4fe0-9dc0-eebeaa1c5be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:57:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-55e57fb8-7697-43df-b4e4-eb891a044c6b tempest-GroupsV314Test-889148083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1923e487-327c-4fe0-9dc0-eebeaa1c5be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:57:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-55e57fb8-7697-43df-b4e4-eb891a044c6b tempest-GroupsV314Test-889148083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d003e15-0b93-4246-8b42-8d5bddf5a034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:57:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-55e57fb8-7697-43df-b4e4-eb891a044c6b tempest-GroupsV314Test-889148083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d003e15-0b93-4246-8b42-8d5bddf5a034) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72c3553c-4606-42cb-b0cd-bc45f69f81bb', 'volume_name': 'volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:57:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-55e57fb8-7697-43df-b4e4-eb891a044c6b tempest-GroupsV314Test-889148083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4205157-29f3-4840-ba02-77f6ea5d5810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:57:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-55e57fb8-7697-43df-b4e4-eb891a044c6b tempest-GroupsV314Test-889148083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4205157-29f3-4840-ba02-77f6ea5d5810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:57:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-55e57fb8-7697-43df-b4e4-eb891a044c6b tempest-GroupsV314Test-889148083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0878f97-4dae-4a30-9607-99e526667014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:57:58 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-55e57fb8-7697-43df-b4e4-eb891a044c6b tempest-GroupsV314Test-889148083 None] Volume 72c3553c-4606-42cb-b0cd-bc45f69f81bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb', 'volume_size': 1} Sep 04 17:57:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-55e57fb8-7697-43df-b4e4-eb891a044c6b tempest-GroupsV314Test-889148083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:57:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-55e57fb8-7697-43df-b4e4-eb891a044c6b tempest-GroupsV314Test-889148083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:57:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-55e57fb8-7697-43df-b4e4-eb891a044c6b tempest-GroupsV314Test-889148083 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=020f287e-44d4-4059-994b-e1b06a4e662c,created_at=2026-09-04T15:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1869886983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=020f287e-44d4-4059-994b-e1b06a4e662c,host='devstack@QuobyteHD#QuobyteHD',id=72c3553c-4606-42cb-b0cd-bc45f69f81bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='336bf0ff2cb1455eadeb004b88155798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:57:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:57:59Z,use_quota=True,user_id='65de712c6d9949df950a139aad525d4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd716ea9-ba0f-4ea5-b2c6-b7bf08988605),volume_type_id=dd716ea9-ba0f-4ea5-b2c6-b7bf08988605)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:57:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-55e57fb8-7697-43df-b4e4-eb891a044c6b tempest-GroupsV314Test-889148083 None] Creating volume 72c3553c-4606-42cb-b0cd-bc45f69f81bb {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:57:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-55e57fb8-7697-43df-b4e4-eb891a044c6b tempest-GroupsV314Test-889148083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:57:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-55e57fb8-7697-43df-b4e4-eb891a044c6b tempest-GroupsV314Test-889148083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:57:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-55e57fb8-7697-43df-b4e4-eb891a044c6b tempest-GroupsV314Test-889148083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:57:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-55e57fb8-7697-43df-b4e4-eb891a044c6b tempest-GroupsV314Test-889148083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:57:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-55e57fb8-7697-43df-b4e4-eb891a044c6b tempest-GroupsV314Test-889148083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:57:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-55e57fb8-7697-43df-b4e4-eb891a044c6b tempest-GroupsV314Test-889148083 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:57:58 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-55e57fb8-7697-43df-b4e4-eb891a044c6b tempest-GroupsV314Test-889148083 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:57:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-55e57fb8-7697-43df-b4e4-eb891a044c6b tempest-GroupsV314Test-889148083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.395s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:58 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:57:58 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] Deleted volume successfully. Sep 04 17:57:58 devstack sudo[98211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb 1073741824 Sep 04 17:57:58 devstack sudo[98211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:58 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-109a954d-05ab-411d-b855-4de4e4177f69 tempest-VolumesDeleteCascade-1318752930 None] Lock "cinder-4aed2bf2-c689-4a62-aa88-d38295c05bc4-delete_volume" released by "delete_volume" :: held 4.939s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:57:59 devstack sudo[98211]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-55e57fb8-7697-43df-b4e4-eb891a044c6b tempest-GroupsV314Test-889148083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb 1073741824" returned: 0 in 0.477s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-55e57fb8-7697-43df-b4e4-eb891a044c6b tempest-GroupsV314Test-889148083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:57:59 devstack sudo[98216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb Sep 04 17:57:59 devstack sudo[98216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:57:59 devstack sudo[98216]: pam_unix(sudo:session): session closed for user root Sep 04 17:57:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-55e57fb8-7697-43df-b4e4-eb891a044c6b tempest-GroupsV314Test-889148083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb" returned: 0 in 0.318s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:57:59 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-55e57fb8-7697-43df-b4e4-eb891a044c6b tempest-GroupsV314Test-889148083 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:57:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-55e57fb8-7697-43df-b4e4-eb891a044c6b tempest-GroupsV314Test-889148083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:57:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-55e57fb8-7697-43df-b4e4-eb891a044c6b tempest-GroupsV314Test-889148083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0878f97-4dae-4a30-9607-99e526667014) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:57:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-55e57fb8-7697-43df-b4e4-eb891a044c6b tempest-GroupsV314Test-889148083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a1de3b7-3ceb-4a8f-8988-01f8a8a84bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:57:59 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-55e57fb8-7697-43df-b4e4-eb891a044c6b tempest-GroupsV314Test-889148083 None] Volume volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb (72c3553c-4606-42cb-b0cd-bc45f69f81bb): created successfully Sep 04 17:57:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-55e57fb8-7697-43df-b4e4-eb891a044c6b tempest-GroupsV314Test-889148083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a1de3b7-3ceb-4a8f-8988-01f8a8a84bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:57:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-55e57fb8-7697-43df-b4e4-eb891a044c6b tempest-GroupsV314Test-889148083 None] Flow 'volume_create_manager' (c64530a8-e487-4109-b566-e60e9f95b59b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:57:59 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-55e57fb8-7697-43df-b4e4-eb891a044c6b tempest-GroupsV314Test-889148083 None] Created volume successfully. Sep 04 17:58:00 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-65a48014-e0a1-4cce-b97a-d9161b3b7e6c tempest-VolumesDeleteCascade-1318752930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:58:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-65a48014-e0a1-4cce-b97a-d9161b3b7e6c tempest-VolumesDeleteCascade-1318752930 None] Flow 'volume_create_manager' (d53daa0a-5c53-43f9-8331-f790852737dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:58:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-65a48014-e0a1-4cce-b97a-d9161b3b7e6c tempest-VolumesDeleteCascade-1318752930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41c0ace2-f71d-4e9b-81c3-8631134b1447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-65a48014-e0a1-4cce-b97a-d9161b3b7e6c tempest-VolumesDeleteCascade-1318752930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41c0ace2-f71d-4e9b-81c3-8631134b1447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-615178122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f32aa6f2-6fae-45d8-9c78-f28599e8c34f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6144acfe25745c1b312316309354a28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:58:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:58:00Z,use_quota=True,user_id='926bd8f8538b48b2ba82592baeee78fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-65a48014-e0a1-4cce-b97a-d9161b3b7e6c tempest-VolumesDeleteCascade-1318752930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (528876e5-0604-4dfc-9568-e244fd1e3f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-65a48014-e0a1-4cce-b97a-d9161b3b7e6c tempest-VolumesDeleteCascade-1318752930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (528876e5-0604-4dfc-9568-e244fd1e3f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-65a48014-e0a1-4cce-b97a-d9161b3b7e6c tempest-VolumesDeleteCascade-1318752930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (966c9f07-4cc7-4ec0-b6de-325ec72b815f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-65a48014-e0a1-4cce-b97a-d9161b3b7e6c tempest-VolumesDeleteCascade-1318752930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (966c9f07-4cc7-4ec0-b6de-325ec72b815f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f32aa6f2-6fae-45d8-9c78-f28599e8c34f', 'volume_name': 'volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-65a48014-e0a1-4cce-b97a-d9161b3b7e6c tempest-VolumesDeleteCascade-1318752930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10ef12db-8411-4bf0-bbe4-7d3915f645fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-65a48014-e0a1-4cce-b97a-d9161b3b7e6c tempest-VolumesDeleteCascade-1318752930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10ef12db-8411-4bf0-bbe4-7d3915f645fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-65a48014-e0a1-4cce-b97a-d9161b3b7e6c tempest-VolumesDeleteCascade-1318752930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35085f9f-381b-413e-80e0-72943bd1e945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:00 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-65a48014-e0a1-4cce-b97a-d9161b3b7e6c tempest-VolumesDeleteCascade-1318752930 None] Volume f32aa6f2-6fae-45d8-9c78-f28599e8c34f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f', 'volume_size': 1} Sep 04 17:58:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-65a48014-e0a1-4cce-b97a-d9161b3b7e6c tempest-VolumesDeleteCascade-1318752930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:58:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-65a48014-e0a1-4cce-b97a-d9161b3b7e6c tempest-VolumesDeleteCascade-1318752930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:58:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-65a48014-e0a1-4cce-b97a-d9161b3b7e6c tempest-VolumesDeleteCascade-1318752930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-615178122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f32aa6f2-6fae-45d8-9c78-f28599e8c34f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6144acfe25745c1b312316309354a28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:58:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:58:00Z,use_quota=True,user_id='926bd8f8538b48b2ba82592baeee78fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:58:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-65a48014-e0a1-4cce-b97a-d9161b3b7e6c tempest-VolumesDeleteCascade-1318752930 None] Creating volume f32aa6f2-6fae-45d8-9c78-f28599e8c34f {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:58:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-65a48014-e0a1-4cce-b97a-d9161b3b7e6c tempest-VolumesDeleteCascade-1318752930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:58:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-65a48014-e0a1-4cce-b97a-d9161b3b7e6c tempest-VolumesDeleteCascade-1318752930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:58:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-65a48014-e0a1-4cce-b97a-d9161b3b7e6c tempest-VolumesDeleteCascade-1318752930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:58:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-65a48014-e0a1-4cce-b97a-d9161b3b7e6c tempest-VolumesDeleteCascade-1318752930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:58:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-65a48014-e0a1-4cce-b97a-d9161b3b7e6c tempest-VolumesDeleteCascade-1318752930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:58:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-65a48014-e0a1-4cce-b97a-d9161b3b7e6c tempest-VolumesDeleteCascade-1318752930 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:58:00 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-65a48014-e0a1-4cce-b97a-d9161b3b7e6c tempest-VolumesDeleteCascade-1318752930 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:58:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-65a48014-e0a1-4cce-b97a-d9161b3b7e6c tempest-VolumesDeleteCascade-1318752930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:00 devstack sudo[98226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f 1073741824 Sep 04 17:58:00 devstack sudo[98226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d439217e-dbe7-4ec5-a72f-dd7862ff3eee tempest-GroupsV314Test-889148083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:58:00 devstack sudo[98226]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-65a48014-e0a1-4cce-b97a-d9161b3b7e6c tempest-VolumesDeleteCascade-1318752930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f 1073741824" returned: 0 in 0.532s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-65a48014-e0a1-4cce-b97a-d9161b3b7e6c tempest-VolumesDeleteCascade-1318752930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:00 devstack sudo[98233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f Sep 04 17:58:00 devstack sudo[98233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:01 devstack sudo[98233]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-65a48014-e0a1-4cce-b97a-d9161b3b7e6c tempest-VolumesDeleteCascade-1318752930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f" returned: 0 in 0.267s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:01 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-65a48014-e0a1-4cce-b97a-d9161b3b7e6c tempest-VolumesDeleteCascade-1318752930 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:58:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-65a48014-e0a1-4cce-b97a-d9161b3b7e6c tempest-VolumesDeleteCascade-1318752930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:58:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d439217e-dbe7-4ec5-a72f-dd7862ff3eee tempest-GroupsV314Test-889148083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.547s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:58:01 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-d439217e-dbe7-4ec5-a72f-dd7862ff3eee tempest-GroupsV314Test-889148083 None] Cloning volume 72c3553c-4606-42cb-b0cd-bc45f69f81bb to volume 349dfe00-8010-4f51-ada9-1a85708a3c37 Sep 04 17:58:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-65a48014-e0a1-4cce-b97a-d9161b3b7e6c tempest-VolumesDeleteCascade-1318752930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35085f9f-381b-413e-80e0-72943bd1e945) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-65a48014-e0a1-4cce-b97a-d9161b3b7e6c tempest-VolumesDeleteCascade-1318752930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c661514-3a14-476a-932f-9c3839a837a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:01 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-65a48014-e0a1-4cce-b97a-d9161b3b7e6c tempest-VolumesDeleteCascade-1318752930 None] Volume volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f (f32aa6f2-6fae-45d8-9c78-f28599e8c34f): created successfully Sep 04 17:58:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-65a48014-e0a1-4cce-b97a-d9161b3b7e6c tempest-VolumesDeleteCascade-1318752930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c661514-3a14-476a-932f-9c3839a837a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-65a48014-e0a1-4cce-b97a-d9161b3b7e6c tempest-VolumesDeleteCascade-1318752930 None] Flow 'volume_create_manager' (d53daa0a-5c53-43f9-8331-f790852737dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:58:01 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-65a48014-e0a1-4cce-b97a-d9161b3b7e6c tempest-VolumesDeleteCascade-1318752930 None] Created volume successfully. Sep 04 17:58:01 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-d439217e-dbe7-4ec5-a72f-dd7862ff3eee tempest-GroupsV314Test-889148083 None] Creating offline snapshot 62031623-bd1c-40a0-acfc-e7f2d2f60b1f of volume 72c3553c-4606-42cb-b0cd-bc45f69f81bb {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 17:58:01 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd668d4-37b2-4c21-b23d-36f097d9f33a]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:58:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d439217e-dbe7-4ec5-a72f-dd7862ff3eee tempest-GroupsV314Test-889148083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:01 devstack sudo[98236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb Sep 04 17:58:01 devstack sudo[98236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:01 devstack sudo[98236]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d439217e-dbe7-4ec5-a72f-dd7862ff3eee tempest-GroupsV314Test-889148083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb" returned: 0 in 0.383s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d439217e-dbe7-4ec5-a72f-dd7862ff3eee tempest-GroupsV314Test-889148083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb.62031623-bd1c-40a0-acfc-e7f2d2f60b1f 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:01 devstack sudo[98241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb.62031623-bd1c-40a0-acfc-e7f2d2f60b1f 1G Sep 04 17:58:01 devstack sudo[98241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:01 devstack sudo[98241]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d439217e-dbe7-4ec5-a72f-dd7862ff3eee tempest-GroupsV314Test-889148083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb.62031623-bd1c-40a0-acfc-e7f2d2f60b1f 1G" returned: 0 in 0.418s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d439217e-dbe7-4ec5-a72f-dd7862ff3eee tempest-GroupsV314Test-889148083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb.62031623-bd1c-40a0-acfc-e7f2d2f60b1f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:02 devstack sudo[98246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb.62031623-bd1c-40a0-acfc-e7f2d2f60b1f Sep 04 17:58:02 devstack sudo[98246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c435f272-990c-48c1-abd4-94c7c0a61c51 tempest-VolumesDeleteCascade-1318752930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:58:02 devstack sudo[98246]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d439217e-dbe7-4ec5-a72f-dd7862ff3eee tempest-GroupsV314Test-889148083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb.62031623-bd1c-40a0-acfc-e7f2d2f60b1f" returned: 0 in 0.354s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:02 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-d439217e-dbe7-4ec5-a72f-dd7862ff3eee tempest-GroupsV314Test-889148083 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb.62031623-bd1c-40a0-acfc-e7f2d2f60b1f is being set with open permissions: ugo+rw: NotImplementedError Sep 04 17:58:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d439217e-dbe7-4ec5-a72f-dd7862ff3eee tempest-GroupsV314Test-889148083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb.62031623-bd1c-40a0-acfc-e7f2d2f60b1f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:02 devstack sudo[98252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb.62031623-bd1c-40a0-acfc-e7f2d2f60b1f Sep 04 17:58:02 devstack sudo[98252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:02 devstack sudo[98252]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d439217e-dbe7-4ec5-a72f-dd7862ff3eee tempest-GroupsV314Test-889148083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb.62031623-bd1c-40a0-acfc-e7f2d2f60b1f" returned: 0 in 0.257s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d439217e-dbe7-4ec5-a72f-dd7862ff3eee tempest-GroupsV314Test-889148083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:02 devstack sudo[98257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb.info Sep 04 17:58:02 devstack sudo[98257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:02 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-2b702e05-96c5-43db-a37f-754bdd142d66 tempest-GroupsTest-1928760915 None] Group tempest-Group1-1621438981: creating Sep 04 17:58:02 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-2b702e05-96c5-43db-a37f-754bdd142d66 tempest-GroupsTest-1928760915 None] Group tempest-Group1-1621438981: created successfully Sep 04 17:58:02 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-2b702e05-96c5-43db-a37f-754bdd142d66 tempest-GroupsTest-1928760915 None] Create group completed successfully. Sep 04 17:58:02 devstack sudo[98257]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d439217e-dbe7-4ec5-a72f-dd7862ff3eee tempest-GroupsV314Test-889148083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb.info" returned: 0 in 0.296s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:02 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-d439217e-dbe7-4ec5-a72f-dd7862ff3eee tempest-GroupsV314Test-889148083 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb.info is being set with open permissions: ugo+rw: NotImplementedError Sep 04 17:58:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d439217e-dbe7-4ec5-a72f-dd7862ff3eee tempest-GroupsV314Test-889148083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:02 devstack sudo[98260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb.info Sep 04 17:58:02 devstack sudo[98260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:03 devstack sudo[98260]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d439217e-dbe7-4ec5-a72f-dd7862ff3eee tempest-GroupsV314Test-889148083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb.info" returned: 0 in 0.253s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:03 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d439217e-dbe7-4ec5-a72f-dd7862ff3eee tempest-GroupsV314Test-889148083 None] Acquiring lock "cinder-quobyte-349dfe00-8010-4f51-ada9-1a85708a3c37" by "_copy_volume_from_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:58:03 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d439217e-dbe7-4ec5-a72f-dd7862ff3eee tempest-GroupsV314Test-889148083 None] Lock "cinder-quobyte-349dfe00-8010-4f51-ada9-1a85708a3c37" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:58:03 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d439217e-dbe7-4ec5-a72f-dd7862ff3eee tempest-GroupsV314Test-889148083 None] snapshot: 62031623-bd1c-40a0-acfc-e7f2d2f60b1f, volume: 349dfe00-8010-4f51-ada9-1a85708a3c37, {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 04 17:58:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d439217e-dbe7-4ec5-a72f-dd7862ff3eee tempest-GroupsV314Test-889148083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:58:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d439217e-dbe7-4ec5-a72f-dd7862ff3eee tempest-GroupsV314Test-889148083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:58:03 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d439217e-dbe7-4ec5-a72f-dd7862ff3eee tempest-GroupsV314Test-889148083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:58:03 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d439217e-dbe7-4ec5-a72f-dd7862ff3eee tempest-GroupsV314Test-889148083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:58:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d439217e-dbe7-4ec5-a72f-dd7862ff3eee tempest-GroupsV314Test-889148083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:58:03 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[21256a39-72d6-4d10-a5fb-64cd1c8e75f0]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:58:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d439217e-dbe7-4ec5-a72f-dd7862ff3eee tempest-GroupsV314Test-889148083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb.62031623-bd1c-40a0-acfc-e7f2d2f60b1f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:03 devstack sudo[98263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb.62031623-bd1c-40a0-acfc-e7f2d2f60b1f Sep 04 17:58:03 devstack sudo[98263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:03 devstack sudo[98263]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d439217e-dbe7-4ec5-a72f-dd7862ff3eee tempest-GroupsV314Test-889148083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb.62031623-bd1c-40a0-acfc-e7f2d2f60b1f" returned: 0 in 0.351s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:03 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-d439217e-dbe7-4ec5-a72f-dd7862ff3eee tempest-GroupsV314Test-889148083 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 17:58:03 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ba914e-dec6-48fb-ab5c-571413936a76]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:58:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d439217e-dbe7-4ec5-a72f-dd7862ff3eee tempest-GroupsV314Test-889148083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:03 devstack sudo[98269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb Sep 04 17:58:03 devstack sudo[98269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:03 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-fe34b10f-723a-4270-afa1-3c6bdd6dc16f tempest-GroupsTest-1928760915 None] Group tempest-Group2-644242400: creating Sep 04 17:58:03 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-fe34b10f-723a-4270-afa1-3c6bdd6dc16f tempest-GroupsTest-1928760915 None] Group tempest-Group2-644242400: created successfully Sep 04 17:58:03 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-fe34b10f-723a-4270-afa1-3c6bdd6dc16f tempest-GroupsTest-1928760915 None] Create group completed successfully. Sep 04 17:58:03 devstack sudo[98269]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d439217e-dbe7-4ec5-a72f-dd7862ff3eee tempest-GroupsV314Test-889148083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb" returned: 0 in 0.379s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:04 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d439217e-dbe7-4ec5-a72f-dd7862ff3eee tempest-GroupsV314Test-889148083 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 04 17:58:04 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d439217e-dbe7-4ec5-a72f-dd7862ff3eee tempest-GroupsV314Test-889148083 None] Creating direct copy from snapshot {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 04 17:58:04 devstack cinder-volume[87314]: DEBUG cinder.utils [None req-d439217e-dbe7-4ec5-a72f-dd7862ff3eee tempest-GroupsV314Test-889148083 None] Path /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-349dfe00-8010-4f51-ada9-1a85708a3c37 not found in is_blk_device check {{(pid=87314) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 04 17:58:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d439217e-dbe7-4ec5-a72f-dd7862ff3eee tempest-GroupsV314Test-889148083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-349dfe00-8010-4f51-ada9-1a85708a3c37 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:04 devstack sudo[98274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-349dfe00-8010-4f51-ada9-1a85708a3c37 Sep 04 17:58:04 devstack sudo[98274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:06 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e3f0f32-120e-4f95-b164-b5a85cd98a05 tempest-GroupsTest-1928760915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:58:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8e3f0f32-120e-4f95-b164-b5a85cd98a05 tempest-GroupsTest-1928760915 None] Flow 'volume_create_manager' (7cd21e57-5361-4f63-8335-cc7224201f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:58:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8e3f0f32-120e-4f95-b164-b5a85cd98a05 tempest-GroupsTest-1928760915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d9db74b-e66e-462a-b35f-191be0885f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8e3f0f32-120e-4f95-b164-b5a85cd98a05 tempest-GroupsTest-1928760915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d9db74b-e66e-462a-b35f-191be0885f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:58:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-526406415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=35da4f86-cc6a-4f69-9b28-fde369830690,host='devstack@QuobyteHD#QuobyteHD',id=765bf260-940e-4b30-abe7-7902342e91b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e5bfb57409d46a890169dc775a95c6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:58:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:58:06Z,use_quota=True,user_id='6907e365096e42718a8750e53e710ca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe152f14-38fc-4d00-8b20-fa9a0c083166),volume_type_id=fe152f14-38fc-4d00-8b20-fa9a0c083166)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8e3f0f32-120e-4f95-b164-b5a85cd98a05 tempest-GroupsTest-1928760915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba301d0f-fa92-43cf-b045-b4a7c8bdfda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8e3f0f32-120e-4f95-b164-b5a85cd98a05 tempest-GroupsTest-1928760915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba301d0f-fa92-43cf-b045-b4a7c8bdfda4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8e3f0f32-120e-4f95-b164-b5a85cd98a05 tempest-GroupsTest-1928760915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fba8f02-f0cf-48a0-99e7-389a80bbccee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8e3f0f32-120e-4f95-b164-b5a85cd98a05 tempest-GroupsTest-1928760915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fba8f02-f0cf-48a0-99e7-389a80bbccee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '765bf260-940e-4b30-abe7-7902342e91b3', 'volume_name': 'volume-765bf260-940e-4b30-abe7-7902342e91b3', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8e3f0f32-120e-4f95-b164-b5a85cd98a05 tempest-GroupsTest-1928760915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d195525a-1ed4-4f23-b8fc-092e23084e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8e3f0f32-120e-4f95-b164-b5a85cd98a05 tempest-GroupsTest-1928760915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d195525a-1ed4-4f23-b8fc-092e23084e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8e3f0f32-120e-4f95-b164-b5a85cd98a05 tempest-GroupsTest-1928760915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9a3d4d4-be1e-4e8b-acb4-5a38d2bc74bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:06 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-8e3f0f32-120e-4f95-b164-b5a85cd98a05 tempest-GroupsTest-1928760915 None] Volume 765bf260-940e-4b30-abe7-7902342e91b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-765bf260-940e-4b30-abe7-7902342e91b3', 'volume_size': 1} Sep 04 17:58:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8e3f0f32-120e-4f95-b164-b5a85cd98a05 tempest-GroupsTest-1928760915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:58:08 devstack sudo[98274]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d439217e-dbe7-4ec5-a72f-dd7862ff3eee tempest-GroupsV314Test-889148083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-349dfe00-8010-4f51-ada9-1a85708a3c37" returned: 0 in 4.528s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:08 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-d439217e-dbe7-4ec5-a72f-dd7862ff3eee tempest-GroupsV314Test-889148083 None] Image conversion details: src /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb, size 1024.00 MB, duration 4.53 sec, destination /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-349dfe00-8010-4f51-ada9-1a85708a3c37 {{(pid=87314) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 17:58:08 devstack cinder-volume[87314]: INFO cinder.image.image_utils [None req-d439217e-dbe7-4ec5-a72f-dd7862ff3eee tempest-GroupsV314Test-889148083 None] Converted 1024.00 MB image at 226.10 MB/s Sep 04 17:58:08 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-d439217e-dbe7-4ec5-a72f-dd7862ff3eee tempest-GroupsV314Test-889148083 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-349dfe00-8010-4f51-ada9-1a85708a3c37 is being set with open permissions: ugo+rw: NotImplementedError Sep 04 17:58:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d439217e-dbe7-4ec5-a72f-dd7862ff3eee tempest-GroupsV314Test-889148083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-349dfe00-8010-4f51-ada9-1a85708a3c37 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:08 devstack sudo[98289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-349dfe00-8010-4f51-ada9-1a85708a3c37 Sep 04 17:58:08 devstack sudo[98289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:08 devstack sudo[98289]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d439217e-dbe7-4ec5-a72f-dd7862ff3eee tempest-GroupsV314Test-889148083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-349dfe00-8010-4f51-ada9-1a85708a3c37" returned: 0 in 0.245s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:08 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d439217e-dbe7-4ec5-a72f-dd7862ff3eee tempest-GroupsV314Test-889148083 None] Lock "cinder-quobyte-349dfe00-8010-4f51-ada9-1a85708a3c37" released by "_copy_volume_from_snapshot" :: held 5.575s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:58:08 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d439217e-dbe7-4ec5-a72f-dd7862ff3eee tempest-GroupsV314Test-889148083 None] Acquiring lock "cinder-quobyte-62031623-bd1c-40a0-acfc-e7f2d2f60b1f" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:58:08 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d439217e-dbe7-4ec5-a72f-dd7862ff3eee tempest-GroupsV314Test-889148083 None] Lock "cinder-quobyte-62031623-bd1c-40a0-acfc-e7f2d2f60b1f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:58:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-d439217e-dbe7-4ec5-a72f-dd7862ff3eee tempest-GroupsV314Test-889148083 None] Deleting offline snapshot 62031623-bd1c-40a0-acfc-e7f2d2f60b1f of volume 72c3553c-4606-42cb-b0cd-bc45f69f81bb {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 17:58:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-d439217e-dbe7-4ec5-a72f-dd7862ff3eee tempest-GroupsV314Test-889148083 None] snapshot_file for this snap is: volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb.62031623-bd1c-40a0-acfc-e7f2d2f60b1f {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 17:58:08 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[8148517d-8503-413a-b2bc-693af1dc810e]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:58:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d439217e-dbe7-4ec5-a72f-dd7862ff3eee tempest-GroupsV314Test-889148083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb.62031623-bd1c-40a0-acfc-e7f2d2f60b1f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:08 devstack sudo[98292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb.62031623-bd1c-40a0-acfc-e7f2d2f60b1f Sep 04 17:58:08 devstack sudo[98292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:09 devstack sudo[98292]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d439217e-dbe7-4ec5-a72f-dd7862ff3eee tempest-GroupsV314Test-889148083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb.62031623-bd1c-40a0-acfc-e7f2d2f60b1f" returned: 0 in 0.339s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:09 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-d439217e-dbe7-4ec5-a72f-dd7862ff3eee tempest-GroupsV314Test-889148083 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 17:58:09 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[243a6160-67ae-469f-b19d-f0fc5735de08]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:58:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d439217e-dbe7-4ec5-a72f-dd7862ff3eee tempest-GroupsV314Test-889148083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:09 devstack sudo[98297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb Sep 04 17:58:09 devstack sudo[98297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:09 devstack sudo[98297]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d439217e-dbe7-4ec5-a72f-dd7862ff3eee tempest-GroupsV314Test-889148083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb" returned: 0 in 0.507s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d439217e-dbe7-4ec5-a72f-dd7862ff3eee tempest-GroupsV314Test-889148083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb.62031623-bd1c-40a0-acfc-e7f2d2f60b1f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:09 devstack sudo[98302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb.62031623-bd1c-40a0-acfc-e7f2d2f60b1f Sep 04 17:58:09 devstack sudo[98302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:10 devstack sudo[98302]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d439217e-dbe7-4ec5-a72f-dd7862ff3eee tempest-GroupsV314Test-889148083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb.62031623-bd1c-40a0-acfc-e7f2d2f60b1f" returned: 0 in 0.322s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d439217e-dbe7-4ec5-a72f-dd7862ff3eee tempest-GroupsV314Test-889148083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb.62031623-bd1c-40a0-acfc-e7f2d2f60b1f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:10 devstack sudo[98307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb.62031623-bd1c-40a0-acfc-e7f2d2f60b1f Sep 04 17:58:10 devstack sudo[98307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:10 devstack sudo[98307]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d439217e-dbe7-4ec5-a72f-dd7862ff3eee tempest-GroupsV314Test-889148083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb.62031623-bd1c-40a0-acfc-e7f2d2f60b1f" returned: 0 in 0.236s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:10 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d439217e-dbe7-4ec5-a72f-dd7862ff3eee tempest-GroupsV314Test-889148083 None] Lock "cinder-quobyte-62031623-bd1c-40a0-acfc-e7f2d2f60b1f" released by "_delete_snapshot" :: held 1.478s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:58:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d439217e-dbe7-4ec5-a72f-dd7862ff3eee tempest-GroupsV314Test-889148083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.216s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:58:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c435f272-990c-48c1-abd4-94c7c0a61c51 tempest-VolumesDeleteCascade-1318752930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.982s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:58:10 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-c435f272-990c-48c1-abd4-94c7c0a61c51 tempest-VolumesDeleteCascade-1318752930 None] Creating offline snapshot 95b266e1-bab7-408e-9ffa-c743a509d664 of volume f32aa6f2-6fae-45d8-9c78-f28599e8c34f {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 17:58:10 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[87fe3db1-015a-49bb-9457-bdcdc2a790ef]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:58:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c435f272-990c-48c1-abd4-94c7c0a61c51 tempest-VolumesDeleteCascade-1318752930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:10 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-d439217e-dbe7-4ec5-a72f-dd7862ff3eee tempest-GroupsV314Test-889148083 None] Create group from source-group-020f287e-44d4-4059-994b-e1b06a4e662c completed successfully. Sep 04 17:58:10 devstack sudo[98310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f Sep 04 17:58:10 devstack sudo[98310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:10 devstack sudo[98310]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c435f272-990c-48c1-abd4-94c7c0a61c51 tempest-VolumesDeleteCascade-1318752930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f" returned: 0 in 0.363s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c435f272-990c-48c1-abd4-94c7c0a61c51 tempest-VolumesDeleteCascade-1318752930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f.95b266e1-bab7-408e-9ffa-c743a509d664 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:10 devstack sudo[98315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f.95b266e1-bab7-408e-9ffa-c743a509d664 1G Sep 04 17:58:10 devstack sudo[98315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:10 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fd1f3972-108d-4830-9cb7-26554cbf30a5 tempest-GroupsV314Test-889148083 None] Acquiring lock "cinder-quobyte-349dfe00-8010-4f51-ada9-1a85708a3c37" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:58:10 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fd1f3972-108d-4830-9cb7-26554cbf30a5 tempest-GroupsV314Test-889148083 None] Lock "cinder-quobyte-349dfe00-8010-4f51-ada9-1a85708a3c37" acquired by "delete_volume" :: waited 0.018s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:58:10 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbfa0437-65ee-41f6-943a-3eea7b60aae1]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:58:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fd1f3972-108d-4830-9cb7-26554cbf30a5 tempest-GroupsV314Test-889148083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-349dfe00-8010-4f51-ada9-1a85708a3c37 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:11 devstack sudo[98321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-349dfe00-8010-4f51-ada9-1a85708a3c37 Sep 04 17:58:11 devstack sudo[98321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:11 devstack sudo[98315]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c435f272-990c-48c1-abd4-94c7c0a61c51 tempest-VolumesDeleteCascade-1318752930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f.95b266e1-bab7-408e-9ffa-c743a509d664 1G" returned: 0 in 0.415s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c435f272-990c-48c1-abd4-94c7c0a61c51 tempest-VolumesDeleteCascade-1318752930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f.95b266e1-bab7-408e-9ffa-c743a509d664 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:11 devstack sudo[98323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f.95b266e1-bab7-408e-9ffa-c743a509d664 Sep 04 17:58:11 devstack sudo[98323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:11 devstack sudo[98321]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fd1f3972-108d-4830-9cb7-26554cbf30a5 tempest-GroupsV314Test-889148083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-349dfe00-8010-4f51-ada9-1a85708a3c37" returned: 0 in 0.363s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fd1f3972-108d-4830-9cb7-26554cbf30a5 tempest-GroupsV314Test-889148083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-349dfe00-8010-4f51-ada9-1a85708a3c37 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:11 devstack sudo[98330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-349dfe00-8010-4f51-ada9-1a85708a3c37 Sep 04 17:58:11 devstack sudo[98330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:11 devstack sudo[98323]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c435f272-990c-48c1-abd4-94c7c0a61c51 tempest-VolumesDeleteCascade-1318752930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f.95b266e1-bab7-408e-9ffa-c743a509d664" returned: 0 in 0.297s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:11 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-c435f272-990c-48c1-abd4-94c7c0a61c51 tempest-VolumesDeleteCascade-1318752930 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f.95b266e1-bab7-408e-9ffa-c743a509d664 is being set with open permissions: ugo+rw Sep 04 17:58:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c435f272-990c-48c1-abd4-94c7c0a61c51 tempest-VolumesDeleteCascade-1318752930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f.95b266e1-bab7-408e-9ffa-c743a509d664 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:11 devstack sudo[98333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f.95b266e1-bab7-408e-9ffa-c743a509d664 Sep 04 17:58:11 devstack sudo[98333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:11 devstack sudo[98330]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fd1f3972-108d-4830-9cb7-26554cbf30a5 tempest-GroupsV314Test-889148083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-349dfe00-8010-4f51-ada9-1a85708a3c37" returned: 0 in 0.230s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:11 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fd1f3972-108d-4830-9cb7-26554cbf30a5 tempest-GroupsV314Test-889148083 None] Lock "cinder-quobyte-349dfe00-8010-4f51-ada9-1a85708a3c37" released by "delete_volume" :: held 0.633s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:58:11 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-fd1f3972-108d-4830-9cb7-26554cbf30a5 tempest-GroupsV314Test-889148083 None] Created reservations ['366cdbc8-51e2-4a29-abae-28c35132026d'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:58:11 devstack sudo[98333]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c435f272-990c-48c1-abd4-94c7c0a61c51 tempest-VolumesDeleteCascade-1318752930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f.95b266e1-bab7-408e-9ffa-c743a509d664" returned: 0 in 0.256s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:11 devstack cinder-volume[87314]: WARNING cinder.quota [None req-fd1f3972-108d-4830-9cb7-26554cbf30a5 tempest-GroupsV314Test-889148083 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-898317508 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-898317508, it is now deprecated. Please use the default quota class for default quota. Sep 04 17:58:11 devstack cinder-volume[87314]: WARNING cinder.quota [None req-fd1f3972-108d-4830-9cb7-26554cbf30a5 tempest-GroupsV314Test-889148083 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-898317508 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-898317508, it is now deprecated. Please use the default quota class for default quota. Sep 04 17:58:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c435f272-990c-48c1-abd4-94c7c0a61c51 tempest-VolumesDeleteCascade-1318752930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:11 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-fd1f3972-108d-4830-9cb7-26554cbf30a5 tempest-GroupsV314Test-889148083 None] Created reservations ['5702109b-963d-4d61-bfae-2d17442583a2', 'f016584a-4379-4dff-920a-9eab66c17340', 'f9e1c390-f205-4c76-8c23-81bffccca241', '0ac48ed0-c59b-46dd-a49c-01c6306da1b9'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:58:11 devstack sudo[98337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f.info Sep 04 17:58:11 devstack sudo[98337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fd1f3972-108d-4830-9cb7-26554cbf30a5 tempest-GroupsV314Test-889148083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:58:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fd1f3972-108d-4830-9cb7-26554cbf30a5 tempest-GroupsV314Test-889148083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:58:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-fd1f3972-108d-4830-9cb7-26554cbf30a5 tempest-GroupsV314Test-889148083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:58:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-fd1f3972-108d-4830-9cb7-26554cbf30a5 tempest-GroupsV314Test-889148083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:58:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fd1f3972-108d-4830-9cb7-26554cbf30a5 tempest-GroupsV314Test-889148083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:58:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fd1f3972-108d-4830-9cb7-26554cbf30a5 tempest-GroupsV314Test-889148083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:11 devstack sudo[98339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:58:11 devstack sudo[98339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:11 devstack sudo[98337]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c435f272-990c-48c1-abd4-94c7c0a61c51 tempest-VolumesDeleteCascade-1318752930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f.info" returned: 0 in 0.248s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:11 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-c435f272-990c-48c1-abd4-94c7c0a61c51 tempest-VolumesDeleteCascade-1318752930 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f.info is being set with open permissions: ugo+rw Sep 04 17:58:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c435f272-990c-48c1-abd4-94c7c0a61c51 tempest-VolumesDeleteCascade-1318752930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:11 devstack sudo[98342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f.info Sep 04 17:58:11 devstack sudo[98342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:12 devstack sudo[98339]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fd1f3972-108d-4830-9cb7-26554cbf30a5 tempest-GroupsV314Test-889148083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.267s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:12 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-fd1f3972-108d-4830-9cb7-26554cbf30a5 tempest-GroupsV314Test-889148083 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:58:12 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-fd1f3972-108d-4830-9cb7-26554cbf30a5 tempest-GroupsV314Test-889148083 None] Delete group completed successfully. Sep 04 17:58:12 devstack sudo[98342]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c435f272-990c-48c1-abd4-94c7c0a61c51 tempest-VolumesDeleteCascade-1318752930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f.info" returned: 0 in 0.251s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c435f272-990c-48c1-abd4-94c7c0a61c51 tempest-VolumesDeleteCascade-1318752930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.921s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:58:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8e3f0f32-120e-4f95-b164-b5a85cd98a05 tempest-GroupsTest-1928760915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.913s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:58:12 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8e3f0f32-120e-4f95-b164-b5a85cd98a05 tempest-GroupsTest-1928760915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=35da4f86-cc6a-4f69-9b28-fde369830690,created_at=2026-09-04T15:58:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-526406415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=35da4f86-cc6a-4f69-9b28-fde369830690,host='devstack@QuobyteHD#QuobyteHD',id=765bf260-940e-4b30-abe7-7902342e91b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e5bfb57409d46a890169dc775a95c6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:58:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:58:06Z,use_quota=True,user_id='6907e365096e42718a8750e53e710ca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe152f14-38fc-4d00-8b20-fa9a0c083166),volume_type_id=fe152f14-38fc-4d00-8b20-fa9a0c083166)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:58:12 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-8e3f0f32-120e-4f95-b164-b5a85cd98a05 tempest-GroupsTest-1928760915 None] Creating volume 765bf260-940e-4b30-abe7-7902342e91b3 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:58:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8e3f0f32-120e-4f95-b164-b5a85cd98a05 tempest-GroupsTest-1928760915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:58:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8e3f0f32-120e-4f95-b164-b5a85cd98a05 tempest-GroupsTest-1928760915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:58:12 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8e3f0f32-120e-4f95-b164-b5a85cd98a05 tempest-GroupsTest-1928760915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:58:12 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8e3f0f32-120e-4f95-b164-b5a85cd98a05 tempest-GroupsTest-1928760915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:58:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8e3f0f32-120e-4f95-b164-b5a85cd98a05 tempest-GroupsTest-1928760915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:58:12 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8e3f0f32-120e-4f95-b164-b5a85cd98a05 tempest-GroupsTest-1928760915 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:58:12 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-8e3f0f32-120e-4f95-b164-b5a85cd98a05 tempest-GroupsTest-1928760915 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:58:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8e3f0f32-120e-4f95-b164-b5a85cd98a05 tempest-GroupsTest-1928760915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-765bf260-940e-4b30-abe7-7902342e91b3 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:12 devstack sudo[98346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-765bf260-940e-4b30-abe7-7902342e91b3 1073741824 Sep 04 17:58:12 devstack sudo[98346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:12 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-c435f272-990c-48c1-abd4-94c7c0a61c51 tempest-VolumesDeleteCascade-1318752930 None] Create snapshot completed successfully Sep 04 17:58:12 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ea925d5d-8d6d-47f5-a501-1889776a6ddf tempest-GroupsV314Test-889148083 None] Acquiring lock "cinder-quobyte-72c3553c-4606-42cb-b0cd-bc45f69f81bb" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:58:12 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ea925d5d-8d6d-47f5-a501-1889776a6ddf tempest-GroupsV314Test-889148083 None] Lock "cinder-quobyte-72c3553c-4606-42cb-b0cd-bc45f69f81bb" acquired by "delete_volume" :: waited 0.018s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:58:12 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[614ed6e2-4778-422a-b22a-a10a7ad8cde2]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:58:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ea925d5d-8d6d-47f5-a501-1889776a6ddf tempest-GroupsV314Test-889148083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:12 devstack sudo[98348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb Sep 04 17:58:12 devstack sudo[98348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:12 devstack sudo[98346]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8e3f0f32-120e-4f95-b164-b5a85cd98a05 tempest-GroupsTest-1928760915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-765bf260-940e-4b30-abe7-7902342e91b3 1073741824" returned: 0 in 0.467s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8e3f0f32-120e-4f95-b164-b5a85cd98a05 tempest-GroupsTest-1928760915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-765bf260-940e-4b30-abe7-7902342e91b3 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:12 devstack sudo[98354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-765bf260-940e-4b30-abe7-7902342e91b3 Sep 04 17:58:12 devstack sudo[98354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:12 devstack sudo[98348]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ea925d5d-8d6d-47f5-a501-1889776a6ddf tempest-GroupsV314Test-889148083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb" returned: 0 in 0.406s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ea925d5d-8d6d-47f5-a501-1889776a6ddf tempest-GroupsV314Test-889148083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:12 devstack sudo[98360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb Sep 04 17:58:12 devstack sudo[98360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:13 devstack sudo[98354]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8e3f0f32-120e-4f95-b164-b5a85cd98a05 tempest-GroupsTest-1928760915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-765bf260-940e-4b30-abe7-7902342e91b3" returned: 0 in 0.251s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:13 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8e3f0f32-120e-4f95-b164-b5a85cd98a05 tempest-GroupsTest-1928760915 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:58:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8e3f0f32-120e-4f95-b164-b5a85cd98a05 tempest-GroupsTest-1928760915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:58:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8e3f0f32-120e-4f95-b164-b5a85cd98a05 tempest-GroupsTest-1928760915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9a3d4d4-be1e-4e8b-acb4-5a38d2bc74bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-765bf260-940e-4b30-abe7-7902342e91b3', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8e3f0f32-120e-4f95-b164-b5a85cd98a05 tempest-GroupsTest-1928760915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7c6bba7-2a61-452b-ab0e-86dc0a024063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:13 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-8e3f0f32-120e-4f95-b164-b5a85cd98a05 tempest-GroupsTest-1928760915 None] Volume volume-765bf260-940e-4b30-abe7-7902342e91b3 (765bf260-940e-4b30-abe7-7902342e91b3): created successfully Sep 04 17:58:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8e3f0f32-120e-4f95-b164-b5a85cd98a05 tempest-GroupsTest-1928760915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7c6bba7-2a61-452b-ab0e-86dc0a024063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8e3f0f32-120e-4f95-b164-b5a85cd98a05 tempest-GroupsTest-1928760915 None] Flow 'volume_create_manager' (7cd21e57-5361-4f63-8335-cc7224201f3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:58:13 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-8e3f0f32-120e-4f95-b164-b5a85cd98a05 tempest-GroupsTest-1928760915 None] Created volume successfully. Sep 04 17:58:13 devstack sudo[98360]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ea925d5d-8d6d-47f5-a501-1889776a6ddf tempest-GroupsV314Test-889148083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-72c3553c-4606-42cb-b0cd-bc45f69f81bb" returned: 0 in 0.265s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:13 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ea925d5d-8d6d-47f5-a501-1889776a6ddf tempest-GroupsV314Test-889148083 None] Lock "cinder-quobyte-72c3553c-4606-42cb-b0cd-bc45f69f81bb" released by "delete_volume" :: held 0.730s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:58:13 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-ea925d5d-8d6d-47f5-a501-1889776a6ddf tempest-GroupsV314Test-889148083 None] Created reservations ['920ab197-a00e-4fcd-822e-61e291298ce0'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:58:13 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-ea925d5d-8d6d-47f5-a501-1889776a6ddf tempest-GroupsV314Test-889148083 None] Created reservations ['3e009d6a-1b6b-4a31-9502-5a373ad47423', '590199c1-8795-4898-af14-463753a53f7a', '81533f71-8681-4da3-b8a7-8851df63fea3', '9cc05b73-e179-4c2c-b56e-1e34b11f0151'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:58:13 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9705336-59b8-4264-a380-07c754b32695 tempest-VolumesDeleteCascade-1318752930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:58:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ea925d5d-8d6d-47f5-a501-1889776a6ddf tempest-GroupsV314Test-889148083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:58:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ea925d5d-8d6d-47f5-a501-1889776a6ddf tempest-GroupsV314Test-889148083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:58:13 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ea925d5d-8d6d-47f5-a501-1889776a6ddf tempest-GroupsV314Test-889148083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:58:13 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ea925d5d-8d6d-47f5-a501-1889776a6ddf tempest-GroupsV314Test-889148083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:58:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ea925d5d-8d6d-47f5-a501-1889776a6ddf tempest-GroupsV314Test-889148083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:58:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ea925d5d-8d6d-47f5-a501-1889776a6ddf tempest-GroupsV314Test-889148083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b9705336-59b8-4264-a380-07c754b32695 tempest-VolumesDeleteCascade-1318752930 None] Flow 'volume_create_manager' (ab7548cf-1a0d-414e-90ff-d9df8becc8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:58:13 devstack sudo[98365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:58:13 devstack sudo[98365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b9705336-59b8-4264-a380-07c754b32695 tempest-VolumesDeleteCascade-1318752930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (babbb4c6-256d-46a1-a0de-c006cc15fc73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b9705336-59b8-4264-a380-07c754b32695 tempest-VolumesDeleteCascade-1318752930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (babbb4c6-256d-46a1-a0de-c006cc15fc73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:58:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1107902989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3938382c-9498-4d37-8ee2-c516cb89f4dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6144acfe25745c1b312316309354a28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:58:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=95b266e1-bab7-408e-9ffa-c743a509d664,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:58:13Z,use_quota=True,user_id='926bd8f8538b48b2ba82592baeee78fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b9705336-59b8-4264-a380-07c754b32695 tempest-VolumesDeleteCascade-1318752930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (429197a7-559e-4cba-9280-445c6de466b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b9705336-59b8-4264-a380-07c754b32695 tempest-VolumesDeleteCascade-1318752930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (429197a7-559e-4cba-9280-445c6de466b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b9705336-59b8-4264-a380-07c754b32695 tempest-VolumesDeleteCascade-1318752930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d84a5751-69f1-45e6-991a-db821a332320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b9705336-59b8-4264-a380-07c754b32695 tempest-VolumesDeleteCascade-1318752930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d84a5751-69f1-45e6-991a-db821a332320) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3938382c-9498-4d37-8ee2-c516cb89f4dc', 'volume_name': 'volume-3938382c-9498-4d37-8ee2-c516cb89f4dc', 'volume_size': 1, 'snapshot_id': '95b266e1-bab7-408e-9ffa-c743a509d664'}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b9705336-59b8-4264-a380-07c754b32695 tempest-VolumesDeleteCascade-1318752930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8f88868-e12a-4eeb-afa2-724bf41731da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b9705336-59b8-4264-a380-07c754b32695 tempest-VolumesDeleteCascade-1318752930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8f88868-e12a-4eeb-afa2-724bf41731da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b9705336-59b8-4264-a380-07c754b32695 tempest-VolumesDeleteCascade-1318752930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cba71a51-fe90-425f-877d-4826bc9d1142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:13 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-b9705336-59b8-4264-a380-07c754b32695 tempest-VolumesDeleteCascade-1318752930 None] Volume 3938382c-9498-4d37-8ee2-c516cb89f4dc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3938382c-9498-4d37-8ee2-c516cb89f4dc', 'volume_size': 1, 'snapshot_id': '95b266e1-bab7-408e-9ffa-c743a509d664'} Sep 04 17:58:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b9705336-59b8-4264-a380-07c754b32695 tempest-VolumesDeleteCascade-1318752930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:58:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b9705336-59b8-4264-a380-07c754b32695 tempest-VolumesDeleteCascade-1318752930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:58:13 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b9705336-59b8-4264-a380-07c754b32695 tempest-VolumesDeleteCascade-1318752930 None] Acquiring lock "cinder-quobyte-95b266e1-bab7-408e-9ffa-c743a509d664-3938382c-9498-4d37-8ee2-c516cb89f4dc" by "_create_volume_from_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:58:13 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b9705336-59b8-4264-a380-07c754b32695 tempest-VolumesDeleteCascade-1318752930 None] Lock "cinder-quobyte-95b266e1-bab7-408e-9ffa-c743a509d664-3938382c-9498-4d37-8ee2-c516cb89f4dc" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:58:13 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b9705336-59b8-4264-a380-07c754b32695 tempest-VolumesDeleteCascade-1318752930 None] Creating volume 3938382c-9498-4d37-8ee2-c516cb89f4dc from snapshot 95b266e1-bab7-408e-9ffa-c743a509d664 {{(pid=87314) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 04 17:58:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b9705336-59b8-4264-a380-07c754b32695 tempest-VolumesDeleteCascade-1318752930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:58:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b9705336-59b8-4264-a380-07c754b32695 tempest-VolumesDeleteCascade-1318752930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:58:13 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b9705336-59b8-4264-a380-07c754b32695 tempest-VolumesDeleteCascade-1318752930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:58:13 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b9705336-59b8-4264-a380-07c754b32695 tempest-VolumesDeleteCascade-1318752930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:58:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b9705336-59b8-4264-a380-07c754b32695 tempest-VolumesDeleteCascade-1318752930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:58:13 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b9705336-59b8-4264-a380-07c754b32695 tempest-VolumesDeleteCascade-1318752930 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:58:13 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b9705336-59b8-4264-a380-07c754b32695 tempest-VolumesDeleteCascade-1318752930 None] Acquiring lock "cinder-quobyte-3938382c-9498-4d37-8ee2-c516cb89f4dc" by "_copy_volume_from_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:58:13 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b9705336-59b8-4264-a380-07c754b32695 tempest-VolumesDeleteCascade-1318752930 None] Lock "cinder-quobyte-3938382c-9498-4d37-8ee2-c516cb89f4dc" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:58:13 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b9705336-59b8-4264-a380-07c754b32695 tempest-VolumesDeleteCascade-1318752930 None] snapshot: 95b266e1-bab7-408e-9ffa-c743a509d664, volume: 3938382c-9498-4d37-8ee2-c516cb89f4dc, {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 04 17:58:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b9705336-59b8-4264-a380-07c754b32695 tempest-VolumesDeleteCascade-1318752930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:58:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b9705336-59b8-4264-a380-07c754b32695 tempest-VolumesDeleteCascade-1318752930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:58:13 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b9705336-59b8-4264-a380-07c754b32695 tempest-VolumesDeleteCascade-1318752930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:58:13 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b9705336-59b8-4264-a380-07c754b32695 tempest-VolumesDeleteCascade-1318752930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:58:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b9705336-59b8-4264-a380-07c754b32695 tempest-VolumesDeleteCascade-1318752930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:58:13 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2094d1-0ec5-4f8c-89c5-e52d997c4dc6]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:58:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b9705336-59b8-4264-a380-07c754b32695 tempest-VolumesDeleteCascade-1318752930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f.95b266e1-bab7-408e-9ffa-c743a509d664 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:13 devstack sudo[98365]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ea925d5d-8d6d-47f5-a501-1889776a6ddf tempest-GroupsV314Test-889148083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.314s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:13 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-ea925d5d-8d6d-47f5-a501-1889776a6ddf tempest-GroupsV314Test-889148083 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:58:13 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-ea925d5d-8d6d-47f5-a501-1889776a6ddf tempest-GroupsV314Test-889148083 None] Delete group completed successfully. Sep 04 17:58:13 devstack sudo[98367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f.95b266e1-bab7-408e-9ffa-c743a509d664 Sep 04 17:58:13 devstack sudo[98367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:14 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-15c22d01-6917-463d-a50c-0174ee42b324 tempest-GroupsTest-1928760915 None] Acquiring lock "cinder-quobyte-765bf260-940e-4b30-abe7-7902342e91b3" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:58:14 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-15c22d01-6917-463d-a50c-0174ee42b324 tempest-GroupsTest-1928760915 None] Lock "cinder-quobyte-765bf260-940e-4b30-abe7-7902342e91b3" acquired by "delete_volume" :: waited 0.021s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:58:14 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fefe283-709d-42bc-842b-a4a2cd0811fb]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:58:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-15c22d01-6917-463d-a50c-0174ee42b324 tempest-GroupsTest-1928760915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-765bf260-940e-4b30-abe7-7902342e91b3 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:14 devstack sudo[98367]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b9705336-59b8-4264-a380-07c754b32695 tempest-VolumesDeleteCascade-1318752930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f.95b266e1-bab7-408e-9ffa-c743a509d664" returned: 0 in 0.472s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:14 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-b9705336-59b8-4264-a380-07c754b32695 tempest-VolumesDeleteCascade-1318752930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 17:58:14 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1237b32-07e3-415d-bc64-04b5c4c2267c]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:58:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b9705336-59b8-4264-a380-07c754b32695 tempest-VolumesDeleteCascade-1318752930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:14 devstack sudo[98373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-765bf260-940e-4b30-abe7-7902342e91b3 Sep 04 17:58:14 devstack sudo[98373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:14 devstack sudo[98374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f Sep 04 17:58:14 devstack sudo[98374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:14 devstack sudo[98373]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-15c22d01-6917-463d-a50c-0174ee42b324 tempest-GroupsTest-1928760915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-765bf260-940e-4b30-abe7-7902342e91b3" returned: 0 in 0.401s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-15c22d01-6917-463d-a50c-0174ee42b324 tempest-GroupsTest-1928760915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-765bf260-940e-4b30-abe7-7902342e91b3 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:14 devstack sudo[98383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-765bf260-940e-4b30-abe7-7902342e91b3 Sep 04 17:58:14 devstack sudo[98383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:14 devstack sudo[98374]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b9705336-59b8-4264-a380-07c754b32695 tempest-VolumesDeleteCascade-1318752930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f" returned: 0 in 0.435s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:14 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b9705336-59b8-4264-a380-07c754b32695 tempest-VolumesDeleteCascade-1318752930 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 04 17:58:14 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b9705336-59b8-4264-a380-07c754b32695 tempest-VolumesDeleteCascade-1318752930 None] Creating direct copy from snapshot {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 04 17:58:14 devstack cinder-volume[87314]: DEBUG cinder.utils [None req-b9705336-59b8-4264-a380-07c754b32695 tempest-VolumesDeleteCascade-1318752930 None] Path /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3938382c-9498-4d37-8ee2-c516cb89f4dc not found in is_blk_device check {{(pid=87314) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 04 17:58:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b9705336-59b8-4264-a380-07c754b32695 tempest-VolumesDeleteCascade-1318752930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3938382c-9498-4d37-8ee2-c516cb89f4dc {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:14 devstack sudo[98386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3938382c-9498-4d37-8ee2-c516cb89f4dc Sep 04 17:58:14 devstack sudo[98386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:14 devstack sudo[98383]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-15c22d01-6917-463d-a50c-0174ee42b324 tempest-GroupsTest-1928760915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-765bf260-940e-4b30-abe7-7902342e91b3" returned: 0 in 0.282s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:14 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-15c22d01-6917-463d-a50c-0174ee42b324 tempest-GroupsTest-1928760915 None] Lock "cinder-quobyte-765bf260-940e-4b30-abe7-7902342e91b3" released by "delete_volume" :: held 0.750s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:58:14 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-15c22d01-6917-463d-a50c-0174ee42b324 tempest-GroupsTest-1928760915 None] Created reservations ['c2c0a714-71ca-40e3-85f6-7ea39893b163'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:58:14 devstack cinder-volume[87314]: WARNING cinder.quota [None req-15c22d01-6917-463d-a50c-0174ee42b324 tempest-GroupsTest-1928760915 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-630996814 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-630996814, it is now deprecated. Please use the default quota class for default quota. Sep 04 17:58:14 devstack cinder-volume[87314]: WARNING cinder.quota [None req-15c22d01-6917-463d-a50c-0174ee42b324 tempest-GroupsTest-1928760915 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-630996814 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-630996814, it is now deprecated. Please use the default quota class for default quota. Sep 04 17:58:14 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-15c22d01-6917-463d-a50c-0174ee42b324 tempest-GroupsTest-1928760915 None] Created reservations ['b6293098-3fd0-461e-bc75-4e73a62dff1a', 'ff371d57-f880-4a55-9489-82ffe173cfbf', 'd41fcb0d-ec89-4185-8cd3-c52e4fe08174', '1607baf5-1115-4779-965e-e198cd17a126'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:58:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-15c22d01-6917-463d-a50c-0174ee42b324 tempest-GroupsTest-1928760915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:58:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-15c22d01-6917-463d-a50c-0174ee42b324 tempest-GroupsTest-1928760915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:58:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-15c22d01-6917-463d-a50c-0174ee42b324 tempest-GroupsTest-1928760915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:58:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-15c22d01-6917-463d-a50c-0174ee42b324 tempest-GroupsTest-1928760915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:58:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-15c22d01-6917-463d-a50c-0174ee42b324 tempest-GroupsTest-1928760915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:58:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-15c22d01-6917-463d-a50c-0174ee42b324 tempest-GroupsTest-1928760915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:15 devstack sudo[98392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:58:15 devstack sudo[98392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:15 devstack sudo[98392]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-15c22d01-6917-463d-a50c-0174ee42b324 tempest-GroupsTest-1928760915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.402s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:15 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-15c22d01-6917-463d-a50c-0174ee42b324 tempest-GroupsTest-1928760915 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:58:15 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-15c22d01-6917-463d-a50c-0174ee42b324 tempest-GroupsTest-1928760915 None] Delete group completed successfully. Sep 04 17:58:15 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-b20ea1c0-9077-42f9-a8db-e15d88d6f8f4 tempest-GroupsTest-1928760915 None] Created reservations ['ede0a087-86bb-4647-9e82-9a1a1c90bc00'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:58:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b20ea1c0-9077-42f9-a8db-e15d88d6f8f4 tempest-GroupsTest-1928760915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:58:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b20ea1c0-9077-42f9-a8db-e15d88d6f8f4 tempest-GroupsTest-1928760915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:58:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b20ea1c0-9077-42f9-a8db-e15d88d6f8f4 tempest-GroupsTest-1928760915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:58:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b20ea1c0-9077-42f9-a8db-e15d88d6f8f4 tempest-GroupsTest-1928760915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:58:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b20ea1c0-9077-42f9-a8db-e15d88d6f8f4 tempest-GroupsTest-1928760915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:58:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b20ea1c0-9077-42f9-a8db-e15d88d6f8f4 tempest-GroupsTest-1928760915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:16 devstack sudo[98403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:58:16 devstack sudo[98403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:16 devstack sudo[98403]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b20ea1c0-9077-42f9-a8db-e15d88d6f8f4 tempest-GroupsTest-1928760915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.603s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:16 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-b20ea1c0-9077-42f9-a8db-e15d88d6f8f4 tempest-GroupsTest-1928760915 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:58:16 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-b20ea1c0-9077-42f9-a8db-e15d88d6f8f4 tempest-GroupsTest-1928760915 None] Delete group completed successfully. Sep 04 17:58:18 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-ef8788d4-f6f1-4303-a0fc-d61cc2d89bb6 tempest-GroupsTest-1928760915 None] Group tempest-GroupsTest-Group-1056434068: creating Sep 04 17:58:18 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-ef8788d4-f6f1-4303-a0fc-d61cc2d89bb6 tempest-GroupsTest-1928760915 None] Group tempest-GroupsTest-Group-1056434068: created successfully Sep 04 17:58:18 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-ef8788d4-f6f1-4303-a0fc-d61cc2d89bb6 tempest-GroupsTest-1928760915 None] Create group completed successfully. Sep 04 17:58:20 devstack sudo[98386]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b9705336-59b8-4264-a380-07c754b32695 tempest-VolumesDeleteCascade-1318752930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3938382c-9498-4d37-8ee2-c516cb89f4dc" returned: 0 in 5.462s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:20 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-b9705336-59b8-4264-a380-07c754b32695 tempest-VolumesDeleteCascade-1318752930 None] Image conversion details: src /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f, size 1024.00 MB, duration 5.46 sec, destination /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3938382c-9498-4d37-8ee2-c516cb89f4dc {{(pid=87314) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 17:58:20 devstack cinder-volume[87314]: INFO cinder.image.image_utils [None req-b9705336-59b8-4264-a380-07c754b32695 tempest-VolumesDeleteCascade-1318752930 None] Converted 1024.00 MB image at 187.43 MB/s Sep 04 17:58:20 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-b9705336-59b8-4264-a380-07c754b32695 tempest-VolumesDeleteCascade-1318752930 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3938382c-9498-4d37-8ee2-c516cb89f4dc is being set with open permissions: ugo+rw Sep 04 17:58:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b9705336-59b8-4264-a380-07c754b32695 tempest-VolumesDeleteCascade-1318752930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3938382c-9498-4d37-8ee2-c516cb89f4dc {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:20 devstack sudo[98406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3938382c-9498-4d37-8ee2-c516cb89f4dc Sep 04 17:58:20 devstack sudo[98406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:20 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-377d8c96-f027-4a0e-83d0-1ec9ed93e2e5 tempest-GroupsTest-1928760915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:58:20 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-377d8c96-f027-4a0e-83d0-1ec9ed93e2e5 tempest-GroupsTest-1928760915 None] Flow 'volume_create_manager' (36473c0c-873b-4713-9cd0-b7362a0c0ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:58:20 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-377d8c96-f027-4a0e-83d0-1ec9ed93e2e5 tempest-GroupsTest-1928760915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0d55952-1819-4953-93df-0b76f83a468b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:20 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-377d8c96-f027-4a0e-83d0-1ec9ed93e2e5 tempest-GroupsTest-1928760915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0d55952-1819-4953-93df-0b76f83a468b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-309720295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ec5ffac8-6b62-4931-a72e-344e58d32237,host='devstack@QuobyteHD#QuobyteHD',id=186e31b8-577e-4d1b-950f-624195a45a4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e5bfb57409d46a890169dc775a95c6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:58:20Z,use_quota=True,user_id='6907e365096e42718a8750e53e710ca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a1a7f46-da06-47e8-846d-e0473dd1353e),volume_type_id=0a1a7f46-da06-47e8-846d-e0473dd1353e)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:20 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-377d8c96-f027-4a0e-83d0-1ec9ed93e2e5 tempest-GroupsTest-1928760915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea69b241-fd49-4c8b-ae69-94b61fea0f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:20 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-377d8c96-f027-4a0e-83d0-1ec9ed93e2e5 tempest-GroupsTest-1928760915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea69b241-fd49-4c8b-ae69-94b61fea0f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:20 devstack sudo[98406]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:20 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-377d8c96-f027-4a0e-83d0-1ec9ed93e2e5 tempest-GroupsTest-1928760915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9906714e-c594-4ced-9343-3106819e11e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:20 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-377d8c96-f027-4a0e-83d0-1ec9ed93e2e5 tempest-GroupsTest-1928760915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9906714e-c594-4ced-9343-3106819e11e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '186e31b8-577e-4d1b-950f-624195a45a4a', 'volume_name': 'volume-186e31b8-577e-4d1b-950f-624195a45a4a', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:20 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-377d8c96-f027-4a0e-83d0-1ec9ed93e2e5 tempest-GroupsTest-1928760915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92e7afbe-b9b7-4835-9c22-93f229a27270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:20 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-377d8c96-f027-4a0e-83d0-1ec9ed93e2e5 tempest-GroupsTest-1928760915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92e7afbe-b9b7-4835-9c22-93f229a27270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:20 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-377d8c96-f027-4a0e-83d0-1ec9ed93e2e5 tempest-GroupsTest-1928760915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99ab4bf7-1578-4669-a0d1-ec95433f6014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:20 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-377d8c96-f027-4a0e-83d0-1ec9ed93e2e5 tempest-GroupsTest-1928760915 None] Volume 186e31b8-577e-4d1b-950f-624195a45a4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-186e31b8-577e-4d1b-950f-624195a45a4a', 'volume_size': 1} Sep 04 17:58:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-377d8c96-f027-4a0e-83d0-1ec9ed93e2e5 tempest-GroupsTest-1928760915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:58:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b9705336-59b8-4264-a380-07c754b32695 tempest-VolumesDeleteCascade-1318752930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3938382c-9498-4d37-8ee2-c516cb89f4dc" returned: 0 in 0.294s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:20 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b9705336-59b8-4264-a380-07c754b32695 tempest-VolumesDeleteCascade-1318752930 None] Lock "cinder-quobyte-3938382c-9498-4d37-8ee2-c516cb89f4dc" released by "_copy_volume_from_snapshot" :: held 6.773s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:58:20 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b9705336-59b8-4264-a380-07c754b32695 tempest-VolumesDeleteCascade-1318752930 None] Lock "cinder-quobyte-95b266e1-bab7-408e-9ffa-c743a509d664-3938382c-9498-4d37-8ee2-c516cb89f4dc" released by "_create_volume_from_snapshot" :: held 6.842s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:58:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b9705336-59b8-4264-a380-07c754b32695 tempest-VolumesDeleteCascade-1318752930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.862s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:58:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-377d8c96-f027-4a0e-83d0-1ec9ed93e2e5 tempest-GroupsTest-1928760915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.052s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:58:20 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-377d8c96-f027-4a0e-83d0-1ec9ed93e2e5 tempest-GroupsTest-1928760915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ec5ffac8-6b62-4931-a72e-344e58d32237,created_at=2026-09-04T15:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-309720295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ec5ffac8-6b62-4931-a72e-344e58d32237,host='devstack@QuobyteHD#QuobyteHD',id=186e31b8-577e-4d1b-950f-624195a45a4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e5bfb57409d46a890169dc775a95c6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:58:20Z,use_quota=True,user_id='6907e365096e42718a8750e53e710ca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a1a7f46-da06-47e8-846d-e0473dd1353e),volume_type_id=0a1a7f46-da06-47e8-846d-e0473dd1353e)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:58:20 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-377d8c96-f027-4a0e-83d0-1ec9ed93e2e5 tempest-GroupsTest-1928760915 None] Creating volume 186e31b8-577e-4d1b-950f-624195a45a4a {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:58:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-377d8c96-f027-4a0e-83d0-1ec9ed93e2e5 tempest-GroupsTest-1928760915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:58:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-377d8c96-f027-4a0e-83d0-1ec9ed93e2e5 tempest-GroupsTest-1928760915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:58:20 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-377d8c96-f027-4a0e-83d0-1ec9ed93e2e5 tempest-GroupsTest-1928760915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:58:20 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-377d8c96-f027-4a0e-83d0-1ec9ed93e2e5 tempest-GroupsTest-1928760915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:58:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-377d8c96-f027-4a0e-83d0-1ec9ed93e2e5 tempest-GroupsTest-1928760915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:58:20 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-377d8c96-f027-4a0e-83d0-1ec9ed93e2e5 tempest-GroupsTest-1928760915 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:58:20 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-377d8c96-f027-4a0e-83d0-1ec9ed93e2e5 tempest-GroupsTest-1928760915 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:58:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-377d8c96-f027-4a0e-83d0-1ec9ed93e2e5 tempest-GroupsTest-1928760915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-186e31b8-577e-4d1b-950f-624195a45a4a 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:20 devstack sudo[98409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-186e31b8-577e-4d1b-950f-624195a45a4a 1073741824 Sep 04 17:58:20 devstack sudo[98409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:20 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b9705336-59b8-4264-a380-07c754b32695 tempest-VolumesDeleteCascade-1318752930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cba71a51-fe90-425f-877d-4826bc9d1142) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3938382c-9498-4d37-8ee2-c516cb89f4dc', 'volume_size': 1, 'snapshot_id': '95b266e1-bab7-408e-9ffa-c743a509d664'}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:20 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b9705336-59b8-4264-a380-07c754b32695 tempest-VolumesDeleteCascade-1318752930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba4664ce-43c7-42d6-888e-3939a91dfe04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:20 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-b9705336-59b8-4264-a380-07c754b32695 tempest-VolumesDeleteCascade-1318752930 None] Volume volume-3938382c-9498-4d37-8ee2-c516cb89f4dc (3938382c-9498-4d37-8ee2-c516cb89f4dc): created successfully Sep 04 17:58:20 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b9705336-59b8-4264-a380-07c754b32695 tempest-VolumesDeleteCascade-1318752930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba4664ce-43c7-42d6-888e-3939a91dfe04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:20 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b9705336-59b8-4264-a380-07c754b32695 tempest-VolumesDeleteCascade-1318752930 None] Flow 'volume_create_manager' (ab7548cf-1a0d-414e-90ff-d9df8becc8d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:58:20 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-b9705336-59b8-4264-a380-07c754b32695 tempest-VolumesDeleteCascade-1318752930 None] Created volume successfully. Sep 04 17:58:20 devstack sudo[98409]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-377d8c96-f027-4a0e-83d0-1ec9ed93e2e5 tempest-GroupsTest-1928760915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-186e31b8-577e-4d1b-950f-624195a45a4a 1073741824" returned: 0 in 0.451s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-377d8c96-f027-4a0e-83d0-1ec9ed93e2e5 tempest-GroupsTest-1928760915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-186e31b8-577e-4d1b-950f-624195a45a4a {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:20 devstack sudo[98415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-186e31b8-577e-4d1b-950f-624195a45a4a Sep 04 17:58:20 devstack sudo[98415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:21 devstack sudo[98415]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-377d8c96-f027-4a0e-83d0-1ec9ed93e2e5 tempest-GroupsTest-1928760915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-186e31b8-577e-4d1b-950f-624195a45a4a" returned: 0 in 0.251s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-377d8c96-f027-4a0e-83d0-1ec9ed93e2e5 tempest-GroupsTest-1928760915 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:58:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-377d8c96-f027-4a0e-83d0-1ec9ed93e2e5 tempest-GroupsTest-1928760915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:58:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-377d8c96-f027-4a0e-83d0-1ec9ed93e2e5 tempest-GroupsTest-1928760915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99ab4bf7-1578-4669-a0d1-ec95433f6014) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-186e31b8-577e-4d1b-950f-624195a45a4a', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-377d8c96-f027-4a0e-83d0-1ec9ed93e2e5 tempest-GroupsTest-1928760915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (157da593-5e11-4380-82cb-dc9532e3156f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:21 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-377d8c96-f027-4a0e-83d0-1ec9ed93e2e5 tempest-GroupsTest-1928760915 None] Volume volume-186e31b8-577e-4d1b-950f-624195a45a4a (186e31b8-577e-4d1b-950f-624195a45a4a): created successfully Sep 04 17:58:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-377d8c96-f027-4a0e-83d0-1ec9ed93e2e5 tempest-GroupsTest-1928760915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (157da593-5e11-4380-82cb-dc9532e3156f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-377d8c96-f027-4a0e-83d0-1ec9ed93e2e5 tempest-GroupsTest-1928760915 None] Flow 'volume_create_manager' (36473c0c-873b-4713-9cd0-b7362a0c0ac0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:58:21 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-377d8c96-f027-4a0e-83d0-1ec9ed93e2e5 tempest-GroupsTest-1928760915 None] Created volume successfully. Sep 04 17:58:21 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-1bd9a2e2-17fd-4cca-a941-236a62fc498f tempest-VolumesDeleteCascade-1318752930 None] Acquiring lock "cinder-f32aa6f2-6fae-45d8-9c78-f28599e8c34f-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:58:21 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-1bd9a2e2-17fd-4cca-a941-236a62fc498f tempest-VolumesDeleteCascade-1318752930 None] Lock "cinder-f32aa6f2-6fae-45d8-9c78-f28599e8c34f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:58:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1bd9a2e2-17fd-4cca-a941-236a62fc498f tempest-VolumesDeleteCascade-1318752930 None] Performing cascade delete. {{(pid=87314) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 04 17:58:21 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-1bd9a2e2-17fd-4cca-a941-236a62fc498f tempest-VolumesDeleteCascade-1318752930 None] Acquiring lock "cinder-95b266e1-bab7-408e-9ffa-c743a509d664-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:58:21 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 17:58:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:58:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:58:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:58:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:58:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:58:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:21 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-1bd9a2e2-17fd-4cca-a941-236a62fc498f tempest-VolumesDeleteCascade-1318752930 None] Lock "cinder-95b266e1-bab7-408e-9ffa-c743a509d664-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:58:21 devstack sudo[98418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:58:21 devstack sudo[98418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:21 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-1bd9a2e2-17fd-4cca-a941-236a62fc498f tempest-VolumesDeleteCascade-1318752930 None] Acquiring lock "cinder-quobyte-f32aa6f2-6fae-45d8-9c78-f28599e8c34f" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:58:21 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-1bd9a2e2-17fd-4cca-a941-236a62fc498f tempest-VolumesDeleteCascade-1318752930 None] Lock "cinder-quobyte-f32aa6f2-6fae-45d8-9c78-f28599e8c34f" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:58:21 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-1bd9a2e2-17fd-4cca-a941-236a62fc498f tempest-VolumesDeleteCascade-1318752930 None] Acquiring lock "cinder-quobyte-95b266e1-bab7-408e-9ffa-c743a509d664" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:58:21 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-1bd9a2e2-17fd-4cca-a941-236a62fc498f tempest-VolumesDeleteCascade-1318752930 None] Lock "cinder-quobyte-95b266e1-bab7-408e-9ffa-c743a509d664" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:58:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-1bd9a2e2-17fd-4cca-a941-236a62fc498f tempest-VolumesDeleteCascade-1318752930 None] Deleting offline snapshot 95b266e1-bab7-408e-9ffa-c743a509d664 of volume f32aa6f2-6fae-45d8-9c78-f28599e8c34f {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 17:58:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-1bd9a2e2-17fd-4cca-a941-236a62fc498f tempest-VolumesDeleteCascade-1318752930 None] snapshot_file for this snap is: volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f.95b266e1-bab7-408e-9ffa-c743a509d664 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 17:58:21 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da2dc95-6cb5-47db-8e07-e1bbf4ef9898]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:58:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1bd9a2e2-17fd-4cca-a941-236a62fc498f tempest-VolumesDeleteCascade-1318752930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f.95b266e1-bab7-408e-9ffa-c743a509d664 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:21 devstack sudo[98418]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.320s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:21 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:58:21 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running periodic task VolumeManager._thread_info {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 17:58:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] thread count: 28 {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 17:58:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] thread info: [<_MainThread(MainThread, started 139900377723008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 17:58:21 devstack sudo[98420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f.95b266e1-bab7-408e-9ffa-c743a509d664 Sep 04 17:58:21 devstack sudo[98420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:22 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9b32ffd-111e-4429-b5dc-09153c24582d tempest-GroupsTest-1928760915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:58:22 devstack sudo[98420]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f9b32ffd-111e-4429-b5dc-09153c24582d tempest-GroupsTest-1928760915 None] Flow 'volume_create_manager' (fedb573c-7a4a-468a-8417-d32386902d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:58:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f9b32ffd-111e-4429-b5dc-09153c24582d tempest-GroupsTest-1928760915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57d3969c-adde-404c-90d1-42ea2f9b4af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1bd9a2e2-17fd-4cca-a941-236a62fc498f tempest-VolumesDeleteCascade-1318752930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f.95b266e1-bab7-408e-9ffa-c743a509d664" returned: 0 in 0.516s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:22 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-1bd9a2e2-17fd-4cca-a941-236a62fc498f tempest-VolumesDeleteCascade-1318752930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 17:58:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f9b32ffd-111e-4429-b5dc-09153c24582d tempest-GroupsTest-1928760915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57d3969c-adde-404c-90d1-42ea2f9b4af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:58:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1088454793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ec5ffac8-6b62-4931-a72e-344e58d32237,host='devstack@QuobyteHD#QuobyteHD',id=ec2f7a62-f304-444f-adab-e0684c561cb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e5bfb57409d46a890169dc775a95c6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:58:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:58:22Z,use_quota=True,user_id='6907e365096e42718a8750e53e710ca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a1a7f46-da06-47e8-846d-e0473dd1353e),volume_type_id=0a1a7f46-da06-47e8-846d-e0473dd1353e)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f9b32ffd-111e-4429-b5dc-09153c24582d tempest-GroupsTest-1928760915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fef89cf-de6f-4eee-b700-aaed93a08946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f9b32ffd-111e-4429-b5dc-09153c24582d tempest-GroupsTest-1928760915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fef89cf-de6f-4eee-b700-aaed93a08946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f9b32ffd-111e-4429-b5dc-09153c24582d tempest-GroupsTest-1928760915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da4ed761-dafe-421b-bbd1-91d6c9891941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f9b32ffd-111e-4429-b5dc-09153c24582d tempest-GroupsTest-1928760915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da4ed761-dafe-421b-bbd1-91d6c9891941) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec2f7a62-f304-444f-adab-e0684c561cb9', 'volume_name': 'volume-ec2f7a62-f304-444f-adab-e0684c561cb9', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f9b32ffd-111e-4429-b5dc-09153c24582d tempest-GroupsTest-1928760915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fa6a01b-1e2b-41ab-867f-46584bdd05b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f9b32ffd-111e-4429-b5dc-09153c24582d tempest-GroupsTest-1928760915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fa6a01b-1e2b-41ab-867f-46584bdd05b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f9b32ffd-111e-4429-b5dc-09153c24582d tempest-GroupsTest-1928760915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baf83f2a-2086-4eda-9831-11bb78c00164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:22 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-f9b32ffd-111e-4429-b5dc-09153c24582d tempest-GroupsTest-1928760915 None] Volume ec2f7a62-f304-444f-adab-e0684c561cb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec2f7a62-f304-444f-adab-e0684c561cb9', 'volume_size': 1} Sep 04 17:58:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f9b32ffd-111e-4429-b5dc-09153c24582d tempest-GroupsTest-1928760915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:58:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f9b32ffd-111e-4429-b5dc-09153c24582d tempest-GroupsTest-1928760915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:58:22 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f9b32ffd-111e-4429-b5dc-09153c24582d tempest-GroupsTest-1928760915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ec5ffac8-6b62-4931-a72e-344e58d32237,created_at=2026-09-04T15:58:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1088454793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ec5ffac8-6b62-4931-a72e-344e58d32237,host='devstack@QuobyteHD#QuobyteHD',id=ec2f7a62-f304-444f-adab-e0684c561cb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e5bfb57409d46a890169dc775a95c6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:58:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:58:22Z,use_quota=True,user_id='6907e365096e42718a8750e53e710ca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a1a7f46-da06-47e8-846d-e0473dd1353e),volume_type_id=0a1a7f46-da06-47e8-846d-e0473dd1353e)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:58:22 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-f9b32ffd-111e-4429-b5dc-09153c24582d tempest-GroupsTest-1928760915 None] Creating volume ec2f7a62-f304-444f-adab-e0684c561cb9 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:58:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f9b32ffd-111e-4429-b5dc-09153c24582d tempest-GroupsTest-1928760915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:58:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f9b32ffd-111e-4429-b5dc-09153c24582d tempest-GroupsTest-1928760915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:58:22 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f9b32ffd-111e-4429-b5dc-09153c24582d tempest-GroupsTest-1928760915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:58:22 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f9b32ffd-111e-4429-b5dc-09153c24582d tempest-GroupsTest-1928760915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:58:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f9b32ffd-111e-4429-b5dc-09153c24582d tempest-GroupsTest-1928760915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:58:22 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f9b32ffd-111e-4429-b5dc-09153c24582d tempest-GroupsTest-1928760915 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:58:22 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-f9b32ffd-111e-4429-b5dc-09153c24582d tempest-GroupsTest-1928760915 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:58:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f9b32ffd-111e-4429-b5dc-09153c24582d tempest-GroupsTest-1928760915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ec2f7a62-f304-444f-adab-e0684c561cb9 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:22 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaaa07b7-d468-4cca-b083-3ece2b285a76]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:58:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1bd9a2e2-17fd-4cca-a941-236a62fc498f tempest-VolumesDeleteCascade-1318752930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:22 devstack sudo[98426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ec2f7a62-f304-444f-adab-e0684c561cb9 1073741824 Sep 04 17:58:22 devstack sudo[98426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:22 devstack sudo[98427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f Sep 04 17:58:22 devstack sudo[98427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:22 devstack sudo[98426]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f9b32ffd-111e-4429-b5dc-09153c24582d tempest-GroupsTest-1928760915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ec2f7a62-f304-444f-adab-e0684c561cb9 1073741824" returned: 0 in 0.502s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f9b32ffd-111e-4429-b5dc-09153c24582d tempest-GroupsTest-1928760915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ec2f7a62-f304-444f-adab-e0684c561cb9 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:22 devstack sudo[98427]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:22 devstack sudo[98437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ec2f7a62-f304-444f-adab-e0684c561cb9 Sep 04 17:58:22 devstack sudo[98437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1bd9a2e2-17fd-4cca-a941-236a62fc498f tempest-VolumesDeleteCascade-1318752930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f" returned: 0 in 0.561s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1bd9a2e2-17fd-4cca-a941-236a62fc498f tempest-VolumesDeleteCascade-1318752930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f.95b266e1-bab7-408e-9ffa-c743a509d664 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:22 devstack sudo[98439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f.95b266e1-bab7-408e-9ffa-c743a509d664 Sep 04 17:58:22 devstack sudo[98439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:22 devstack sudo[98437]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f9b32ffd-111e-4429-b5dc-09153c24582d tempest-GroupsTest-1928760915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ec2f7a62-f304-444f-adab-e0684c561cb9" returned: 0 in 0.266s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:22 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f9b32ffd-111e-4429-b5dc-09153c24582d tempest-GroupsTest-1928760915 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:58:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f9b32ffd-111e-4429-b5dc-09153c24582d tempest-GroupsTest-1928760915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:58:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f9b32ffd-111e-4429-b5dc-09153c24582d tempest-GroupsTest-1928760915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baf83f2a-2086-4eda-9831-11bb78c00164) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec2f7a62-f304-444f-adab-e0684c561cb9', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f9b32ffd-111e-4429-b5dc-09153c24582d tempest-GroupsTest-1928760915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9511e6ac-28c2-4543-8b93-b1fa644af35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:23 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-f9b32ffd-111e-4429-b5dc-09153c24582d tempest-GroupsTest-1928760915 None] Volume volume-ec2f7a62-f304-444f-adab-e0684c561cb9 (ec2f7a62-f304-444f-adab-e0684c561cb9): created successfully Sep 04 17:58:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f9b32ffd-111e-4429-b5dc-09153c24582d tempest-GroupsTest-1928760915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9511e6ac-28c2-4543-8b93-b1fa644af35f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f9b32ffd-111e-4429-b5dc-09153c24582d tempest-GroupsTest-1928760915 None] Flow 'volume_create_manager' (fedb573c-7a4a-468a-8417-d32386902d87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:58:23 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-f9b32ffd-111e-4429-b5dc-09153c24582d tempest-GroupsTest-1928760915 None] Created volume successfully. Sep 04 17:58:23 devstack sudo[98439]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1bd9a2e2-17fd-4cca-a941-236a62fc498f tempest-VolumesDeleteCascade-1318752930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f.95b266e1-bab7-408e-9ffa-c743a509d664" returned: 0 in 0.398s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1bd9a2e2-17fd-4cca-a941-236a62fc498f tempest-VolumesDeleteCascade-1318752930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f.95b266e1-bab7-408e-9ffa-c743a509d664 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:23 devstack sudo[98446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f.95b266e1-bab7-408e-9ffa-c743a509d664 Sep 04 17:58:23 devstack sudo[98446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:23 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-03df7604-7f02-4063-8c7d-f6d03b6e27ab tempest-GroupsTest-1928760915 None] Update group completed successfully. Sep 04 17:58:23 devstack sudo[98446]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1bd9a2e2-17fd-4cca-a941-236a62fc498f tempest-VolumesDeleteCascade-1318752930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f.95b266e1-bab7-408e-9ffa-c743a509d664" returned: 0 in 0.283s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:23 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-1bd9a2e2-17fd-4cca-a941-236a62fc498f tempest-VolumesDeleteCascade-1318752930 None] Lock "cinder-quobyte-95b266e1-bab7-408e-9ffa-c743a509d664" released by "_delete_snapshot" :: held 1.943s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:58:23 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-1bd9a2e2-17fd-4cca-a941-236a62fc498f tempest-VolumesDeleteCascade-1318752930 None] Lock "cinder-quobyte-f32aa6f2-6fae-45d8-9c78-f28599e8c34f" released by "delete_snapshot" :: held 1.982s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:58:23 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-1bd9a2e2-17fd-4cca-a941-236a62fc498f tempest-VolumesDeleteCascade-1318752930 None] Created reservations ['37fb1e56-8ef0-4810-a7bb-3158a29e6a42', '75fde3af-158f-4baf-8344-08f0fa6b5fd5', '27538569-fa85-4a5b-a3d7-991ef7e30c37', '9dbc0448-b180-439b-b6b0-a4f4c3e47862'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:58:23 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-1bd9a2e2-17fd-4cca-a941-236a62fc498f tempest-VolumesDeleteCascade-1318752930 None] Delete snapshot completed successfully. Sep 04 17:58:23 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-1bd9a2e2-17fd-4cca-a941-236a62fc498f tempest-VolumesDeleteCascade-1318752930 None] Lock "cinder-95b266e1-bab7-408e-9ffa-c743a509d664-delete_snapshot" released by "delete_snapshot" :: held 2.215s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:58:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1bd9a2e2-17fd-4cca-a941-236a62fc498f tempest-VolumesDeleteCascade-1318752930 None] Snapshots deleted, issuing volume delete {{(pid=87314) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 04 17:58:23 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-1bd9a2e2-17fd-4cca-a941-236a62fc498f tempest-VolumesDeleteCascade-1318752930 None] Acquiring lock "cinder-quobyte-f32aa6f2-6fae-45d8-9c78-f28599e8c34f" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:58:23 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-1bd9a2e2-17fd-4cca-a941-236a62fc498f tempest-VolumesDeleteCascade-1318752930 None] Lock "cinder-quobyte-f32aa6f2-6fae-45d8-9c78-f28599e8c34f" acquired by "delete_volume" :: waited 0.019s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:58:23 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73d0fe9-06e9-4f40-9a13-e3f22882928c]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:58:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1bd9a2e2-17fd-4cca-a941-236a62fc498f tempest-VolumesDeleteCascade-1318752930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:23 devstack sudo[98450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f Sep 04 17:58:23 devstack sudo[98450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:24 devstack sudo[98450]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1bd9a2e2-17fd-4cca-a941-236a62fc498f tempest-VolumesDeleteCascade-1318752930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f" returned: 0 in 0.368s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1bd9a2e2-17fd-4cca-a941-236a62fc498f tempest-VolumesDeleteCascade-1318752930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:24 devstack sudo[98456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f Sep 04 17:58:24 devstack sudo[98456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:24 devstack sudo[98456]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1bd9a2e2-17fd-4cca-a941-236a62fc498f tempest-VolumesDeleteCascade-1318752930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f32aa6f2-6fae-45d8-9c78-f28599e8c34f" returned: 0 in 0.242s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:24 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-1bd9a2e2-17fd-4cca-a941-236a62fc498f tempest-VolumesDeleteCascade-1318752930 None] Lock "cinder-quobyte-f32aa6f2-6fae-45d8-9c78-f28599e8c34f" released by "delete_volume" :: held 0.674s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:58:24 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-1bd9a2e2-17fd-4cca-a941-236a62fc498f tempest-VolumesDeleteCascade-1318752930 None] Created reservations ['dfcd2830-ffc9-4890-9835-ede1a1fa3e75', '05a13c43-ac7c-4b59-bb95-6a216154dfd4', '50c408dd-046f-4e95-bfa4-52accf43b1a9', '3820c41c-a33d-401c-abc7-731e69a76d43'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:58:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1bd9a2e2-17fd-4cca-a941-236a62fc498f tempest-VolumesDeleteCascade-1318752930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:58:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1bd9a2e2-17fd-4cca-a941-236a62fc498f tempest-VolumesDeleteCascade-1318752930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:58:24 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-1bd9a2e2-17fd-4cca-a941-236a62fc498f tempest-VolumesDeleteCascade-1318752930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:58:24 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-1bd9a2e2-17fd-4cca-a941-236a62fc498f tempest-VolumesDeleteCascade-1318752930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:58:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1bd9a2e2-17fd-4cca-a941-236a62fc498f tempest-VolumesDeleteCascade-1318752930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:58:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1bd9a2e2-17fd-4cca-a941-236a62fc498f tempest-VolumesDeleteCascade-1318752930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:24 devstack sudo[98459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:58:24 devstack sudo[98459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:24 devstack sudo[98459]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1bd9a2e2-17fd-4cca-a941-236a62fc498f tempest-VolumesDeleteCascade-1318752930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.276s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:24 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-1bd9a2e2-17fd-4cca-a941-236a62fc498f tempest-VolumesDeleteCascade-1318752930 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:58:24 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-1bd9a2e2-17fd-4cca-a941-236a62fc498f tempest-VolumesDeleteCascade-1318752930 None] Deleted volume successfully. Sep 04 17:58:24 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-1bd9a2e2-17fd-4cca-a941-236a62fc498f tempest-VolumesDeleteCascade-1318752930 None] Lock "cinder-f32aa6f2-6fae-45d8-9c78-f28599e8c34f-delete_volume" released by "delete_volume" :: held 3.465s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:58:24 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-daaa80fe-66f9-44e0-ae37-c9264c887cb9 tempest-GroupsTest-1928760915 None] Update group completed successfully. Sep 04 17:58:24 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-722f0e5c-1a72-4c0d-98d9-a135c30052ca tempest-VolumesDeleteCascade-1318752930 None] Acquiring lock "cinder-3938382c-9498-4d37-8ee2-c516cb89f4dc-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:58:24 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-722f0e5c-1a72-4c0d-98d9-a135c30052ca tempest-VolumesDeleteCascade-1318752930 None] Lock "cinder-3938382c-9498-4d37-8ee2-c516cb89f4dc-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:58:24 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-722f0e5c-1a72-4c0d-98d9-a135c30052ca tempest-VolumesDeleteCascade-1318752930 None] Acquiring lock "cinder-quobyte-3938382c-9498-4d37-8ee2-c516cb89f4dc" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:58:24 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-722f0e5c-1a72-4c0d-98d9-a135c30052ca tempest-VolumesDeleteCascade-1318752930 None] Lock "cinder-quobyte-3938382c-9498-4d37-8ee2-c516cb89f4dc" acquired by "delete_volume" :: waited 0.024s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:58:24 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[941817b3-2987-4502-a308-84bc597a30af]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:58:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-722f0e5c-1a72-4c0d-98d9-a135c30052ca tempest-VolumesDeleteCascade-1318752930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3938382c-9498-4d37-8ee2-c516cb89f4dc {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:25 devstack sudo[98462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3938382c-9498-4d37-8ee2-c516cb89f4dc Sep 04 17:58:25 devstack sudo[98462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:25 devstack sudo[98462]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-722f0e5c-1a72-4c0d-98d9-a135c30052ca tempest-VolumesDeleteCascade-1318752930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3938382c-9498-4d37-8ee2-c516cb89f4dc" returned: 0 in 0.396s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-722f0e5c-1a72-4c0d-98d9-a135c30052ca tempest-VolumesDeleteCascade-1318752930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3938382c-9498-4d37-8ee2-c516cb89f4dc {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:25 devstack sudo[98468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3938382c-9498-4d37-8ee2-c516cb89f4dc Sep 04 17:58:25 devstack sudo[98468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:25 devstack sudo[98468]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-722f0e5c-1a72-4c0d-98d9-a135c30052ca tempest-VolumesDeleteCascade-1318752930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3938382c-9498-4d37-8ee2-c516cb89f4dc" returned: 0 in 0.271s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:25 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-722f0e5c-1a72-4c0d-98d9-a135c30052ca tempest-VolumesDeleteCascade-1318752930 None] Lock "cinder-quobyte-3938382c-9498-4d37-8ee2-c516cb89f4dc" released by "delete_volume" :: held 0.707s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:58:25 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-722f0e5c-1a72-4c0d-98d9-a135c30052ca tempest-VolumesDeleteCascade-1318752930 None] Created reservations ['1aa599bf-5bf2-4d86-ade2-52786f9d9b3c', 'daeb9dd0-636d-4b8d-bb74-c958c1540abf', '88a74861-ec2e-4bee-a9fd-2f024088d86c', '006d65f0-c6a1-4bdd-9418-2967f7be787f'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:58:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-722f0e5c-1a72-4c0d-98d9-a135c30052ca tempest-VolumesDeleteCascade-1318752930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:58:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-722f0e5c-1a72-4c0d-98d9-a135c30052ca tempest-VolumesDeleteCascade-1318752930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:58:25 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-722f0e5c-1a72-4c0d-98d9-a135c30052ca tempest-VolumesDeleteCascade-1318752930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:58:25 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-722f0e5c-1a72-4c0d-98d9-a135c30052ca tempest-VolumesDeleteCascade-1318752930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:58:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-722f0e5c-1a72-4c0d-98d9-a135c30052ca tempest-VolumesDeleteCascade-1318752930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:58:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-722f0e5c-1a72-4c0d-98d9-a135c30052ca tempest-VolumesDeleteCascade-1318752930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:25 devstack sudo[98471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:58:25 devstack sudo[98471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:26 devstack sudo[98471]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-722f0e5c-1a72-4c0d-98d9-a135c30052ca tempest-VolumesDeleteCascade-1318752930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.278s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:26 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-722f0e5c-1a72-4c0d-98d9-a135c30052ca tempest-VolumesDeleteCascade-1318752930 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:58:26 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-722f0e5c-1a72-4c0d-98d9-a135c30052ca tempest-VolumesDeleteCascade-1318752930 None] Deleted volume successfully. Sep 04 17:58:26 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-722f0e5c-1a72-4c0d-98d9-a135c30052ca tempest-VolumesDeleteCascade-1318752930 None] Lock "cinder-3938382c-9498-4d37-8ee2-c516cb89f4dc-delete_volume" released by "delete_volume" :: held 1.226s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:58:26 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5ae79507-b360-4fbf-a8c3-373e67f81d68 tempest-GroupsTest-1928760915 None] Acquiring lock "cinder-quobyte-186e31b8-577e-4d1b-950f-624195a45a4a" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:58:26 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5ae79507-b360-4fbf-a8c3-373e67f81d68 tempest-GroupsTest-1928760915 None] Lock "cinder-quobyte-186e31b8-577e-4d1b-950f-624195a45a4a" acquired by "delete_volume" :: waited 0.022s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:58:26 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e0cd51-5bb5-4a3c-bf18-91735e3eaeca]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:58:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5ae79507-b360-4fbf-a8c3-373e67f81d68 tempest-GroupsTest-1928760915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-186e31b8-577e-4d1b-950f-624195a45a4a {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:26 devstack sudo[98474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-186e31b8-577e-4d1b-950f-624195a45a4a Sep 04 17:58:26 devstack sudo[98474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:27 devstack sudo[98474]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5ae79507-b360-4fbf-a8c3-373e67f81d68 tempest-GroupsTest-1928760915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-186e31b8-577e-4d1b-950f-624195a45a4a" returned: 0 in 0.404s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5ae79507-b360-4fbf-a8c3-373e67f81d68 tempest-GroupsTest-1928760915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-186e31b8-577e-4d1b-950f-624195a45a4a {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:27 devstack sudo[98479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-186e31b8-577e-4d1b-950f-624195a45a4a Sep 04 17:58:27 devstack sudo[98479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:27 devstack sudo[98479]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5ae79507-b360-4fbf-a8c3-373e67f81d68 tempest-GroupsTest-1928760915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-186e31b8-577e-4d1b-950f-624195a45a4a" returned: 0 in 0.271s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:27 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5ae79507-b360-4fbf-a8c3-373e67f81d68 tempest-GroupsTest-1928760915 None] Lock "cinder-quobyte-186e31b8-577e-4d1b-950f-624195a45a4a" released by "delete_volume" :: held 0.736s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:58:27 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5ae79507-b360-4fbf-a8c3-373e67f81d68 tempest-GroupsTest-1928760915 None] Acquiring lock "cinder-quobyte-ec2f7a62-f304-444f-adab-e0684c561cb9" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:58:27 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5ae79507-b360-4fbf-a8c3-373e67f81d68 tempest-GroupsTest-1928760915 None] Lock "cinder-quobyte-ec2f7a62-f304-444f-adab-e0684c561cb9" acquired by "delete_volume" :: waited 0.068s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:58:27 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e063a1d-c071-4431-8772-c44255160b9a]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:58:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5ae79507-b360-4fbf-a8c3-373e67f81d68 tempest-GroupsTest-1928760915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ec2f7a62-f304-444f-adab-e0684c561cb9 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:27 devstack sudo[98482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ec2f7a62-f304-444f-adab-e0684c561cb9 Sep 04 17:58:27 devstack sudo[98482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:27 devstack sudo[98482]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5ae79507-b360-4fbf-a8c3-373e67f81d68 tempest-GroupsTest-1928760915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ec2f7a62-f304-444f-adab-e0684c561cb9" returned: 0 in 0.409s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5ae79507-b360-4fbf-a8c3-373e67f81d68 tempest-GroupsTest-1928760915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ec2f7a62-f304-444f-adab-e0684c561cb9 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:27 devstack sudo[98487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ec2f7a62-f304-444f-adab-e0684c561cb9 Sep 04 17:58:27 devstack sudo[98487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:28 devstack sudo[98487]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5ae79507-b360-4fbf-a8c3-373e67f81d68 tempest-GroupsTest-1928760915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ec2f7a62-f304-444f-adab-e0684c561cb9" returned: 0 in 0.260s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:28 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5ae79507-b360-4fbf-a8c3-373e67f81d68 tempest-GroupsTest-1928760915 None] Lock "cinder-quobyte-ec2f7a62-f304-444f-adab-e0684c561cb9" released by "delete_volume" :: held 0.720s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:58:28 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-5ae79507-b360-4fbf-a8c3-373e67f81d68 tempest-GroupsTest-1928760915 None] Created reservations ['e8aea03b-758b-4fb0-9c62-db07cb33a5c6'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:58:28 devstack cinder-volume[87314]: WARNING cinder.quota [None req-5ae79507-b360-4fbf-a8c3-373e67f81d68 tempest-GroupsTest-1928760915 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1626311750 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1626311750, it is now deprecated. Please use the default quota class for default quota. Sep 04 17:58:28 devstack cinder-volume[87314]: WARNING cinder.quota [None req-5ae79507-b360-4fbf-a8c3-373e67f81d68 tempest-GroupsTest-1928760915 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1626311750 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1626311750, it is now deprecated. Please use the default quota class for default quota. Sep 04 17:58:28 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-5ae79507-b360-4fbf-a8c3-373e67f81d68 tempest-GroupsTest-1928760915 None] Created reservations ['b2d9617f-ab64-4054-9144-5eb9eb55f782', 'bbab94e5-b06b-484a-8748-6f9e7f369644', 'c45b6361-89e6-448f-913d-2910587b67da', 'bc2a7ca9-58e9-4030-a4c1-fd9dbe528df1'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:58:28 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-5ae79507-b360-4fbf-a8c3-373e67f81d68 tempest-GroupsTest-1928760915 None] Created reservations ['5696e154-f3b8-440a-94b0-886722de16b5', '150baac3-e8ff-4f2a-b472-10de9bb0bb2e', '56bae884-30e2-4764-91eb-08d32f3b6d83', '24589328-04f9-4052-9dd4-765491f18a0b'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:58:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5ae79507-b360-4fbf-a8c3-373e67f81d68 tempest-GroupsTest-1928760915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:58:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5ae79507-b360-4fbf-a8c3-373e67f81d68 tempest-GroupsTest-1928760915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:58:28 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5ae79507-b360-4fbf-a8c3-373e67f81d68 tempest-GroupsTest-1928760915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:58:28 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5ae79507-b360-4fbf-a8c3-373e67f81d68 tempest-GroupsTest-1928760915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:58:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5ae79507-b360-4fbf-a8c3-373e67f81d68 tempest-GroupsTest-1928760915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:58:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5ae79507-b360-4fbf-a8c3-373e67f81d68 tempest-GroupsTest-1928760915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:28 devstack sudo[98490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:58:28 devstack sudo[98490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:28 devstack sudo[98490]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5ae79507-b360-4fbf-a8c3-373e67f81d68 tempest-GroupsTest-1928760915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.284s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:28 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-5ae79507-b360-4fbf-a8c3-373e67f81d68 tempest-GroupsTest-1928760915 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:58:28 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-5ae79507-b360-4fbf-a8c3-373e67f81d68 tempest-GroupsTest-1928760915 None] Delete group completed successfully. Sep 04 17:58:29 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-22861943-f9c4-4aa7-9f8c-ce5897114b8c tempest-VolumesExtendTest-863733137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:58:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-22861943-f9c4-4aa7-9f8c-ce5897114b8c tempest-VolumesExtendTest-863733137 None] Flow 'volume_create_manager' (10ef0f8f-bc80-44d1-a367-f7d2b8a8834c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:58:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-22861943-f9c4-4aa7-9f8c-ce5897114b8c tempest-VolumesExtendTest-863733137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17bb67ae-f3ee-42a9-87d8-523ed3482162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-22861943-f9c4-4aa7-9f8c-ce5897114b8c tempest-VolumesExtendTest-863733137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17bb67ae-f3ee-42a9-87d8-523ed3482162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:58:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1530016825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8419db82-de0e-48ec-b2ee-1e89615108f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf1576504bf545d3825ffd8f6e56e5d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:58:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:58:30Z,use_quota=True,user_id='29f4bc05ec5045249f40041294985484',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-22861943-f9c4-4aa7-9f8c-ce5897114b8c tempest-VolumesExtendTest-863733137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6203a075-f1e4-4fee-86b9-ad01ed33b503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-22861943-f9c4-4aa7-9f8c-ce5897114b8c tempest-VolumesExtendTest-863733137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6203a075-f1e4-4fee-86b9-ad01ed33b503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-22861943-f9c4-4aa7-9f8c-ce5897114b8c tempest-VolumesExtendTest-863733137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (424c6fb4-2254-4e21-900b-7082fc153385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:29 devstack cinder-volume[87314]: DEBUG cinder.image.glance [None req-22861943-f9c4-4aa7-9f8c-ce5897114b8c tempest-VolumesExtendTest-863733137 None] Creating Keystone auth plugin from conf {{(pid=87314) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 04 17:58:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-22861943-f9c4-4aa7-9f8c-ce5897114b8c tempest-VolumesExtendTest-863733137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (424c6fb4-2254-4e21-900b-7082fc153385) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8419db82-de0e-48ec-b2ee-1e89615108f3', 'volume_name': 'volume-8419db82-de0e-48ec-b2ee-1e89615108f3', 'volume_size': 1, 'image_id': 'eeb1e1b9-f612-4acd-9439-6285840a52d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eeb1e1b9-f612-4acd-9439-6285840a52d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'be7dacacfc0f482c9fff51cfcb1c78e5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eeb1e1b9-f612-4acd-9439-6285840a52d1', 'created_at': datetime.datetime(2026, 9, 4, 15, 43, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 15, 43, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eeb1e1b9-f612-4acd-9439-6285840a52d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-22861943-f9c4-4aa7-9f8c-ce5897114b8c tempest-VolumesExtendTest-863733137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41ee5f26-c7b9-48d7-a312-e60fbff7c1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-22861943-f9c4-4aa7-9f8c-ce5897114b8c tempest-VolumesExtendTest-863733137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41ee5f26-c7b9-48d7-a312-e60fbff7c1a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-22861943-f9c4-4aa7-9f8c-ce5897114b8c tempest-VolumesExtendTest-863733137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (027d2a53-5833-45cc-8528-0b985e685d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:30 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-22861943-f9c4-4aa7-9f8c-ce5897114b8c tempest-VolumesExtendTest-863733137 None] Volume 8419db82-de0e-48ec-b2ee-1e89615108f3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8419db82-de0e-48ec-b2ee-1e89615108f3', 'volume_size': 1, 'image_id': 'eeb1e1b9-f612-4acd-9439-6285840a52d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eeb1e1b9-f612-4acd-9439-6285840a52d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'be7dacacfc0f482c9fff51cfcb1c78e5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eeb1e1b9-f612-4acd-9439-6285840a52d1', 'created_at': datetime.datetime(2026, 9, 4, 15, 43, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 15, 43, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eeb1e1b9-f612-4acd-9439-6285840a52d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 04 17:58:30 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-22861943-f9c4-4aa7-9f8c-ce5897114b8c tempest-VolumesExtendTest-863733137 None] Trying to clone 8419db82-de0e-48ec-b2ee-1e89615108f3 from image eeb1e1b9-f612-4acd-9439-6285840a52d1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/eeb1e1b9-f612-4acd-9439-6285840a52d1', 'metadata': {}}]). {{(pid=87314) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 04 17:58:30 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-22861943-f9c4-4aa7-9f8c-ce5897114b8c tempest-VolumesExtendTest-863733137 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1_24ww5oyvdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87314) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 04 17:58:30 devstack cinder-volume[87314]: INFO cinder.image.image_utils [None req-22861943-f9c4-4aa7-9f8c-ce5897114b8c tempest-VolumesExtendTest-863733137 None] Image download 20.69 MB at 20.69 MB/s Sep 04 17:58:30 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6769481-369b-4767-9f90-dda63daa8952]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:58:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-22861943-f9c4-4aa7-9f8c-ce5897114b8c tempest-VolumesExtendTest-863733137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1_24ww5oyvdevstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:31 devstack sudo[98494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1_24ww5oyvdevstack@QuobyteHD Sep 04 17:58:31 devstack sudo[98494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:31 devstack sudo[98494]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-22861943-f9c4-4aa7-9f8c-ce5897114b8c tempest-VolumesExtendTest-863733137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1_24ww5oyvdevstack@QuobyteHD" returned: 0 in 0.366s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:31 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-22861943-f9c4-4aa7-9f8c-ce5897114b8c tempest-VolumesExtendTest-863733137 None] Temporary image eeb1e1b9-f612-4acd-9439-6285840a52d1 is fetched for user 29f4bc05ec5045249f40041294985484. {{(pid=87314) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 04 17:58:31 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[788dc521-912a-42f2-8246-84d32b74f728]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:58:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-22861943-f9c4-4aa7-9f8c-ce5897114b8c tempest-VolumesExtendTest-863733137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1_24ww5oyvdevstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:31 devstack sudo[98499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1_24ww5oyvdevstack@QuobyteHD Sep 04 17:58:31 devstack sudo[98499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:31 devstack sudo[98499]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-22861943-f9c4-4aa7-9f8c-ce5897114b8c tempest-VolumesExtendTest-863733137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1_24ww5oyvdevstack@QuobyteHD" returned: 0 in 0.338s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-22861943-f9c4-4aa7-9f8c-ce5897114b8c tempest-VolumesExtendTest-863733137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:58:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-22861943-f9c4-4aa7-9f8c-ce5897114b8c tempest-VolumesExtendTest-863733137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:58:31 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-22861943-f9c4-4aa7-9f8c-ce5897114b8c tempest-VolumesExtendTest-863733137 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:58:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1530016825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8419db82-de0e-48ec-b2ee-1e89615108f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf1576504bf545d3825ffd8f6e56e5d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:58:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:58:30Z,use_quota=True,user_id='29f4bc05ec5045249f40041294985484',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:58:31 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-22861943-f9c4-4aa7-9f8c-ce5897114b8c tempest-VolumesExtendTest-863733137 None] Creating volume 8419db82-de0e-48ec-b2ee-1e89615108f3 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:58:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-22861943-f9c4-4aa7-9f8c-ce5897114b8c tempest-VolumesExtendTest-863733137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:58:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-22861943-f9c4-4aa7-9f8c-ce5897114b8c tempest-VolumesExtendTest-863733137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:58:31 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-22861943-f9c4-4aa7-9f8c-ce5897114b8c tempest-VolumesExtendTest-863733137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:58:31 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-22861943-f9c4-4aa7-9f8c-ce5897114b8c tempest-VolumesExtendTest-863733137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:58:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-22861943-f9c4-4aa7-9f8c-ce5897114b8c tempest-VolumesExtendTest-863733137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:58:31 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-22861943-f9c4-4aa7-9f8c-ce5897114b8c tempest-VolumesExtendTest-863733137 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:58:31 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-22861943-f9c4-4aa7-9f8c-ce5897114b8c tempest-VolumesExtendTest-863733137 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:58:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-22861943-f9c4-4aa7-9f8c-ce5897114b8c tempest-VolumesExtendTest-863733137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8419db82-de0e-48ec-b2ee-1e89615108f3 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:31 devstack sudo[98504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8419db82-de0e-48ec-b2ee-1e89615108f3 1073741824 Sep 04 17:58:31 devstack sudo[98504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:32 devstack sudo[98504]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-22861943-f9c4-4aa7-9f8c-ce5897114b8c tempest-VolumesExtendTest-863733137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8419db82-de0e-48ec-b2ee-1e89615108f3 1073741824" returned: 0 in 0.425s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-22861943-f9c4-4aa7-9f8c-ce5897114b8c tempest-VolumesExtendTest-863733137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8419db82-de0e-48ec-b2ee-1e89615108f3 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:32 devstack sudo[98510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8419db82-de0e-48ec-b2ee-1e89615108f3 Sep 04 17:58:32 devstack sudo[98510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:32 devstack sudo[98510]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-22861943-f9c4-4aa7-9f8c-ce5897114b8c tempest-VolumesExtendTest-863733137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8419db82-de0e-48ec-b2ee-1e89615108f3" returned: 0 in 0.273s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:32 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-22861943-f9c4-4aa7-9f8c-ce5897114b8c tempest-VolumesExtendTest-863733137 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:58:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-22861943-f9c4-4aa7-9f8c-ce5897114b8c tempest-VolumesExtendTest-863733137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:58:32 devstack cinder-volume[87314]: DEBUG cinder.volume.volume_utils [None req-22861943-f9c4-4aa7-9f8c-ce5897114b8c tempest-VolumesExtendTest-863733137 None] Attempting download of eeb1e1b9-f612-4acd-9439-6285840a52d1 ((None, [{'url': 'file:///opt/stack/data/glance/images/eeb1e1b9-f612-4acd-9439-6285840a52d1', 'metadata': {}}])) to volume 8419db82-de0e-48ec-b2ee-1e89615108f3. {{(pid=87314) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 04 17:58:32 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec725468-13cb-4e9a-a887-8687cd276e58]: (4, 'raw') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:58:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-22861943-f9c4-4aa7-9f8c-ce5897114b8c tempest-VolumesExtendTest-863733137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eeb1e1b9-f612-4acd-9439-6285840a52d1_2no8ut8h {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:32 devstack sudo[98513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eeb1e1b9-f612-4acd-9439-6285840a52d1_2no8ut8h Sep 04 17:58:32 devstack sudo[98513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:32 devstack sudo[98513]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-22861943-f9c4-4aa7-9f8c-ce5897114b8c tempest-VolumesExtendTest-863733137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eeb1e1b9-f612-4acd-9439-6285840a52d1_2no8ut8h" returned: 0 in 0.337s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-22861943-f9c4-4aa7-9f8c-ce5897114b8c tempest-VolumesExtendTest-863733137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eeb1e1b9-f612-4acd-9439-6285840a52d1_2no8ut8h {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:33 devstack sudo[98517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eeb1e1b9-f612-4acd-9439-6285840a52d1_2no8ut8h Sep 04 17:58:33 devstack sudo[98517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:33 devstack sudo[98517]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-22861943-f9c4-4aa7-9f8c-ce5897114b8c tempest-VolumesExtendTest-863733137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eeb1e1b9-f612-4acd-9439-6285840a52d1_2no8ut8h" returned: 1 in 0.385s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-22861943-f9c4-4aa7-9f8c-ce5897114b8c tempest-VolumesExtendTest-863733137 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eeb1e1b9-f612-4acd-9439-6285840a52d1_2no8ut8h' failed. Not Retrying. {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 17:58:33 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e62ffeb-614f-431b-9929-ad65e59b9821]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:58:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-22861943-f9c4-4aa7-9f8c-ce5897114b8c tempest-VolumesExtendTest-863733137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1_24ww5oyvdevstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:33 devstack sudo[98521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1_24ww5oyvdevstack@QuobyteHD Sep 04 17:58:33 devstack sudo[98521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:33 devstack sudo[98521]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-22861943-f9c4-4aa7-9f8c-ce5897114b8c tempest-VolumesExtendTest-863733137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1_24ww5oyvdevstack@QuobyteHD" returned: 0 in 0.372s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:33 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-22861943-f9c4-4aa7-9f8c-ce5897114b8c tempest-VolumesExtendTest-863733137 None] eeb1e1b9-f612-4acd-9439-6285840a52d1 was qcow2, converting to qcow2 {{(pid=87314) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 04 17:58:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-22861943-f9c4-4aa7-9f8c-ce5897114b8c tempest-VolumesExtendTest-863733137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1_24ww5oyvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8419db82-de0e-48ec-b2ee-1e89615108f3 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:33 devstack sudo[98527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1_24ww5oyvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8419db82-de0e-48ec-b2ee-1e89615108f3 Sep 04 17:58:33 devstack sudo[98527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:35 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cd26c6f-59c9-40d3-8680-2dcaa9ba4885 tempest-VolumeRetypeWithoutMigrationTest-1360919436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:58:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7cd26c6f-59c9-40d3-8680-2dcaa9ba4885 tempest-VolumeRetypeWithoutMigrationTest-1360919436 None] Flow 'volume_create_manager' (945dbccf-972a-484c-acd4-179b78792e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:58:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7cd26c6f-59c9-40d3-8680-2dcaa9ba4885 tempest-VolumeRetypeWithoutMigrationTest-1360919436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c7ca133-30bb-490a-84fd-2384b9a40684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7cd26c6f-59c9-40d3-8680-2dcaa9ba4885 tempest-VolumeRetypeWithoutMigrationTest-1360919436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c7ca133-30bb-490a-84fd-2384b9a40684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:58:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1185094205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5f2ec20-ffd9-4b6e-8bf6-5f02624fe6a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66cf4c9324a5441ab97829f115038696',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:58:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:58:35Z,use_quota=True,user_id='ea1ebf8409474a15a70dae3429f4270a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb11a533-22b9-4272-85e4-a30eed695f66),volume_type_id=fb11a533-22b9-4272-85e4-a30eed695f66)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7cd26c6f-59c9-40d3-8680-2dcaa9ba4885 tempest-VolumeRetypeWithoutMigrationTest-1360919436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5d735fc-c792-4605-b3a2-80db868f9229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7cd26c6f-59c9-40d3-8680-2dcaa9ba4885 tempest-VolumeRetypeWithoutMigrationTest-1360919436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5d735fc-c792-4605-b3a2-80db868f9229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7cd26c6f-59c9-40d3-8680-2dcaa9ba4885 tempest-VolumeRetypeWithoutMigrationTest-1360919436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00d2218c-a4ac-48db-961e-4a7b8c3a600a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7cd26c6f-59c9-40d3-8680-2dcaa9ba4885 tempest-VolumeRetypeWithoutMigrationTest-1360919436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00d2218c-a4ac-48db-961e-4a7b8c3a600a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5f2ec20-ffd9-4b6e-8bf6-5f02624fe6a4', 'volume_name': 'volume-e5f2ec20-ffd9-4b6e-8bf6-5f02624fe6a4', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7cd26c6f-59c9-40d3-8680-2dcaa9ba4885 tempest-VolumeRetypeWithoutMigrationTest-1360919436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d20fbd27-0e9d-4017-83f9-3c367877cfc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7cd26c6f-59c9-40d3-8680-2dcaa9ba4885 tempest-VolumeRetypeWithoutMigrationTest-1360919436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d20fbd27-0e9d-4017-83f9-3c367877cfc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7cd26c6f-59c9-40d3-8680-2dcaa9ba4885 tempest-VolumeRetypeWithoutMigrationTest-1360919436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c04f63f8-382a-4b35-afb9-552a6fec8fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:35 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-7cd26c6f-59c9-40d3-8680-2dcaa9ba4885 tempest-VolumeRetypeWithoutMigrationTest-1360919436 None] Volume e5f2ec20-ffd9-4b6e-8bf6-5f02624fe6a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5f2ec20-ffd9-4b6e-8bf6-5f02624fe6a4', 'volume_size': 1} Sep 04 17:58:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7cd26c6f-59c9-40d3-8680-2dcaa9ba4885 tempest-VolumeRetypeWithoutMigrationTest-1360919436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:58:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7cd26c6f-59c9-40d3-8680-2dcaa9ba4885 tempest-VolumeRetypeWithoutMigrationTest-1360919436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:58:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7cd26c6f-59c9-40d3-8680-2dcaa9ba4885 tempest-VolumeRetypeWithoutMigrationTest-1360919436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:58:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1185094205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5f2ec20-ffd9-4b6e-8bf6-5f02624fe6a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66cf4c9324a5441ab97829f115038696',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:58:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:58:35Z,use_quota=True,user_id='ea1ebf8409474a15a70dae3429f4270a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb11a533-22b9-4272-85e4-a30eed695f66),volume_type_id=fb11a533-22b9-4272-85e4-a30eed695f66)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:58:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-7cd26c6f-59c9-40d3-8680-2dcaa9ba4885 tempest-VolumeRetypeWithoutMigrationTest-1360919436 None] Creating volume e5f2ec20-ffd9-4b6e-8bf6-5f02624fe6a4 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:58:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7cd26c6f-59c9-40d3-8680-2dcaa9ba4885 tempest-VolumeRetypeWithoutMigrationTest-1360919436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:58:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7cd26c6f-59c9-40d3-8680-2dcaa9ba4885 tempest-VolumeRetypeWithoutMigrationTest-1360919436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:58:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7cd26c6f-59c9-40d3-8680-2dcaa9ba4885 tempest-VolumeRetypeWithoutMigrationTest-1360919436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:58:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7cd26c6f-59c9-40d3-8680-2dcaa9ba4885 tempest-VolumeRetypeWithoutMigrationTest-1360919436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:58:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7cd26c6f-59c9-40d3-8680-2dcaa9ba4885 tempest-VolumeRetypeWithoutMigrationTest-1360919436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:58:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7cd26c6f-59c9-40d3-8680-2dcaa9ba4885 tempest-VolumeRetypeWithoutMigrationTest-1360919436 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:58:35 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-7cd26c6f-59c9-40d3-8680-2dcaa9ba4885 tempest-VolumeRetypeWithoutMigrationTest-1360919436 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:58:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7cd26c6f-59c9-40d3-8680-2dcaa9ba4885 tempest-VolumeRetypeWithoutMigrationTest-1360919436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-e5f2ec20-ffd9-4b6e-8bf6-5f02624fe6a4 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:35 devstack sudo[98535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-e5f2ec20-ffd9-4b6e-8bf6-5f02624fe6a4 1073741824 Sep 04 17:58:35 devstack sudo[98535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:35 devstack sudo[98527]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-22861943-f9c4-4aa7-9f8c-ce5897114b8c tempest-VolumesExtendTest-863733137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1_24ww5oyvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8419db82-de0e-48ec-b2ee-1e89615108f3" returned: 0 in 2.054s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:35 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-22861943-f9c4-4aa7-9f8c-ce5897114b8c tempest-VolumesExtendTest-863733137 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1_24ww5oyvdevstack@QuobyteHD, size 112.00 MB, duration 2.06 sec, destination /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8419db82-de0e-48ec-b2ee-1e89615108f3 {{(pid=87314) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 17:58:35 devstack cinder-volume[87314]: INFO cinder.image.image_utils [None req-22861943-f9c4-4aa7-9f8c-ce5897114b8c tempest-VolumesExtendTest-863733137 None] Converted 112.00 MB image at 54.48 MB/s Sep 04 17:58:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-22861943-f9c4-4aa7-9f8c-ce5897114b8c tempest-VolumesExtendTest-863733137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8419db82-de0e-48ec-b2ee-1e89615108f3 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:35 devstack sudo[98541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8419db82-de0e-48ec-b2ee-1e89615108f3 1G Sep 04 17:58:35 devstack sudo[98541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:35 devstack sudo[98535]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7cd26c6f-59c9-40d3-8680-2dcaa9ba4885 tempest-VolumeRetypeWithoutMigrationTest-1360919436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-e5f2ec20-ffd9-4b6e-8bf6-5f02624fe6a4 1073741824" returned: 0 in 0.515s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7cd26c6f-59c9-40d3-8680-2dcaa9ba4885 tempest-VolumeRetypeWithoutMigrationTest-1360919436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-e5f2ec20-ffd9-4b6e-8bf6-5f02624fe6a4 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:35 devstack sudo[98543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-e5f2ec20-ffd9-4b6e-8bf6-5f02624fe6a4 Sep 04 17:58:35 devstack sudo[98543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:36 devstack sudo[98541]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-22861943-f9c4-4aa7-9f8c-ce5897114b8c tempest-VolumesExtendTest-863733137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8419db82-de0e-48ec-b2ee-1e89615108f3 1G" returned: 0 in 0.373s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:36 devstack cinder-volume[87314]: DEBUG cinder.volume.volume_utils [None req-22861943-f9c4-4aa7-9f8c-ce5897114b8c tempest-VolumesExtendTest-863733137 None] Downloaded image eeb1e1b9-f612-4acd-9439-6285840a52d1 ((None, [{'url': 'file:///opt/stack/data/glance/images/eeb1e1b9-f612-4acd-9439-6285840a52d1', 'metadata': {}}])) to volume 8419db82-de0e-48ec-b2ee-1e89615108f3 successfully. {{(pid=87314) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 04 17:58:36 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-22861943-f9c4-4aa7-9f8c-ce5897114b8c tempest-VolumesExtendTest-863733137 None] Temporary image eeb1e1b9-f612-4acd-9439-6285840a52d1 for user 29f4bc05ec5045249f40041294985484 is deleted. {{(pid=87314) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 04 17:58:36 devstack cinder-volume[87314]: DEBUG cinder.volume.volume_utils [None req-22861943-f9c4-4aa7-9f8c-ce5897114b8c tempest-VolumesExtendTest-863733137 None] Marking volume 8419db82-de0e-48ec-b2ee-1e89615108f3 as bootable. {{(pid=87314) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 04 17:58:36 devstack sudo[98543]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:36 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-22861943-f9c4-4aa7-9f8c-ce5897114b8c tempest-VolumesExtendTest-863733137 None] Copying metadata from image eeb1e1b9-f612-4acd-9439-6285840a52d1 to 8419db82-de0e-48ec-b2ee-1e89615108f3. {{(pid=87314) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 04 17:58:36 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-22861943-f9c4-4aa7-9f8c-ce5897114b8c tempest-VolumesExtendTest-863733137 None] Creating volume glance metadata for volume 8419db82-de0e-48ec-b2ee-1e89615108f3 backed by image eeb1e1b9-f612-4acd-9439-6285840a52d1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'eeb1e1b9-f612-4acd-9439-6285840a52d1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87314) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 04 17:58:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7cd26c6f-59c9-40d3-8680-2dcaa9ba4885 tempest-VolumeRetypeWithoutMigrationTest-1360919436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-e5f2ec20-ffd9-4b6e-8bf6-5f02624fe6a4" returned: 0 in 0.310s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7cd26c6f-59c9-40d3-8680-2dcaa9ba4885 tempest-VolumeRetypeWithoutMigrationTest-1360919436 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:58:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7cd26c6f-59c9-40d3-8680-2dcaa9ba4885 tempest-VolumeRetypeWithoutMigrationTest-1360919436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:58:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7cd26c6f-59c9-40d3-8680-2dcaa9ba4885 tempest-VolumeRetypeWithoutMigrationTest-1360919436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c04f63f8-382a-4b35-afb9-552a6fec8fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5f2ec20-ffd9-4b6e-8bf6-5f02624fe6a4', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7cd26c6f-59c9-40d3-8680-2dcaa9ba4885 tempest-VolumeRetypeWithoutMigrationTest-1360919436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83fa6fd0-1f75-4a09-b872-e5137d278a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:36 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-7cd26c6f-59c9-40d3-8680-2dcaa9ba4885 tempest-VolumeRetypeWithoutMigrationTest-1360919436 None] Volume volume-e5f2ec20-ffd9-4b6e-8bf6-5f02624fe6a4 (e5f2ec20-ffd9-4b6e-8bf6-5f02624fe6a4): created successfully Sep 04 17:58:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7cd26c6f-59c9-40d3-8680-2dcaa9ba4885 tempest-VolumeRetypeWithoutMigrationTest-1360919436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83fa6fd0-1f75-4a09-b872-e5137d278a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7cd26c6f-59c9-40d3-8680-2dcaa9ba4885 tempest-VolumeRetypeWithoutMigrationTest-1360919436 None] Flow 'volume_create_manager' (945dbccf-972a-484c-acd4-179b78792e25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:58:36 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-7cd26c6f-59c9-40d3-8680-2dcaa9ba4885 tempest-VolumeRetypeWithoutMigrationTest-1360919436 None] Created volume successfully. Sep 04 17:58:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-22861943-f9c4-4aa7-9f8c-ce5897114b8c tempest-VolumesExtendTest-863733137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (027d2a53-5833-45cc-8528-0b985e685d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8419db82-de0e-48ec-b2ee-1e89615108f3', 'volume_size': 1, 'image_id': 'eeb1e1b9-f612-4acd-9439-6285840a52d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eeb1e1b9-f612-4acd-9439-6285840a52d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'be7dacacfc0f482c9fff51cfcb1c78e5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eeb1e1b9-f612-4acd-9439-6285840a52d1', 'created_at': datetime.datetime(2026, 9, 4, 15, 43, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 15, 43, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eeb1e1b9-f612-4acd-9439-6285840a52d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-22861943-f9c4-4aa7-9f8c-ce5897114b8c tempest-VolumesExtendTest-863733137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ec66260-af1c-4c84-b628-4924718b046b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:36 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-22861943-f9c4-4aa7-9f8c-ce5897114b8c tempest-VolumesExtendTest-863733137 None] Volume volume-8419db82-de0e-48ec-b2ee-1e89615108f3 (8419db82-de0e-48ec-b2ee-1e89615108f3): created successfully Sep 04 17:58:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-22861943-f9c4-4aa7-9f8c-ce5897114b8c tempest-VolumesExtendTest-863733137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ec66260-af1c-4c84-b628-4924718b046b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-22861943-f9c4-4aa7-9f8c-ce5897114b8c tempest-VolumesExtendTest-863733137 None] Flow 'volume_create_manager' (10ef0f8f-bc80-44d1-a367-f7d2b8a8834c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:58:36 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-22861943-f9c4-4aa7-9f8c-ce5897114b8c tempest-VolumesExtendTest-863733137 None] Created volume successfully. Sep 04 17:58:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-682f245b-494c-43a7-a96e-7d137972f4a3 tempest-VolumesExtendTest-863733137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:58:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-682f245b-494c-43a7-a96e-7d137972f4a3 tempest-VolumesExtendTest-863733137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:58:37 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5aa8f75-5646-453f-aa63-8f84fcd16c7a]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:58:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-682f245b-494c-43a7-a96e-7d137972f4a3 tempest-VolumesExtendTest-863733137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8419db82-de0e-48ec-b2ee-1e89615108f3 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:37 devstack sudo[98549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8419db82-de0e-48ec-b2ee-1e89615108f3 Sep 04 17:58:37 devstack sudo[98549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f11c727b-be24-4b19-92de-258753ba5cbd tempest-VolumeRetypeWithoutMigrationTest-1360919436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:58:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f11c727b-be24-4b19-92de-258753ba5cbd tempest-VolumeRetypeWithoutMigrationTest-1360919436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:58:37 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f11c727b-be24-4b19-92de-258753ba5cbd tempest-VolumeRetypeWithoutMigrationTest-1360919436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:58:37 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f11c727b-be24-4b19-92de-258753ba5cbd tempest-VolumeRetypeWithoutMigrationTest-1360919436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:58:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f11c727b-be24-4b19-92de-258753ba5cbd tempest-VolumeRetypeWithoutMigrationTest-1360919436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:58:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f11c727b-be24-4b19-92de-258753ba5cbd tempest-VolumeRetypeWithoutMigrationTest-1360919436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:37 devstack sudo[98551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:58:37 devstack sudo[98551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:37 devstack sudo[98549]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-682f245b-494c-43a7-a96e-7d137972f4a3 tempest-VolumesExtendTest-863733137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8419db82-de0e-48ec-b2ee-1e89615108f3" returned: 0 in 0.420s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-682f245b-494c-43a7-a96e-7d137972f4a3 tempest-VolumesExtendTest-863733137 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8419db82-de0e-48ec-b2ee-1e89615108f3 2G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:37 devstack sudo[98551]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f11c727b-be24-4b19-92de-258753ba5cbd tempest-VolumeRetypeWithoutMigrationTest-1360919436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.282s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:37 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-f11c727b-be24-4b19-92de-258753ba5cbd tempest-VolumeRetypeWithoutMigrationTest-1360919436 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:58:37 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-f11c727b-be24-4b19-92de-258753ba5cbd tempest-VolumeRetypeWithoutMigrationTest-1360919436 None] Retype volume completed successfully. Sep 04 17:58:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-682f245b-494c-43a7-a96e-7d137972f4a3 tempest-VolumesExtendTest-863733137 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8419db82-de0e-48ec-b2ee-1e89615108f3 2G" returned: 0 in 0.110s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-682f245b-494c-43a7-a96e-7d137972f4a3 tempest-VolumesExtendTest-863733137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.560s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:58:38 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-682f245b-494c-43a7-a96e-7d137972f4a3 tempest-VolumesExtendTest-863733137 None] Extend volume completed successfully. Sep 04 17:58:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0a8d1e3e-2fb6-496b-be5d-e877d6550023 tempest-VolumesExtendTest-863733137 None] Acquiring lock "cinder-8419db82-de0e-48ec-b2ee-1e89615108f3-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:58:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0a8d1e3e-2fb6-496b-be5d-e877d6550023 tempest-VolumesExtendTest-863733137 None] Lock "cinder-8419db82-de0e-48ec-b2ee-1e89615108f3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:58:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0a8d1e3e-2fb6-496b-be5d-e877d6550023 tempest-VolumesExtendTest-863733137 None] Acquiring lock "cinder-quobyte-8419db82-de0e-48ec-b2ee-1e89615108f3" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:58:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0a8d1e3e-2fb6-496b-be5d-e877d6550023 tempest-VolumesExtendTest-863733137 None] Lock "cinder-quobyte-8419db82-de0e-48ec-b2ee-1e89615108f3" acquired by "delete_volume" :: waited 0.019s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:58:38 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f552ca3-5df2-4a88-8ade-db86051b66a3]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:58:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0a8d1e3e-2fb6-496b-be5d-e877d6550023 tempest-VolumesExtendTest-863733137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8419db82-de0e-48ec-b2ee-1e89615108f3 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:38 devstack sudo[98560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8419db82-de0e-48ec-b2ee-1e89615108f3 Sep 04 17:58:38 devstack sudo[98560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-58e3e49a-1876-442f-8035-948fbd76f3ac tempest-VolumeRetypeWithoutMigrationTest-1360919436 None] Acquiring lock "cinder-e5f2ec20-ffd9-4b6e-8bf6-5f02624fe6a4-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:58:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-58e3e49a-1876-442f-8035-948fbd76f3ac tempest-VolumeRetypeWithoutMigrationTest-1360919436 None] Lock "cinder-e5f2ec20-ffd9-4b6e-8bf6-5f02624fe6a4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:58:39 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:UPDATE=185,cinder:SELECT=165,cinder:DELETE=7,cinder:INSERT=51 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 17:58:39 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-58e3e49a-1876-442f-8035-948fbd76f3ac tempest-VolumeRetypeWithoutMigrationTest-1360919436 None] Acquiring lock "cinder-quobyte-e5f2ec20-ffd9-4b6e-8bf6-5f02624fe6a4" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:58:39 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-58e3e49a-1876-442f-8035-948fbd76f3ac tempest-VolumeRetypeWithoutMigrationTest-1360919436 None] Lock "cinder-quobyte-e5f2ec20-ffd9-4b6e-8bf6-5f02624fe6a4" acquired by "delete_volume" :: waited 0.027s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:58:39 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[7796710c-6364-4bb1-a0f7-c16ecbb94e05]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:58:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-58e3e49a-1876-442f-8035-948fbd76f3ac tempest-VolumeRetypeWithoutMigrationTest-1360919436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-e5f2ec20-ffd9-4b6e-8bf6-5f02624fe6a4 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:39 devstack sudo[98562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-e5f2ec20-ffd9-4b6e-8bf6-5f02624fe6a4 Sep 04 17:58:39 devstack sudo[98562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:39 devstack sudo[98560]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0a8d1e3e-2fb6-496b-be5d-e877d6550023 tempest-VolumesExtendTest-863733137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8419db82-de0e-48ec-b2ee-1e89615108f3" returned: 0 in 0.426s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0a8d1e3e-2fb6-496b-be5d-e877d6550023 tempest-VolumesExtendTest-863733137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8419db82-de0e-48ec-b2ee-1e89615108f3 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:39 devstack sudo[98567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8419db82-de0e-48ec-b2ee-1e89615108f3 Sep 04 17:58:39 devstack sudo[98567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:39 devstack sudo[98562]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-58e3e49a-1876-442f-8035-948fbd76f3ac tempest-VolumeRetypeWithoutMigrationTest-1360919436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-e5f2ec20-ffd9-4b6e-8bf6-5f02624fe6a4" returned: 0 in 0.386s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-58e3e49a-1876-442f-8035-948fbd76f3ac tempest-VolumeRetypeWithoutMigrationTest-1360919436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-e5f2ec20-ffd9-4b6e-8bf6-5f02624fe6a4 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:39 devstack sudo[98573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-e5f2ec20-ffd9-4b6e-8bf6-5f02624fe6a4 Sep 04 17:58:39 devstack sudo[98573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:39 devstack sudo[98567]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0a8d1e3e-2fb6-496b-be5d-e877d6550023 tempest-VolumesExtendTest-863733137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8419db82-de0e-48ec-b2ee-1e89615108f3" returned: 0 in 0.258s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:39 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0a8d1e3e-2fb6-496b-be5d-e877d6550023 tempest-VolumesExtendTest-863733137 None] Lock "cinder-quobyte-8419db82-de0e-48ec-b2ee-1e89615108f3" released by "delete_volume" :: held 0.743s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:58:39 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:UPDATE=179,cinder:SELECT=175,cinder:INSERT=39,cinder:DELETE=11 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 17:58:39 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-0a8d1e3e-2fb6-496b-be5d-e877d6550023 tempest-VolumesExtendTest-863733137 None] Created reservations ['66cefeef-90b8-44ae-ac54-0d47afc90f24', 'd62c927d-48d6-4c45-a815-b1a4d14412b6', '4a7dd43d-aeb1-48db-85ae-24baa2fd2ad2', '2304cc7b-4cc4-40a3-b100-8e6c1b026380'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:58:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0a8d1e3e-2fb6-496b-be5d-e877d6550023 tempest-VolumesExtendTest-863733137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:58:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0a8d1e3e-2fb6-496b-be5d-e877d6550023 tempest-VolumesExtendTest-863733137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:58:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0a8d1e3e-2fb6-496b-be5d-e877d6550023 tempest-VolumesExtendTest-863733137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:58:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0a8d1e3e-2fb6-496b-be5d-e877d6550023 tempest-VolumesExtendTest-863733137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:58:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0a8d1e3e-2fb6-496b-be5d-e877d6550023 tempest-VolumesExtendTest-863733137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:58:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0a8d1e3e-2fb6-496b-be5d-e877d6550023 tempest-VolumesExtendTest-863733137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:39 devstack sudo[98575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:58:39 devstack sudo[98575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:39 devstack sudo[98573]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-58e3e49a-1876-442f-8035-948fbd76f3ac tempest-VolumeRetypeWithoutMigrationTest-1360919436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-e5f2ec20-ffd9-4b6e-8bf6-5f02624fe6a4" returned: 0 in 0.274s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:39 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-58e3e49a-1876-442f-8035-948fbd76f3ac tempest-VolumeRetypeWithoutMigrationTest-1360919436 None] Lock "cinder-quobyte-e5f2ec20-ffd9-4b6e-8bf6-5f02624fe6a4" released by "delete_volume" :: held 0.709s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:58:39 devstack cinder-volume[87314]: WARNING cinder.quota [None req-58e3e49a-1876-442f-8035-948fbd76f3ac tempest-VolumeRetypeWithoutMigrationTest-1360919436 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 04 17:58:39 devstack cinder-volume[87314]: WARNING cinder.quota [None req-58e3e49a-1876-442f-8035-948fbd76f3ac tempest-VolumeRetypeWithoutMigrationTest-1360919436 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 04 17:58:39 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-58e3e49a-1876-442f-8035-948fbd76f3ac tempest-VolumeRetypeWithoutMigrationTest-1360919436 None] Created reservations ['b66134d1-819b-4bb7-af38-b883d41d8a47', 'b73d623d-072f-4bb9-b00a-4bcfbe6b5a80', 'd425756e-9672-4017-a1e3-5ec9b359a324', 'f855fb3c-dbac-43aa-b45c-9ddb3cf23739'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:58:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-58e3e49a-1876-442f-8035-948fbd76f3ac tempest-VolumeRetypeWithoutMigrationTest-1360919436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:58:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-58e3e49a-1876-442f-8035-948fbd76f3ac tempest-VolumeRetypeWithoutMigrationTest-1360919436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:58:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-58e3e49a-1876-442f-8035-948fbd76f3ac tempest-VolumeRetypeWithoutMigrationTest-1360919436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:58:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-58e3e49a-1876-442f-8035-948fbd76f3ac tempest-VolumeRetypeWithoutMigrationTest-1360919436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:58:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-58e3e49a-1876-442f-8035-948fbd76f3ac tempest-VolumeRetypeWithoutMigrationTest-1360919436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:58:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-58e3e49a-1876-442f-8035-948fbd76f3ac tempest-VolumeRetypeWithoutMigrationTest-1360919436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:39 devstack sudo[98578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:58:39 devstack sudo[98578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:40 devstack sudo[98575]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0a8d1e3e-2fb6-496b-be5d-e877d6550023 tempest-VolumesExtendTest-863733137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.314s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:40 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-0a8d1e3e-2fb6-496b-be5d-e877d6550023 tempest-VolumesExtendTest-863733137 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:58:40 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-0a8d1e3e-2fb6-496b-be5d-e877d6550023 tempest-VolumesExtendTest-863733137 None] Deleted volume successfully. Sep 04 17:58:40 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0a8d1e3e-2fb6-496b-be5d-e877d6550023 tempest-VolumesExtendTest-863733137 None] Lock "cinder-8419db82-de0e-48ec-b2ee-1e89615108f3-delete_volume" released by "delete_volume" :: held 1.299s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:58:40 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7dc57e4-19a0-42a9-9348-7bee14de940a tempest-VolumeQuotasAdminTestJSON-1072564872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:58:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f7dc57e4-19a0-42a9-9348-7bee14de940a tempest-VolumeQuotasAdminTestJSON-1072564872 None] Flow 'volume_create_manager' (a5f67c54-b0c4-4bad-bcd7-28c7b4ce37b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:58:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f7dc57e4-19a0-42a9-9348-7bee14de940a tempest-VolumeQuotasAdminTestJSON-1072564872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3a09abb-1bbe-433f-aa67-3e20306db1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f7dc57e4-19a0-42a9-9348-7bee14de940a tempest-VolumeQuotasAdminTestJSON-1072564872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3a09abb-1bbe-433f-aa67-3e20306db1da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:58:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1250105049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0909a6d0-5c5c-45d9-8d70-76dce778beb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca1b412f938742ccb969a75c12e8ae45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:58:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:58:40Z,use_quota=True,user_id='aa2afde3cf2845fc8a0ac4c50edb6475',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f7dc57e4-19a0-42a9-9348-7bee14de940a tempest-VolumeQuotasAdminTestJSON-1072564872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa89d96e-6c70-4c3e-bf93-e93ab9178b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f7dc57e4-19a0-42a9-9348-7bee14de940a tempest-VolumeQuotasAdminTestJSON-1072564872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa89d96e-6c70-4c3e-bf93-e93ab9178b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f7dc57e4-19a0-42a9-9348-7bee14de940a tempest-VolumeQuotasAdminTestJSON-1072564872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (064781ae-3ad9-4455-9844-6bbd3c5aeee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f7dc57e4-19a0-42a9-9348-7bee14de940a tempest-VolumeQuotasAdminTestJSON-1072564872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (064781ae-3ad9-4455-9844-6bbd3c5aeee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0909a6d0-5c5c-45d9-8d70-76dce778beb6', 'volume_name': 'volume-0909a6d0-5c5c-45d9-8d70-76dce778beb6', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f7dc57e4-19a0-42a9-9348-7bee14de940a tempest-VolumeQuotasAdminTestJSON-1072564872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3b7f9ea-c17b-490e-8f21-d20f23267abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f7dc57e4-19a0-42a9-9348-7bee14de940a tempest-VolumeQuotasAdminTestJSON-1072564872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3b7f9ea-c17b-490e-8f21-d20f23267abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f7dc57e4-19a0-42a9-9348-7bee14de940a tempest-VolumeQuotasAdminTestJSON-1072564872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bec569e8-8f6a-4676-b937-71050e6ab2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:40 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-f7dc57e4-19a0-42a9-9348-7bee14de940a tempest-VolumeQuotasAdminTestJSON-1072564872 None] Volume 0909a6d0-5c5c-45d9-8d70-76dce778beb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0909a6d0-5c5c-45d9-8d70-76dce778beb6', 'volume_size': 1} Sep 04 17:58:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f7dc57e4-19a0-42a9-9348-7bee14de940a tempest-VolumeQuotasAdminTestJSON-1072564872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:58:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f7dc57e4-19a0-42a9-9348-7bee14de940a tempest-VolumeQuotasAdminTestJSON-1072564872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:58:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f7dc57e4-19a0-42a9-9348-7bee14de940a tempest-VolumeQuotasAdminTestJSON-1072564872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:58:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1250105049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0909a6d0-5c5c-45d9-8d70-76dce778beb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca1b412f938742ccb969a75c12e8ae45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:58:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:58:40Z,use_quota=True,user_id='aa2afde3cf2845fc8a0ac4c50edb6475',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:58:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-f7dc57e4-19a0-42a9-9348-7bee14de940a tempest-VolumeQuotasAdminTestJSON-1072564872 None] Creating volume 0909a6d0-5c5c-45d9-8d70-76dce778beb6 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:58:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f7dc57e4-19a0-42a9-9348-7bee14de940a tempest-VolumeQuotasAdminTestJSON-1072564872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:58:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f7dc57e4-19a0-42a9-9348-7bee14de940a tempest-VolumeQuotasAdminTestJSON-1072564872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:58:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f7dc57e4-19a0-42a9-9348-7bee14de940a tempest-VolumeQuotasAdminTestJSON-1072564872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:58:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f7dc57e4-19a0-42a9-9348-7bee14de940a tempest-VolumeQuotasAdminTestJSON-1072564872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:58:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f7dc57e4-19a0-42a9-9348-7bee14de940a tempest-VolumeQuotasAdminTestJSON-1072564872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:58:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f7dc57e4-19a0-42a9-9348-7bee14de940a tempest-VolumeQuotasAdminTestJSON-1072564872 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:58:40 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-f7dc57e4-19a0-42a9-9348-7bee14de940a tempest-VolumeQuotasAdminTestJSON-1072564872 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:58:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f7dc57e4-19a0-42a9-9348-7bee14de940a tempest-VolumeQuotasAdminTestJSON-1072564872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0909a6d0-5c5c-45d9-8d70-76dce778beb6 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:40 devstack sudo[98581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0909a6d0-5c5c-45d9-8d70-76dce778beb6 1073741824 Sep 04 17:58:40 devstack sudo[98581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:40 devstack sudo[98578]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-58e3e49a-1876-442f-8035-948fbd76f3ac tempest-VolumeRetypeWithoutMigrationTest-1360919436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.329s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:40 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-58e3e49a-1876-442f-8035-948fbd76f3ac tempest-VolumeRetypeWithoutMigrationTest-1360919436 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:58:40 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-58e3e49a-1876-442f-8035-948fbd76f3ac tempest-VolumeRetypeWithoutMigrationTest-1360919436 None] Deleted volume successfully. Sep 04 17:58:40 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-58e3e49a-1876-442f-8035-948fbd76f3ac tempest-VolumeRetypeWithoutMigrationTest-1360919436 None] Lock "cinder-e5f2ec20-ffd9-4b6e-8bf6-5f02624fe6a4-delete_volume" released by "delete_volume" :: held 1.330s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:58:40 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-f968e77d-c3c7-4760-bc58-4dcde5a12f1e tempest-VolumesExtendTest-863733137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:58:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f968e77d-c3c7-4760-bc58-4dcde5a12f1e tempest-VolumesExtendTest-863733137 None] Flow 'volume_create_manager' (b78aef2a-115d-4dae-9c12-17e8ce143a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:58:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f968e77d-c3c7-4760-bc58-4dcde5a12f1e tempest-VolumesExtendTest-863733137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2751eff-2858-4d2e-80f6-8203cc233e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f968e77d-c3c7-4760-bc58-4dcde5a12f1e tempest-VolumesExtendTest-863733137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2751eff-2858-4d2e-80f6-8203cc233e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:58:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-760731679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=625b3701-7454-4920-9a28-22688e3b1095,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf1576504bf545d3825ffd8f6e56e5d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:58:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:58:40Z,use_quota=True,user_id='29f4bc05ec5045249f40041294985484',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f968e77d-c3c7-4760-bc58-4dcde5a12f1e tempest-VolumesExtendTest-863733137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8a503f3-5913-44a0-a55d-a2e44861db64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f968e77d-c3c7-4760-bc58-4dcde5a12f1e tempest-VolumesExtendTest-863733137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8a503f3-5913-44a0-a55d-a2e44861db64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f968e77d-c3c7-4760-bc58-4dcde5a12f1e tempest-VolumesExtendTest-863733137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9523edf-1770-4a8c-b8b1-c91daf93c2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f968e77d-c3c7-4760-bc58-4dcde5a12f1e tempest-VolumesExtendTest-863733137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9523edf-1770-4a8c-b8b1-c91daf93c2c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '625b3701-7454-4920-9a28-22688e3b1095', 'volume_name': 'volume-625b3701-7454-4920-9a28-22688e3b1095', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f968e77d-c3c7-4760-bc58-4dcde5a12f1e tempest-VolumesExtendTest-863733137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (433e6b23-868c-4c27-b1f5-9be012ac55ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f968e77d-c3c7-4760-bc58-4dcde5a12f1e tempest-VolumesExtendTest-863733137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (433e6b23-868c-4c27-b1f5-9be012ac55ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f968e77d-c3c7-4760-bc58-4dcde5a12f1e tempest-VolumesExtendTest-863733137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7346b9f-8337-4ca6-9a3d-8de460fa7da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:40 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-f968e77d-c3c7-4760-bc58-4dcde5a12f1e tempest-VolumesExtendTest-863733137 None] Volume 625b3701-7454-4920-9a28-22688e3b1095: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-625b3701-7454-4920-9a28-22688e3b1095', 'volume_size': 1} Sep 04 17:58:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f968e77d-c3c7-4760-bc58-4dcde5a12f1e tempest-VolumesExtendTest-863733137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:58:40 devstack sudo[98581]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f7dc57e4-19a0-42a9-9348-7bee14de940a tempest-VolumeQuotasAdminTestJSON-1072564872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0909a6d0-5c5c-45d9-8d70-76dce778beb6 1073741824" returned: 0 in 0.534s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f7dc57e4-19a0-42a9-9348-7bee14de940a tempest-VolumeQuotasAdminTestJSON-1072564872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0909a6d0-5c5c-45d9-8d70-76dce778beb6 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:40 devstack sudo[98588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0909a6d0-5c5c-45d9-8d70-76dce778beb6 Sep 04 17:58:40 devstack sudo[98588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:40 devstack sudo[98588]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f7dc57e4-19a0-42a9-9348-7bee14de940a tempest-VolumeQuotasAdminTestJSON-1072564872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0909a6d0-5c5c-45d9-8d70-76dce778beb6" returned: 0 in 0.245s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f7dc57e4-19a0-42a9-9348-7bee14de940a tempest-VolumeQuotasAdminTestJSON-1072564872 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:58:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f7dc57e4-19a0-42a9-9348-7bee14de940a tempest-VolumeQuotasAdminTestJSON-1072564872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:58:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f968e77d-c3c7-4760-bc58-4dcde5a12f1e tempest-VolumesExtendTest-863733137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.365s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:58:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f968e77d-c3c7-4760-bc58-4dcde5a12f1e tempest-VolumesExtendTest-863733137 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:58:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-760731679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=625b3701-7454-4920-9a28-22688e3b1095,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf1576504bf545d3825ffd8f6e56e5d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:58:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:58:40Z,use_quota=True,user_id='29f4bc05ec5045249f40041294985484',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:58:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-f968e77d-c3c7-4760-bc58-4dcde5a12f1e tempest-VolumesExtendTest-863733137 None] Creating volume 625b3701-7454-4920-9a28-22688e3b1095 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:58:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f968e77d-c3c7-4760-bc58-4dcde5a12f1e tempest-VolumesExtendTest-863733137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:58:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f968e77d-c3c7-4760-bc58-4dcde5a12f1e tempest-VolumesExtendTest-863733137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:58:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f968e77d-c3c7-4760-bc58-4dcde5a12f1e tempest-VolumesExtendTest-863733137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:58:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f968e77d-c3c7-4760-bc58-4dcde5a12f1e tempest-VolumesExtendTest-863733137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:58:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f968e77d-c3c7-4760-bc58-4dcde5a12f1e tempest-VolumesExtendTest-863733137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:58:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f968e77d-c3c7-4760-bc58-4dcde5a12f1e tempest-VolumesExtendTest-863733137 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:58:40 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-f968e77d-c3c7-4760-bc58-4dcde5a12f1e tempest-VolumesExtendTest-863733137 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:58:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f968e77d-c3c7-4760-bc58-4dcde5a12f1e tempest-VolumesExtendTest-863733137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-625b3701-7454-4920-9a28-22688e3b1095 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f7dc57e4-19a0-42a9-9348-7bee14de940a tempest-VolumeQuotasAdminTestJSON-1072564872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bec569e8-8f6a-4676-b937-71050e6ab2b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0909a6d0-5c5c-45d9-8d70-76dce778beb6', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f7dc57e4-19a0-42a9-9348-7bee14de940a tempest-VolumeQuotasAdminTestJSON-1072564872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (770f1ddc-040e-43a9-ab53-2999e47e26d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:41 devstack sudo[98591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-625b3701-7454-4920-9a28-22688e3b1095 1073741824 Sep 04 17:58:41 devstack sudo[98591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:41 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-f7dc57e4-19a0-42a9-9348-7bee14de940a tempest-VolumeQuotasAdminTestJSON-1072564872 None] Volume volume-0909a6d0-5c5c-45d9-8d70-76dce778beb6 (0909a6d0-5c5c-45d9-8d70-76dce778beb6): created successfully Sep 04 17:58:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f7dc57e4-19a0-42a9-9348-7bee14de940a tempest-VolumeQuotasAdminTestJSON-1072564872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (770f1ddc-040e-43a9-ab53-2999e47e26d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f7dc57e4-19a0-42a9-9348-7bee14de940a tempest-VolumeQuotasAdminTestJSON-1072564872 None] Flow 'volume_create_manager' (a5f67c54-b0c4-4bad-bcd7-28c7b4ce37b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:58:41 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-f7dc57e4-19a0-42a9-9348-7bee14de940a tempest-VolumeQuotasAdminTestJSON-1072564872 None] Created volume successfully. Sep 04 17:58:41 devstack sudo[98591]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f968e77d-c3c7-4760-bc58-4dcde5a12f1e tempest-VolumesExtendTest-863733137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-625b3701-7454-4920-9a28-22688e3b1095 1073741824" returned: 0 in 0.508s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f968e77d-c3c7-4760-bc58-4dcde5a12f1e tempest-VolumesExtendTest-863733137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-625b3701-7454-4920-9a28-22688e3b1095 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:41 devstack sudo[98597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-625b3701-7454-4920-9a28-22688e3b1095 Sep 04 17:58:41 devstack sudo[98597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:41 devstack sudo[98597]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f968e77d-c3c7-4760-bc58-4dcde5a12f1e tempest-VolumesExtendTest-863733137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-625b3701-7454-4920-9a28-22688e3b1095" returned: 0 in 0.280s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:41 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f968e77d-c3c7-4760-bc58-4dcde5a12f1e tempest-VolumesExtendTest-863733137 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:58:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f968e77d-c3c7-4760-bc58-4dcde5a12f1e tempest-VolumesExtendTest-863733137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:58:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f968e77d-c3c7-4760-bc58-4dcde5a12f1e tempest-VolumesExtendTest-863733137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7346b9f-8337-4ca6-9a3d-8de460fa7da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-625b3701-7454-4920-9a28-22688e3b1095', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f968e77d-c3c7-4760-bc58-4dcde5a12f1e tempest-VolumesExtendTest-863733137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7807e172-6f66-4a0a-9c01-93fa57428b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:41 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-f968e77d-c3c7-4760-bc58-4dcde5a12f1e tempest-VolumesExtendTest-863733137 None] Volume volume-625b3701-7454-4920-9a28-22688e3b1095 (625b3701-7454-4920-9a28-22688e3b1095): created successfully Sep 04 17:58:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f968e77d-c3c7-4760-bc58-4dcde5a12f1e tempest-VolumesExtendTest-863733137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7807e172-6f66-4a0a-9c01-93fa57428b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f968e77d-c3c7-4760-bc58-4dcde5a12f1e tempest-VolumesExtendTest-863733137 None] Flow 'volume_create_manager' (b78aef2a-115d-4dae-9c12-17e8ce143a84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:58:41 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-f968e77d-c3c7-4760-bc58-4dcde5a12f1e tempest-VolumesExtendTest-863733137 None] Created volume successfully. Sep 04 17:58:42 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-810c0452-f90b-46a3-baf1-57a371907bcb tempest-VolumeQuotasAdminTestJSON-1072564872 None] Acquiring lock "cinder-0909a6d0-5c5c-45d9-8d70-76dce778beb6-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:58:42 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-810c0452-f90b-46a3-baf1-57a371907bcb tempest-VolumeQuotasAdminTestJSON-1072564872 None] Lock "cinder-0909a6d0-5c5c-45d9-8d70-76dce778beb6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:58:42 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-810c0452-f90b-46a3-baf1-57a371907bcb tempest-VolumeQuotasAdminTestJSON-1072564872 None] Acquiring lock "cinder-quobyte-0909a6d0-5c5c-45d9-8d70-76dce778beb6" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:58:42 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-810c0452-f90b-46a3-baf1-57a371907bcb tempest-VolumeQuotasAdminTestJSON-1072564872 None] Lock "cinder-quobyte-0909a6d0-5c5c-45d9-8d70-76dce778beb6" acquired by "delete_volume" :: waited 0.018s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:58:42 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5e37f3-b4d9-4b00-a7eb-b5dbd1e45b53]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:58:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-810c0452-f90b-46a3-baf1-57a371907bcb tempest-VolumeQuotasAdminTestJSON-1072564872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0909a6d0-5c5c-45d9-8d70-76dce778beb6 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:42 devstack sudo[98638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0909a6d0-5c5c-45d9-8d70-76dce778beb6 Sep 04 17:58:42 devstack sudo[98638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:42 devstack sudo[98638]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-810c0452-f90b-46a3-baf1-57a371907bcb tempest-VolumeQuotasAdminTestJSON-1072564872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0909a6d0-5c5c-45d9-8d70-76dce778beb6" returned: 0 in 0.476s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-810c0452-f90b-46a3-baf1-57a371907bcb tempest-VolumeQuotasAdminTestJSON-1072564872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0909a6d0-5c5c-45d9-8d70-76dce778beb6 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:42 devstack sudo[98643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0909a6d0-5c5c-45d9-8d70-76dce778beb6 Sep 04 17:58:42 devstack sudo[98643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-64ea2e7a-125a-4788-bbdc-86ab6590a077 tempest-VolumesExtendTest-863733137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:58:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-64ea2e7a-125a-4788-bbdc-86ab6590a077 tempest-VolumesExtendTest-863733137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:58:42 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-64ea2e7a-125a-4788-bbdc-86ab6590a077 tempest-VolumesExtendTest-863733137 None] Creating offline snapshot 2bfee95e-2609-4f50-bf1b-ff1d42259d24 of volume 625b3701-7454-4920-9a28-22688e3b1095 {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 17:58:42 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[8caf2cb1-bd92-4daa-9b61-90eeb914e3dc]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:58:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-64ea2e7a-125a-4788-bbdc-86ab6590a077 tempest-VolumesExtendTest-863733137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-625b3701-7454-4920-9a28-22688e3b1095 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:43 devstack sudo[98645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-625b3701-7454-4920-9a28-22688e3b1095 Sep 04 17:58:43 devstack sudo[98645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:43 devstack sudo[98643]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-810c0452-f90b-46a3-baf1-57a371907bcb tempest-VolumeQuotasAdminTestJSON-1072564872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0909a6d0-5c5c-45d9-8d70-76dce778beb6" returned: 0 in 0.302s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:43 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-810c0452-f90b-46a3-baf1-57a371907bcb tempest-VolumeQuotasAdminTestJSON-1072564872 None] Lock "cinder-quobyte-0909a6d0-5c5c-45d9-8d70-76dce778beb6" released by "delete_volume" :: held 0.825s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:58:43 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-810c0452-f90b-46a3-baf1-57a371907bcb tempest-VolumeQuotasAdminTestJSON-1072564872 None] Created reservations ['b4eeb3fc-781d-4316-8678-be2e1c5fe702', '29228a57-1d2c-484f-a96b-776b437904cc', '7009259d-e6b2-47ce-947b-5ac3e14dcc6f', '4bdba930-982c-4617-9b0c-a4bc2f64999b'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:58:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-810c0452-f90b-46a3-baf1-57a371907bcb tempest-VolumeQuotasAdminTestJSON-1072564872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:58:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-810c0452-f90b-46a3-baf1-57a371907bcb tempest-VolumeQuotasAdminTestJSON-1072564872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:58:43 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-810c0452-f90b-46a3-baf1-57a371907bcb tempest-VolumeQuotasAdminTestJSON-1072564872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:58:43 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-810c0452-f90b-46a3-baf1-57a371907bcb tempest-VolumeQuotasAdminTestJSON-1072564872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:58:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-810c0452-f90b-46a3-baf1-57a371907bcb tempest-VolumeQuotasAdminTestJSON-1072564872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:58:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-810c0452-f90b-46a3-baf1-57a371907bcb tempest-VolumeQuotasAdminTestJSON-1072564872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:43 devstack sudo[98651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:58:43 devstack sudo[98651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:43 devstack sudo[98645]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-64ea2e7a-125a-4788-bbdc-86ab6590a077 tempest-VolumesExtendTest-863733137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-625b3701-7454-4920-9a28-22688e3b1095" returned: 0 in 0.503s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-64ea2e7a-125a-4788-bbdc-86ab6590a077 tempest-VolumesExtendTest-863733137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-625b3701-7454-4920-9a28-22688e3b1095,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-625b3701-7454-4920-9a28-22688e3b1095.2bfee95e-2609-4f50-bf1b-ff1d42259d24 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:43 devstack sudo[98654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-625b3701-7454-4920-9a28-22688e3b1095,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-625b3701-7454-4920-9a28-22688e3b1095.2bfee95e-2609-4f50-bf1b-ff1d42259d24 1G Sep 04 17:58:43 devstack sudo[98654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:43 devstack sudo[98651]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-810c0452-f90b-46a3-baf1-57a371907bcb tempest-VolumeQuotasAdminTestJSON-1072564872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.322s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:43 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-810c0452-f90b-46a3-baf1-57a371907bcb tempest-VolumeQuotasAdminTestJSON-1072564872 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:58:43 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-810c0452-f90b-46a3-baf1-57a371907bcb tempest-VolumeQuotasAdminTestJSON-1072564872 None] Deleted volume successfully. Sep 04 17:58:43 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-810c0452-f90b-46a3-baf1-57a371907bcb tempest-VolumeQuotasAdminTestJSON-1072564872 None] Lock "cinder-0909a6d0-5c5c-45d9-8d70-76dce778beb6-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:58:43 devstack sudo[98654]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-64ea2e7a-125a-4788-bbdc-86ab6590a077 tempest-VolumesExtendTest-863733137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-625b3701-7454-4920-9a28-22688e3b1095,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-625b3701-7454-4920-9a28-22688e3b1095.2bfee95e-2609-4f50-bf1b-ff1d42259d24 1G" returned: 0 in 0.555s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-64ea2e7a-125a-4788-bbdc-86ab6590a077 tempest-VolumesExtendTest-863733137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-625b3701-7454-4920-9a28-22688e3b1095 -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-625b3701-7454-4920-9a28-22688e3b1095.2bfee95e-2609-4f50-bf1b-ff1d42259d24 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:43 devstack sudo[98661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-625b3701-7454-4920-9a28-22688e3b1095 -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-625b3701-7454-4920-9a28-22688e3b1095.2bfee95e-2609-4f50-bf1b-ff1d42259d24 Sep 04 17:58:43 devstack sudo[98661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:44 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-edbfa1c7-361f-41c6-83d0-b6f332f18f61 tempest-VolumeQuotasAdminTestJSON-1072564872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:58:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-edbfa1c7-361f-41c6-83d0-b6f332f18f61 tempest-VolumeQuotasAdminTestJSON-1072564872 None] Flow 'volume_create_manager' (ac660a6a-a366-477e-aa92-4e3c6d3497b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:58:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-edbfa1c7-361f-41c6-83d0-b6f332f18f61 tempest-VolumeQuotasAdminTestJSON-1072564872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba598362-0e56-4f9f-be81-b0a073ffbb27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-edbfa1c7-361f-41c6-83d0-b6f332f18f61 tempest-VolumeQuotasAdminTestJSON-1072564872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba598362-0e56-4f9f-be81-b0a073ffbb27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:58:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2146714926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdda5009-9f3a-48e2-b4da-c846a4aab004,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca1b412f938742ccb969a75c12e8ae45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:58:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:58:44Z,use_quota=True,user_id='aa2afde3cf2845fc8a0ac4c50edb6475',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-edbfa1c7-361f-41c6-83d0-b6f332f18f61 tempest-VolumeQuotasAdminTestJSON-1072564872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31ff8dbf-29a9-42d1-b2c5-6d204f0e1762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-edbfa1c7-361f-41c6-83d0-b6f332f18f61 tempest-VolumeQuotasAdminTestJSON-1072564872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31ff8dbf-29a9-42d1-b2c5-6d204f0e1762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-edbfa1c7-361f-41c6-83d0-b6f332f18f61 tempest-VolumeQuotasAdminTestJSON-1072564872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02366047-6852-43a3-a37c-763a7d7ea645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-edbfa1c7-361f-41c6-83d0-b6f332f18f61 tempest-VolumeQuotasAdminTestJSON-1072564872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02366047-6852-43a3-a37c-763a7d7ea645) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdda5009-9f3a-48e2-b4da-c846a4aab004', 'volume_name': 'volume-bdda5009-9f3a-48e2-b4da-c846a4aab004', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-edbfa1c7-361f-41c6-83d0-b6f332f18f61 tempest-VolumeQuotasAdminTestJSON-1072564872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eca1e27-d4b2-4ce4-b32c-4070f56ffcc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-edbfa1c7-361f-41c6-83d0-b6f332f18f61 tempest-VolumeQuotasAdminTestJSON-1072564872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eca1e27-d4b2-4ce4-b32c-4070f56ffcc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-edbfa1c7-361f-41c6-83d0-b6f332f18f61 tempest-VolumeQuotasAdminTestJSON-1072564872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50d311b1-d6f0-4c23-95b7-4df6153af789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:44 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-edbfa1c7-361f-41c6-83d0-b6f332f18f61 tempest-VolumeQuotasAdminTestJSON-1072564872 None] Volume bdda5009-9f3a-48e2-b4da-c846a4aab004: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdda5009-9f3a-48e2-b4da-c846a4aab004', 'volume_size': 1} Sep 04 17:58:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-edbfa1c7-361f-41c6-83d0-b6f332f18f61 tempest-VolumeQuotasAdminTestJSON-1072564872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:58:44 devstack sudo[98661]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-64ea2e7a-125a-4788-bbdc-86ab6590a077 tempest-VolumesExtendTest-863733137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-625b3701-7454-4920-9a28-22688e3b1095 -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-625b3701-7454-4920-9a28-22688e3b1095.2bfee95e-2609-4f50-bf1b-ff1d42259d24" returned: 0 in 0.334s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:44 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-64ea2e7a-125a-4788-bbdc-86ab6590a077 tempest-VolumesExtendTest-863733137 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-625b3701-7454-4920-9a28-22688e3b1095.2bfee95e-2609-4f50-bf1b-ff1d42259d24 is being set with open permissions: ugo+rw Sep 04 17:58:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-64ea2e7a-125a-4788-bbdc-86ab6590a077 tempest-VolumesExtendTest-863733137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-625b3701-7454-4920-9a28-22688e3b1095.2bfee95e-2609-4f50-bf1b-ff1d42259d24 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:44 devstack sudo[98666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-625b3701-7454-4920-9a28-22688e3b1095.2bfee95e-2609-4f50-bf1b-ff1d42259d24 Sep 04 17:58:44 devstack sudo[98666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:44 devstack sudo[98666]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-64ea2e7a-125a-4788-bbdc-86ab6590a077 tempest-VolumesExtendTest-863733137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-625b3701-7454-4920-9a28-22688e3b1095.2bfee95e-2609-4f50-bf1b-ff1d42259d24" returned: 0 in 0.255s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-64ea2e7a-125a-4788-bbdc-86ab6590a077 tempest-VolumesExtendTest-863733137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-625b3701-7454-4920-9a28-22688e3b1095.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:44 devstack sudo[98669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-625b3701-7454-4920-9a28-22688e3b1095.info Sep 04 17:58:44 devstack sudo[98669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:44 devstack sudo[98669]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-64ea2e7a-125a-4788-bbdc-86ab6590a077 tempest-VolumesExtendTest-863733137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-625b3701-7454-4920-9a28-22688e3b1095.info" returned: 0 in 0.271s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:44 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-64ea2e7a-125a-4788-bbdc-86ab6590a077 tempest-VolumesExtendTest-863733137 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-625b3701-7454-4920-9a28-22688e3b1095.info is being set with open permissions: ugo+rw Sep 04 17:58:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-64ea2e7a-125a-4788-bbdc-86ab6590a077 tempest-VolumesExtendTest-863733137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-625b3701-7454-4920-9a28-22688e3b1095.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:44 devstack sudo[98672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-625b3701-7454-4920-9a28-22688e3b1095.info Sep 04 17:58:44 devstack sudo[98672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:45 devstack sudo[98672]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-64ea2e7a-125a-4788-bbdc-86ab6590a077 tempest-VolumesExtendTest-863733137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-625b3701-7454-4920-9a28-22688e3b1095.info" returned: 0 in 0.254s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-64ea2e7a-125a-4788-bbdc-86ab6590a077 tempest-VolumesExtendTest-863733137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.303s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:58:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-edbfa1c7-361f-41c6-83d0-b6f332f18f61 tempest-VolumeQuotasAdminTestJSON-1072564872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.017s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:58:45 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-edbfa1c7-361f-41c6-83d0-b6f332f18f61 tempest-VolumeQuotasAdminTestJSON-1072564872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:58:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2146714926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdda5009-9f3a-48e2-b4da-c846a4aab004,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca1b412f938742ccb969a75c12e8ae45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:58:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:58:44Z,use_quota=True,user_id='aa2afde3cf2845fc8a0ac4c50edb6475',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:58:45 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-edbfa1c7-361f-41c6-83d0-b6f332f18f61 tempest-VolumeQuotasAdminTestJSON-1072564872 None] Creating volume bdda5009-9f3a-48e2-b4da-c846a4aab004 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:58:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-edbfa1c7-361f-41c6-83d0-b6f332f18f61 tempest-VolumeQuotasAdminTestJSON-1072564872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:58:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-edbfa1c7-361f-41c6-83d0-b6f332f18f61 tempest-VolumeQuotasAdminTestJSON-1072564872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:58:45 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-edbfa1c7-361f-41c6-83d0-b6f332f18f61 tempest-VolumeQuotasAdminTestJSON-1072564872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:58:45 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-edbfa1c7-361f-41c6-83d0-b6f332f18f61 tempest-VolumeQuotasAdminTestJSON-1072564872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:58:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-edbfa1c7-361f-41c6-83d0-b6f332f18f61 tempest-VolumeQuotasAdminTestJSON-1072564872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:58:45 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-edbfa1c7-361f-41c6-83d0-b6f332f18f61 tempest-VolumeQuotasAdminTestJSON-1072564872 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:58:45 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-edbfa1c7-361f-41c6-83d0-b6f332f18f61 tempest-VolumeQuotasAdminTestJSON-1072564872 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:58:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-edbfa1c7-361f-41c6-83d0-b6f332f18f61 tempest-VolumeQuotasAdminTestJSON-1072564872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-bdda5009-9f3a-48e2-b4da-c846a4aab004 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:45 devstack sudo[98675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-bdda5009-9f3a-48e2-b4da-c846a4aab004 1073741824 Sep 04 17:58:45 devstack sudo[98675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:45 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-64ea2e7a-125a-4788-bbdc-86ab6590a077 tempest-VolumesExtendTest-863733137 None] Create snapshot completed successfully Sep 04 17:58:45 devstack sudo[98675]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-edbfa1c7-361f-41c6-83d0-b6f332f18f61 tempest-VolumeQuotasAdminTestJSON-1072564872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-bdda5009-9f3a-48e2-b4da-c846a4aab004 1073741824" returned: 0 in 0.509s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-edbfa1c7-361f-41c6-83d0-b6f332f18f61 tempest-VolumeQuotasAdminTestJSON-1072564872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-bdda5009-9f3a-48e2-b4da-c846a4aab004 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:45 devstack sudo[98681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-bdda5009-9f3a-48e2-b4da-c846a4aab004 Sep 04 17:58:45 devstack sudo[98681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:46 devstack sudo[98681]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-edbfa1c7-361f-41c6-83d0-b6f332f18f61 tempest-VolumeQuotasAdminTestJSON-1072564872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-bdda5009-9f3a-48e2-b4da-c846a4aab004" returned: 0 in 0.292s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:46 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-edbfa1c7-361f-41c6-83d0-b6f332f18f61 tempest-VolumeQuotasAdminTestJSON-1072564872 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:58:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-edbfa1c7-361f-41c6-83d0-b6f332f18f61 tempest-VolumeQuotasAdminTestJSON-1072564872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:58:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-edbfa1c7-361f-41c6-83d0-b6f332f18f61 tempest-VolumeQuotasAdminTestJSON-1072564872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50d311b1-d6f0-4c23-95b7-4df6153af789) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdda5009-9f3a-48e2-b4da-c846a4aab004', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-edbfa1c7-361f-41c6-83d0-b6f332f18f61 tempest-VolumeQuotasAdminTestJSON-1072564872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (095c1424-ec75-420e-92b7-71f09f27a0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:46 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-edbfa1c7-361f-41c6-83d0-b6f332f18f61 tempest-VolumeQuotasAdminTestJSON-1072564872 None] Volume volume-bdda5009-9f3a-48e2-b4da-c846a4aab004 (bdda5009-9f3a-48e2-b4da-c846a4aab004): created successfully Sep 04 17:58:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-edbfa1c7-361f-41c6-83d0-b6f332f18f61 tempest-VolumeQuotasAdminTestJSON-1072564872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (095c1424-ec75-420e-92b7-71f09f27a0fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-edbfa1c7-361f-41c6-83d0-b6f332f18f61 tempest-VolumeQuotasAdminTestJSON-1072564872 None] Flow 'volume_create_manager' (ac660a6a-a366-477e-aa92-4e3c6d3497b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:58:46 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-edbfa1c7-361f-41c6-83d0-b6f332f18f61 tempest-VolumeQuotasAdminTestJSON-1072564872 None] Created volume successfully. Sep 04 17:58:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f66b7c4d-2f24-4e37-a013-641258f324b1 tempest-VolumesExtendTest-863733137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:58:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f66b7c4d-2f24-4e37-a013-641258f324b1 tempest-VolumesExtendTest-863733137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:58:46 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdba49e7-266f-4ad9-b32d-16979a081c8f]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:58:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f66b7c4d-2f24-4e37-a013-641258f324b1 tempest-VolumesExtendTest-863733137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-625b3701-7454-4920-9a28-22688e3b1095 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:46 devstack sudo[98684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-625b3701-7454-4920-9a28-22688e3b1095 Sep 04 17:58:46 devstack sudo[98684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:46 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf28ec08-b8a7-4c0a-8f88-7e7e7e9a7ab1 tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:58:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bf28ec08-b8a7-4c0a-8f88-7e7e7e9a7ab1 tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Flow 'volume_create_manager' (7c038675-7150-41f5-af65-b79d9d2a3b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:58:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bf28ec08-b8a7-4c0a-8f88-7e7e7e9a7ab1 tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16dc00f9-fc2f-4e54-81fb-9ad696f3fec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bf28ec08-b8a7-4c0a-8f88-7e7e7e9a7ab1 tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16dc00f9-fc2f-4e54-81fb-9ad696f3fec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:58:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2065200680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d0af6f9-b75a-4e69-930b-7b2afae4410c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9fa81c71e7f4a93a6a9ed0b94d16a42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:58:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:58:47Z,use_quota=True,user_id='d3bcba3a3de54f05af82ff34f653b528',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bf28ec08-b8a7-4c0a-8f88-7e7e7e9a7ab1 tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (221771a2-e4ec-4f4d-8d63-e3a9a6e3ec4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bf28ec08-b8a7-4c0a-8f88-7e7e7e9a7ab1 tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (221771a2-e4ec-4f4d-8d63-e3a9a6e3ec4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bf28ec08-b8a7-4c0a-8f88-7e7e7e9a7ab1 tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d87e0865-79f2-4000-ac84-83e64844bc02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bf28ec08-b8a7-4c0a-8f88-7e7e7e9a7ab1 tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d87e0865-79f2-4000-ac84-83e64844bc02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d0af6f9-b75a-4e69-930b-7b2afae4410c', 'volume_name': 'volume-1d0af6f9-b75a-4e69-930b-7b2afae4410c', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bf28ec08-b8a7-4c0a-8f88-7e7e7e9a7ab1 tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (528a701f-1864-441e-bc5c-604ef82abb61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bf28ec08-b8a7-4c0a-8f88-7e7e7e9a7ab1 tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (528a701f-1864-441e-bc5c-604ef82abb61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bf28ec08-b8a7-4c0a-8f88-7e7e7e9a7ab1 tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36665334-5b60-48de-b88e-ab8f086bb1aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:46 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-bf28ec08-b8a7-4c0a-8f88-7e7e7e9a7ab1 tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Volume 1d0af6f9-b75a-4e69-930b-7b2afae4410c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d0af6f9-b75a-4e69-930b-7b2afae4410c', 'volume_size': 1} Sep 04 17:58:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bf28ec08-b8a7-4c0a-8f88-7e7e7e9a7ab1 tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:58:46 devstack sudo[98684]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f66b7c4d-2f24-4e37-a013-641258f324b1 tempest-VolumesExtendTest-863733137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-625b3701-7454-4920-9a28-22688e3b1095" returned: 0 in 0.429s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f66b7c4d-2f24-4e37-a013-641258f324b1 tempest-VolumesExtendTest-863733137 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-625b3701-7454-4920-9a28-22688e3b1095.2bfee95e-2609-4f50-bf1b-ff1d42259d24 2G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f66b7c4d-2f24-4e37-a013-641258f324b1 tempest-VolumesExtendTest-863733137 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-625b3701-7454-4920-9a28-22688e3b1095.2bfee95e-2609-4f50-bf1b-ff1d42259d24 2G" returned: 0 in 0.125s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f66b7c4d-2f24-4e37-a013-641258f324b1 tempest-VolumesExtendTest-863733137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.595s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:58:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bf28ec08-b8a7-4c0a-8f88-7e7e7e9a7ab1 tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.194s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:58:46 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-bf28ec08-b8a7-4c0a-8f88-7e7e7e9a7ab1 tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:58:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2065200680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d0af6f9-b75a-4e69-930b-7b2afae4410c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9fa81c71e7f4a93a6a9ed0b94d16a42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:58:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:58:47Z,use_quota=True,user_id='d3bcba3a3de54f05af82ff34f653b528',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:58:46 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-bf28ec08-b8a7-4c0a-8f88-7e7e7e9a7ab1 tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Creating volume 1d0af6f9-b75a-4e69-930b-7b2afae4410c {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:58:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bf28ec08-b8a7-4c0a-8f88-7e7e7e9a7ab1 tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:58:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bf28ec08-b8a7-4c0a-8f88-7e7e7e9a7ab1 tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:58:46 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-bf28ec08-b8a7-4c0a-8f88-7e7e7e9a7ab1 tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:58:46 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-bf28ec08-b8a7-4c0a-8f88-7e7e7e9a7ab1 tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:58:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bf28ec08-b8a7-4c0a-8f88-7e7e7e9a7ab1 tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:58:46 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-bf28ec08-b8a7-4c0a-8f88-7e7e7e9a7ab1 tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:58:46 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-bf28ec08-b8a7-4c0a-8f88-7e7e7e9a7ab1 tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:58:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bf28ec08-b8a7-4c0a-8f88-7e7e7e9a7ab1 tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1d0af6f9-b75a-4e69-930b-7b2afae4410c 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:46 devstack sudo[98693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1d0af6f9-b75a-4e69-930b-7b2afae4410c 1073741824 Sep 04 17:58:46 devstack sudo[98693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:46 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-f66b7c4d-2f24-4e37-a013-641258f324b1 tempest-VolumesExtendTest-863733137 None] Extend volume completed successfully. Sep 04 17:58:47 devstack sudo[98693]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bf28ec08-b8a7-4c0a-8f88-7e7e7e9a7ab1 tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1d0af6f9-b75a-4e69-930b-7b2afae4410c 1073741824" returned: 0 in 0.442s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bf28ec08-b8a7-4c0a-8f88-7e7e7e9a7ab1 tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1d0af6f9-b75a-4e69-930b-7b2afae4410c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:47 devstack sudo[98699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1d0af6f9-b75a-4e69-930b-7b2afae4410c Sep 04 17:58:47 devstack sudo[98699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:47 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3d225724-5ad2-4821-9fb0-248b41ed394d tempest-VolumesExtendTest-863733137 None] Acquiring lock "cinder-2bfee95e-2609-4f50-bf1b-ff1d42259d24-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:58:47 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3d225724-5ad2-4821-9fb0-248b41ed394d tempest-VolumesExtendTest-863733137 None] Lock "cinder-2bfee95e-2609-4f50-bf1b-ff1d42259d24-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:58:47 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3d225724-5ad2-4821-9fb0-248b41ed394d tempest-VolumesExtendTest-863733137 None] Acquiring lock "cinder-quobyte-625b3701-7454-4920-9a28-22688e3b1095" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:58:47 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3d225724-5ad2-4821-9fb0-248b41ed394d tempest-VolumesExtendTest-863733137 None] Lock "cinder-quobyte-625b3701-7454-4920-9a28-22688e3b1095" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:58:47 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3d225724-5ad2-4821-9fb0-248b41ed394d tempest-VolumesExtendTest-863733137 None] Acquiring lock "cinder-quobyte-2bfee95e-2609-4f50-bf1b-ff1d42259d24" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:58:47 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3d225724-5ad2-4821-9fb0-248b41ed394d tempest-VolumesExtendTest-863733137 None] Lock "cinder-quobyte-2bfee95e-2609-4f50-bf1b-ff1d42259d24" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:58:47 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-3d225724-5ad2-4821-9fb0-248b41ed394d tempest-VolumesExtendTest-863733137 None] Deleting offline snapshot 2bfee95e-2609-4f50-bf1b-ff1d42259d24 of volume 625b3701-7454-4920-9a28-22688e3b1095 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 17:58:47 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-3d225724-5ad2-4821-9fb0-248b41ed394d tempest-VolumesExtendTest-863733137 None] snapshot_file for this snap is: volume-625b3701-7454-4920-9a28-22688e3b1095.2bfee95e-2609-4f50-bf1b-ff1d42259d24 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 17:58:47 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeca3ef8-1049-47ad-a6f9-9f5f16e0223b]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:58:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3d225724-5ad2-4821-9fb0-248b41ed394d tempest-VolumesExtendTest-863733137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-625b3701-7454-4920-9a28-22688e3b1095.2bfee95e-2609-4f50-bf1b-ff1d42259d24 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:47 devstack sudo[98699]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bf28ec08-b8a7-4c0a-8f88-7e7e7e9a7ab1 tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1d0af6f9-b75a-4e69-930b-7b2afae4410c" returned: 0 in 0.371s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:47 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-bf28ec08-b8a7-4c0a-8f88-7e7e7e9a7ab1 tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:58:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bf28ec08-b8a7-4c0a-8f88-7e7e7e9a7ab1 tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:58:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bf28ec08-b8a7-4c0a-8f88-7e7e7e9a7ab1 tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36665334-5b60-48de-b88e-ab8f086bb1aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d0af6f9-b75a-4e69-930b-7b2afae4410c', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bf28ec08-b8a7-4c0a-8f88-7e7e7e9a7ab1 tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f77dabf9-f62f-4cbb-9a71-ecce54322acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:47 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-bf28ec08-b8a7-4c0a-8f88-7e7e7e9a7ab1 tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Volume volume-1d0af6f9-b75a-4e69-930b-7b2afae4410c (1d0af6f9-b75a-4e69-930b-7b2afae4410c): created successfully Sep 04 17:58:47 devstack sudo[98701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-625b3701-7454-4920-9a28-22688e3b1095.2bfee95e-2609-4f50-bf1b-ff1d42259d24 Sep 04 17:58:47 devstack sudo[98701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bf28ec08-b8a7-4c0a-8f88-7e7e7e9a7ab1 tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f77dabf9-f62f-4cbb-9a71-ecce54322acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bf28ec08-b8a7-4c0a-8f88-7e7e7e9a7ab1 tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Flow 'volume_create_manager' (7c038675-7150-41f5-af65-b79d9d2a3b92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:58:47 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-bf28ec08-b8a7-4c0a-8f88-7e7e7e9a7ab1 tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Created volume successfully. Sep 04 17:58:47 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-963a674a-532d-405f-bd1c-8718c33a6585 tempest-VolumeQuotasAdminTestJSON-1718847312 None] Transfer volume completed successfully. Sep 04 17:58:48 devstack sudo[98701]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3d225724-5ad2-4821-9fb0-248b41ed394d tempest-VolumesExtendTest-863733137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-625b3701-7454-4920-9a28-22688e3b1095.2bfee95e-2609-4f50-bf1b-ff1d42259d24" returned: 0 in 0.417s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:48 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-3d225724-5ad2-4821-9fb0-248b41ed394d tempest-VolumesExtendTest-863733137 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-625b3701-7454-4920-9a28-22688e3b1095(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 17:58:48 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[76cef975-2cb3-4e2f-b764-7940625185e8]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:58:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3d225724-5ad2-4821-9fb0-248b41ed394d tempest-VolumesExtendTest-863733137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-625b3701-7454-4920-9a28-22688e3b1095 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:48 devstack sudo[98707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-625b3701-7454-4920-9a28-22688e3b1095 Sep 04 17:58:48 devstack sudo[98707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:48 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-458f1cc7-7de1-4a4c-8e90-c7c1004d8a62 tempest-VolumeQuotasAdminTestJSON-1348057999 None] Acquiring lock "cinder-bdda5009-9f3a-48e2-b4da-c846a4aab004-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:58:48 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-458f1cc7-7de1-4a4c-8e90-c7c1004d8a62 tempest-VolumeQuotasAdminTestJSON-1348057999 None] Lock "cinder-bdda5009-9f3a-48e2-b4da-c846a4aab004-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:58:48 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-458f1cc7-7de1-4a4c-8e90-c7c1004d8a62 tempest-VolumeQuotasAdminTestJSON-1348057999 None] Acquiring lock "cinder-quobyte-bdda5009-9f3a-48e2-b4da-c846a4aab004" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:58:48 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-458f1cc7-7de1-4a4c-8e90-c7c1004d8a62 tempest-VolumeQuotasAdminTestJSON-1348057999 None] Lock "cinder-quobyte-bdda5009-9f3a-48e2-b4da-c846a4aab004" acquired by "delete_volume" :: waited 0.017s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:58:48 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[993adcf1-2ef0-4cf9-a7d4-3bec2d9113df]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:58:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-458f1cc7-7de1-4a4c-8e90-c7c1004d8a62 tempest-VolumeQuotasAdminTestJSON-1348057999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-bdda5009-9f3a-48e2-b4da-c846a4aab004 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:48 devstack sudo[98707]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3d225724-5ad2-4821-9fb0-248b41ed394d tempest-VolumesExtendTest-863733137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-625b3701-7454-4920-9a28-22688e3b1095" returned: 0 in 0.405s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3d225724-5ad2-4821-9fb0-248b41ed394d tempest-VolumesExtendTest-863733137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-625b3701-7454-4920-9a28-22688e3b1095.2bfee95e-2609-4f50-bf1b-ff1d42259d24 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:48 devstack sudo[98713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-625b3701-7454-4920-9a28-22688e3b1095.2bfee95e-2609-4f50-bf1b-ff1d42259d24 Sep 04 17:58:48 devstack sudo[98713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:48 devstack sudo[98712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-bdda5009-9f3a-48e2-b4da-c846a4aab004 Sep 04 17:58:48 devstack sudo[98712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:48 devstack sudo[98712]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-458f1cc7-7de1-4a4c-8e90-c7c1004d8a62 tempest-VolumeQuotasAdminTestJSON-1348057999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-bdda5009-9f3a-48e2-b4da-c846a4aab004" returned: 0 in 0.407s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-458f1cc7-7de1-4a4c-8e90-c7c1004d8a62 tempest-VolumeQuotasAdminTestJSON-1348057999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-bdda5009-9f3a-48e2-b4da-c846a4aab004 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:48 devstack sudo[98723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-bdda5009-9f3a-48e2-b4da-c846a4aab004 Sep 04 17:58:48 devstack sudo[98723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:48 devstack sudo[98713]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3d225724-5ad2-4821-9fb0-248b41ed394d tempest-VolumesExtendTest-863733137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-625b3701-7454-4920-9a28-22688e3b1095.2bfee95e-2609-4f50-bf1b-ff1d42259d24" returned: 0 in 0.433s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3d225724-5ad2-4821-9fb0-248b41ed394d tempest-VolumesExtendTest-863733137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-625b3701-7454-4920-9a28-22688e3b1095.2bfee95e-2609-4f50-bf1b-ff1d42259d24 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:48 devstack sudo[98725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-625b3701-7454-4920-9a28-22688e3b1095.2bfee95e-2609-4f50-bf1b-ff1d42259d24 Sep 04 17:58:48 devstack sudo[98725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ff7e9e18-ffbb-4893-b862-25452aef2ddf tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:58:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ff7e9e18-ffbb-4893-b862-25452aef2ddf tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:58:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-ff7e9e18-ffbb-4893-b862-25452aef2ddf tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Creating offline snapshot 62108a56-fb31-4cd0-81f7-d51078ba150d of volume 1d0af6f9-b75a-4e69-930b-7b2afae4410c {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 17:58:49 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[405816ec-e489-4e80-a06b-967ae6a9ae66]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:58:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ff7e9e18-ffbb-4893-b862-25452aef2ddf tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1d0af6f9-b75a-4e69-930b-7b2afae4410c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:49 devstack sudo[98727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1d0af6f9-b75a-4e69-930b-7b2afae4410c Sep 04 17:58:49 devstack sudo[98727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:49 devstack sudo[98723]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-458f1cc7-7de1-4a4c-8e90-c7c1004d8a62 tempest-VolumeQuotasAdminTestJSON-1348057999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-bdda5009-9f3a-48e2-b4da-c846a4aab004" returned: 0 in 0.284s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-458f1cc7-7de1-4a4c-8e90-c7c1004d8a62 tempest-VolumeQuotasAdminTestJSON-1348057999 None] Lock "cinder-quobyte-bdda5009-9f3a-48e2-b4da-c846a4aab004" released by "delete_volume" :: held 0.731s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:58:49 devstack sudo[98725]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3d225724-5ad2-4821-9fb0-248b41ed394d tempest-VolumesExtendTest-863733137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-625b3701-7454-4920-9a28-22688e3b1095.2bfee95e-2609-4f50-bf1b-ff1d42259d24" returned: 0 in 0.276s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:49 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-458f1cc7-7de1-4a4c-8e90-c7c1004d8a62 tempest-VolumeQuotasAdminTestJSON-1348057999 None] Created reservations ['b166ca45-fe86-4370-bd6d-d4bd5e7d1fdf', 'd560a3ad-cdb2-42b4-8374-952fb36ee5c1', '0c063b9a-2142-4cae-96be-0b9de31cc80c', 'e7ab3c36-a715-42ba-94e1-1acaba6d9790'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:58:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3d225724-5ad2-4821-9fb0-248b41ed394d tempest-VolumesExtendTest-863733137 None] Lock "cinder-quobyte-2bfee95e-2609-4f50-bf1b-ff1d42259d24" released by "_delete_snapshot" :: held 1.662s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:58:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3d225724-5ad2-4821-9fb0-248b41ed394d tempest-VolumesExtendTest-863733137 None] Lock "cinder-quobyte-625b3701-7454-4920-9a28-22688e3b1095" released by "delete_snapshot" :: held 1.693s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:58:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-458f1cc7-7de1-4a4c-8e90-c7c1004d8a62 tempest-VolumeQuotasAdminTestJSON-1348057999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:58:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-458f1cc7-7de1-4a4c-8e90-c7c1004d8a62 tempest-VolumeQuotasAdminTestJSON-1348057999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:58:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-458f1cc7-7de1-4a4c-8e90-c7c1004d8a62 tempest-VolumeQuotasAdminTestJSON-1348057999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:58:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-458f1cc7-7de1-4a4c-8e90-c7c1004d8a62 tempest-VolumeQuotasAdminTestJSON-1348057999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:58:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-458f1cc7-7de1-4a4c-8e90-c7c1004d8a62 tempest-VolumeQuotasAdminTestJSON-1348057999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:58:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-458f1cc7-7de1-4a4c-8e90-c7c1004d8a62 tempest-VolumeQuotasAdminTestJSON-1348057999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:49 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-3d225724-5ad2-4821-9fb0-248b41ed394d tempest-VolumesExtendTest-863733137 None] Created reservations ['7c48f06e-3852-459f-a6a9-4923e8de105c', '25bdd7be-f70c-4d35-8f95-4b05ff94b817', '98f87d3e-9324-46d4-91e2-304262eb156a', 'c17cdbab-57d5-4106-b753-6971b1b0c2b4'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:58:49 devstack sudo[98733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:58:49 devstack sudo[98733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:49 devstack sudo[98727]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:49 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-3d225724-5ad2-4821-9fb0-248b41ed394d tempest-VolumesExtendTest-863733137 None] Delete snapshot completed successfully. Sep 04 17:58:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ff7e9e18-ffbb-4893-b862-25452aef2ddf tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1d0af6f9-b75a-4e69-930b-7b2afae4410c" returned: 0 in 0.422s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ff7e9e18-ffbb-4893-b862-25452aef2ddf tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1d0af6f9-b75a-4e69-930b-7b2afae4410c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1d0af6f9-b75a-4e69-930b-7b2afae4410c.62108a56-fb31-4cd0-81f7-d51078ba150d 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3d225724-5ad2-4821-9fb0-248b41ed394d tempest-VolumesExtendTest-863733137 None] Lock "cinder-2bfee95e-2609-4f50-bf1b-ff1d42259d24-delete_snapshot" released by "delete_snapshot" :: held 1.911s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:58:49 devstack sudo[98736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1d0af6f9-b75a-4e69-930b-7b2afae4410c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1d0af6f9-b75a-4e69-930b-7b2afae4410c.62108a56-fb31-4cd0-81f7-d51078ba150d 1G Sep 04 17:58:49 devstack sudo[98736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:49 devstack sudo[98733]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-458f1cc7-7de1-4a4c-8e90-c7c1004d8a62 tempest-VolumeQuotasAdminTestJSON-1348057999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.297s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:49 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-458f1cc7-7de1-4a4c-8e90-c7c1004d8a62 tempest-VolumeQuotasAdminTestJSON-1348057999 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:58:49 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-458f1cc7-7de1-4a4c-8e90-c7c1004d8a62 tempest-VolumeQuotasAdminTestJSON-1348057999 None] Deleted volume successfully. Sep 04 17:58:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-458f1cc7-7de1-4a4c-8e90-c7c1004d8a62 tempest-VolumeQuotasAdminTestJSON-1348057999 None] Lock "cinder-bdda5009-9f3a-48e2-b4da-c846a4aab004-delete_volume" released by "delete_volume" :: held 1.284s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:58:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-1a6d1c5c-fbb7-4485-88b2-541117325069 tempest-VolumesExtendTest-863733137 None] Acquiring lock "cinder-625b3701-7454-4920-9a28-22688e3b1095-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:58:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-1a6d1c5c-fbb7-4485-88b2-541117325069 tempest-VolumesExtendTest-863733137 None] Lock "cinder-625b3701-7454-4920-9a28-22688e3b1095-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:58:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-1a6d1c5c-fbb7-4485-88b2-541117325069 tempest-VolumesExtendTest-863733137 None] Acquiring lock "cinder-quobyte-625b3701-7454-4920-9a28-22688e3b1095" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:58:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-1a6d1c5c-fbb7-4485-88b2-541117325069 tempest-VolumesExtendTest-863733137 None] Lock "cinder-quobyte-625b3701-7454-4920-9a28-22688e3b1095" acquired by "delete_volume" :: waited 0.017s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:58:49 devstack sudo[98736]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ff7e9e18-ffbb-4893-b862-25452aef2ddf tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1d0af6f9-b75a-4e69-930b-7b2afae4410c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1d0af6f9-b75a-4e69-930b-7b2afae4410c.62108a56-fb31-4cd0-81f7-d51078ba150d 1G" returned: 0 in 0.549s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ff7e9e18-ffbb-4893-b862-25452aef2ddf tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d0af6f9-b75a-4e69-930b-7b2afae4410c -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1d0af6f9-b75a-4e69-930b-7b2afae4410c.62108a56-fb31-4cd0-81f7-d51078ba150d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:50 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc730e01-914d-4c70-8873-5781f287e9b3]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:58:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1a6d1c5c-fbb7-4485-88b2-541117325069 tempest-VolumesExtendTest-863733137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-625b3701-7454-4920-9a28-22688e3b1095 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:50 devstack sudo[98743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d0af6f9-b75a-4e69-930b-7b2afae4410c -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1d0af6f9-b75a-4e69-930b-7b2afae4410c.62108a56-fb31-4cd0-81f7-d51078ba150d Sep 04 17:58:50 devstack sudo[98743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:50 devstack sudo[98744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-625b3701-7454-4920-9a28-22688e3b1095 Sep 04 17:58:50 devstack sudo[98744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:50 devstack sudo[98743]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ff7e9e18-ffbb-4893-b862-25452aef2ddf tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d0af6f9-b75a-4e69-930b-7b2afae4410c -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1d0af6f9-b75a-4e69-930b-7b2afae4410c.62108a56-fb31-4cd0-81f7-d51078ba150d" returned: 0 in 0.336s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:50 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-ff7e9e18-ffbb-4893-b862-25452aef2ddf tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1d0af6f9-b75a-4e69-930b-7b2afae4410c.62108a56-fb31-4cd0-81f7-d51078ba150d is being set with open permissions: ugo+rw Sep 04 17:58:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ff7e9e18-ffbb-4893-b862-25452aef2ddf tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1d0af6f9-b75a-4e69-930b-7b2afae4410c.62108a56-fb31-4cd0-81f7-d51078ba150d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:50 devstack sudo[98752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1d0af6f9-b75a-4e69-930b-7b2afae4410c.62108a56-fb31-4cd0-81f7-d51078ba150d Sep 04 17:58:50 devstack sudo[98752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:50 devstack sudo[98744]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1a6d1c5c-fbb7-4485-88b2-541117325069 tempest-VolumesExtendTest-863733137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-625b3701-7454-4920-9a28-22688e3b1095" returned: 0 in 0.394s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1a6d1c5c-fbb7-4485-88b2-541117325069 tempest-VolumesExtendTest-863733137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-625b3701-7454-4920-9a28-22688e3b1095 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:50 devstack sudo[98756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-625b3701-7454-4920-9a28-22688e3b1095 Sep 04 17:58:50 devstack sudo[98756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:50 devstack sudo[98752]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ff7e9e18-ffbb-4893-b862-25452aef2ddf tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1d0af6f9-b75a-4e69-930b-7b2afae4410c.62108a56-fb31-4cd0-81f7-d51078ba150d" returned: 0 in 0.281s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:50 devstack sudo[98756]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1a6d1c5c-fbb7-4485-88b2-541117325069 tempest-VolumesExtendTest-863733137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-625b3701-7454-4920-9a28-22688e3b1095" returned: 0 in 0.266s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ff7e9e18-ffbb-4893-b862-25452aef2ddf tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1d0af6f9-b75a-4e69-930b-7b2afae4410c.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:50 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-1a6d1c5c-fbb7-4485-88b2-541117325069 tempest-VolumesExtendTest-863733137 None] Lock "cinder-quobyte-625b3701-7454-4920-9a28-22688e3b1095" released by "delete_volume" :: held 0.766s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:58:50 devstack sudo[98760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1d0af6f9-b75a-4e69-930b-7b2afae4410c.info Sep 04 17:58:50 devstack sudo[98760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:50 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-1a6d1c5c-fbb7-4485-88b2-541117325069 tempest-VolumesExtendTest-863733137 None] Created reservations ['63a2b873-7cc0-444c-816e-09b7e1542ba9', 'e5939457-ff2b-46ab-a242-5c993cb3aa4e', 'd3f86610-4725-4bb1-85fd-43981ecab37a', '19014b05-3204-4cb8-ba90-238787d2e614'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:58:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1a6d1c5c-fbb7-4485-88b2-541117325069 tempest-VolumesExtendTest-863733137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:58:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1a6d1c5c-fbb7-4485-88b2-541117325069 tempest-VolumesExtendTest-863733137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:58:50 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-1a6d1c5c-fbb7-4485-88b2-541117325069 tempest-VolumesExtendTest-863733137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:58:50 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-1a6d1c5c-fbb7-4485-88b2-541117325069 tempest-VolumesExtendTest-863733137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:58:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1a6d1c5c-fbb7-4485-88b2-541117325069 tempest-VolumesExtendTest-863733137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:58:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1a6d1c5c-fbb7-4485-88b2-541117325069 tempest-VolumesExtendTest-863733137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:50 devstack sudo[98762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:58:50 devstack sudo[98762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:51 devstack sudo[98760]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ff7e9e18-ffbb-4893-b862-25452aef2ddf tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1d0af6f9-b75a-4e69-930b-7b2afae4410c.info" returned: 0 in 0.312s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:51 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-ff7e9e18-ffbb-4893-b862-25452aef2ddf tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1d0af6f9-b75a-4e69-930b-7b2afae4410c.info is being set with open permissions: ugo+rw Sep 04 17:58:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ff7e9e18-ffbb-4893-b862-25452aef2ddf tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1d0af6f9-b75a-4e69-930b-7b2afae4410c.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:51 devstack sudo[98765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1d0af6f9-b75a-4e69-930b-7b2afae4410c.info Sep 04 17:58:51 devstack sudo[98765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:51 devstack sudo[98762]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1a6d1c5c-fbb7-4485-88b2-541117325069 tempest-VolumesExtendTest-863733137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.307s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:51 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-1a6d1c5c-fbb7-4485-88b2-541117325069 tempest-VolumesExtendTest-863733137 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:58:51 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-1a6d1c5c-fbb7-4485-88b2-541117325069 tempest-VolumesExtendTest-863733137 None] Deleted volume successfully. Sep 04 17:58:51 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-1a6d1c5c-fbb7-4485-88b2-541117325069 tempest-VolumesExtendTest-863733137 None] Lock "cinder-625b3701-7454-4920-9a28-22688e3b1095-delete_volume" released by "delete_volume" :: held 1.317s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:58:51 devstack sudo[98765]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ff7e9e18-ffbb-4893-b862-25452aef2ddf tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1d0af6f9-b75a-4e69-930b-7b2afae4410c.info" returned: 0 in 0.295s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ff7e9e18-ffbb-4893-b862-25452aef2ddf tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.347s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:58:51 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-ff7e9e18-ffbb-4893-b862-25452aef2ddf tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Create snapshot completed successfully Sep 04 17:58:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6e55aaac-842d-4d6c-9028-643a87da968e tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Acquiring lock "cinder-62108a56-fb31-4cd0-81f7-d51078ba150d-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:58:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6e55aaac-842d-4d6c-9028-643a87da968e tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Lock "cinder-62108a56-fb31-4cd0-81f7-d51078ba150d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:58:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6e55aaac-842d-4d6c-9028-643a87da968e tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Acquiring lock "cinder-quobyte-1d0af6f9-b75a-4e69-930b-7b2afae4410c" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:58:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6e55aaac-842d-4d6c-9028-643a87da968e tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Lock "cinder-quobyte-1d0af6f9-b75a-4e69-930b-7b2afae4410c" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:58:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6e55aaac-842d-4d6c-9028-643a87da968e tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Acquiring lock "cinder-quobyte-62108a56-fb31-4cd0-81f7-d51078ba150d" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:58:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6e55aaac-842d-4d6c-9028-643a87da968e tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Lock "cinder-quobyte-62108a56-fb31-4cd0-81f7-d51078ba150d" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:58:52 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-6e55aaac-842d-4d6c-9028-643a87da968e tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Deleting offline snapshot 62108a56-fb31-4cd0-81f7-d51078ba150d of volume 1d0af6f9-b75a-4e69-930b-7b2afae4410c {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 17:58:52 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-6e55aaac-842d-4d6c-9028-643a87da968e tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] snapshot_file for this snap is: volume-1d0af6f9-b75a-4e69-930b-7b2afae4410c.62108a56-fb31-4cd0-81f7-d51078ba150d {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 17:58:52 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0721499-d08d-40be-9aa8-de0c0771584a]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:58:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6e55aaac-842d-4d6c-9028-643a87da968e tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1d0af6f9-b75a-4e69-930b-7b2afae4410c.62108a56-fb31-4cd0-81f7-d51078ba150d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:53 devstack sudo[98769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1d0af6f9-b75a-4e69-930b-7b2afae4410c.62108a56-fb31-4cd0-81f7-d51078ba150d Sep 04 17:58:53 devstack sudo[98769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:53 devstack sudo[98769]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6e55aaac-842d-4d6c-9028-643a87da968e tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1d0af6f9-b75a-4e69-930b-7b2afae4410c.62108a56-fb31-4cd0-81f7-d51078ba150d" returned: 0 in 0.404s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:53 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-6e55aaac-842d-4d6c-9028-643a87da968e tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d0af6f9-b75a-4e69-930b-7b2afae4410c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 17:58:53 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff02715-f4e6-46cf-8316-aee2d36e2699]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:58:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6e55aaac-842d-4d6c-9028-643a87da968e tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1d0af6f9-b75a-4e69-930b-7b2afae4410c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:53 devstack sudo[98774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1d0af6f9-b75a-4e69-930b-7b2afae4410c Sep 04 17:58:53 devstack sudo[98774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:53 devstack sudo[98774]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6e55aaac-842d-4d6c-9028-643a87da968e tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1d0af6f9-b75a-4e69-930b-7b2afae4410c" returned: 0 in 0.435s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6e55aaac-842d-4d6c-9028-643a87da968e tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1d0af6f9-b75a-4e69-930b-7b2afae4410c.62108a56-fb31-4cd0-81f7-d51078ba150d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:53 devstack sudo[98780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1d0af6f9-b75a-4e69-930b-7b2afae4410c.62108a56-fb31-4cd0-81f7-d51078ba150d Sep 04 17:58:53 devstack sudo[98780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:54 devstack sudo[98780]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6e55aaac-842d-4d6c-9028-643a87da968e tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1d0af6f9-b75a-4e69-930b-7b2afae4410c.62108a56-fb31-4cd0-81f7-d51078ba150d" returned: 0 in 0.399s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6e55aaac-842d-4d6c-9028-643a87da968e tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1d0af6f9-b75a-4e69-930b-7b2afae4410c.62108a56-fb31-4cd0-81f7-d51078ba150d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:54 devstack sudo[98786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1d0af6f9-b75a-4e69-930b-7b2afae4410c.62108a56-fb31-4cd0-81f7-d51078ba150d Sep 04 17:58:54 devstack sudo[98786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:54 devstack sudo[98786]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6e55aaac-842d-4d6c-9028-643a87da968e tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1d0af6f9-b75a-4e69-930b-7b2afae4410c.62108a56-fb31-4cd0-81f7-d51078ba150d" returned: 0 in 0.305s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:54 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6e55aaac-842d-4d6c-9028-643a87da968e tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Lock "cinder-quobyte-62108a56-fb31-4cd0-81f7-d51078ba150d" released by "_delete_snapshot" :: held 1.696s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:58:54 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6e55aaac-842d-4d6c-9028-643a87da968e tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Lock "cinder-quobyte-1d0af6f9-b75a-4e69-930b-7b2afae4410c" released by "delete_snapshot" :: held 1.735s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:58:54 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-6e55aaac-842d-4d6c-9028-643a87da968e tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Created reservations ['3d062a74-a046-4aea-a975-20ea3719d0dc', '88387b66-d92f-468e-9bac-4dd32c171a87', 'f9164f40-0074-4d03-b83e-289e445b1df7', 'b0607945-76de-470b-9927-c5449372fcc2'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:58:54 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-6e55aaac-842d-4d6c-9028-643a87da968e tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Delete snapshot completed successfully. Sep 04 17:58:54 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6e55aaac-842d-4d6c-9028-643a87da968e tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Lock "cinder-62108a56-fb31-4cd0-81f7-d51078ba150d-delete_snapshot" released by "delete_snapshot" :: held 1.972s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:58:55 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-220b207f-da9c-4685-9daf-6099965cfc94 tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Acquiring lock "cinder-1d0af6f9-b75a-4e69-930b-7b2afae4410c-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:58:55 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-220b207f-da9c-4685-9daf-6099965cfc94 tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Lock "cinder-1d0af6f9-b75a-4e69-930b-7b2afae4410c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:58:55 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-220b207f-da9c-4685-9daf-6099965cfc94 tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Acquiring lock "cinder-quobyte-1d0af6f9-b75a-4e69-930b-7b2afae4410c" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:58:55 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-220b207f-da9c-4685-9daf-6099965cfc94 tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Lock "cinder-quobyte-1d0af6f9-b75a-4e69-930b-7b2afae4410c" acquired by "delete_volume" :: waited 0.017s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:58:55 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[c629143a-5343-447a-98f9-e3124ac88156]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:58:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-220b207f-da9c-4685-9daf-6099965cfc94 tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1d0af6f9-b75a-4e69-930b-7b2afae4410c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:55 devstack sudo[98789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1d0af6f9-b75a-4e69-930b-7b2afae4410c Sep 04 17:58:55 devstack sudo[98789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:55 devstack sudo[98789]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-220b207f-da9c-4685-9daf-6099965cfc94 tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1d0af6f9-b75a-4e69-930b-7b2afae4410c" returned: 0 in 0.427s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-220b207f-da9c-4685-9daf-6099965cfc94 tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1d0af6f9-b75a-4e69-930b-7b2afae4410c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:55 devstack sudo[98795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1d0af6f9-b75a-4e69-930b-7b2afae4410c Sep 04 17:58:55 devstack sudo[98795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:55 devstack sudo[98795]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-220b207f-da9c-4685-9daf-6099965cfc94 tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1d0af6f9-b75a-4e69-930b-7b2afae4410c" returned: 0 in 0.252s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:55 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-220b207f-da9c-4685-9daf-6099965cfc94 tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Lock "cinder-quobyte-1d0af6f9-b75a-4e69-930b-7b2afae4410c" released by "delete_volume" :: held 0.756s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:58:55 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-220b207f-da9c-4685-9daf-6099965cfc94 tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Created reservations ['29931229-685a-4dea-8f78-ba747fdd1905', '5cb968dd-9833-427e-a16d-bdcd03c4d96f', '9cf51942-31e1-4965-b012-7c8848fcf967', '52f5f55b-04ff-4876-a3f7-a132829c7165'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:58:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-220b207f-da9c-4685-9daf-6099965cfc94 tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:58:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-220b207f-da9c-4685-9daf-6099965cfc94 tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:58:56 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-220b207f-da9c-4685-9daf-6099965cfc94 tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:58:56 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-220b207f-da9c-4685-9daf-6099965cfc94 tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:58:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-220b207f-da9c-4685-9daf-6099965cfc94 tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:58:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-220b207f-da9c-4685-9daf-6099965cfc94 tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:56 devstack sudo[98798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:58:56 devstack sudo[98798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:56 devstack sudo[98798]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-220b207f-da9c-4685-9daf-6099965cfc94 tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.274s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:56 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-220b207f-da9c-4685-9daf-6099965cfc94 tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:58:56 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-220b207f-da9c-4685-9daf-6099965cfc94 tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Deleted volume successfully. Sep 04 17:58:56 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-220b207f-da9c-4685-9daf-6099965cfc94 tempest-VolumeSnapshotQuotasNegativeTestJSON-414350074 None] Lock "cinder-1d0af6f9-b75a-4e69-930b-7b2afae4410c-delete_volume" released by "delete_volume" :: held 1.300s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:58:59 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bb9b170-e3e6-4463-8583-90eaaacea3c0 tempest-VolumeTypesAccessTest-1208870650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:58:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7bb9b170-e3e6-4463-8583-90eaaacea3c0 tempest-VolumeTypesAccessTest-1208870650 None] Flow 'volume_create_manager' (4ddb0d16-1974-4362-b6ec-158874279bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:58:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7bb9b170-e3e6-4463-8583-90eaaacea3c0 tempest-VolumeTypesAccessTest-1208870650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81019bec-e9d1-4c6d-b449-a5c2aa8246c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7bb9b170-e3e6-4463-8583-90eaaacea3c0 tempest-VolumeTypesAccessTest-1208870650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81019bec-e9d1-4c6d-b449-a5c2aa8246c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:58:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1662054072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4465af46-9470-4a0e-a9e2-b72dcdd3e901,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b58df43c0ca481ca9c889871c9e3a93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:58:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:58:59Z,use_quota=True,user_id='b6cf46de0871471787268f79bcc046f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70d05201-c4c5-4d79-b94f-fd59815b9dfe),volume_type_id=70d05201-c4c5-4d79-b94f-fd59815b9dfe)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7bb9b170-e3e6-4463-8583-90eaaacea3c0 tempest-VolumeTypesAccessTest-1208870650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2f955d8-c162-4001-8924-3a53db822507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7bb9b170-e3e6-4463-8583-90eaaacea3c0 tempest-VolumeTypesAccessTest-1208870650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2f955d8-c162-4001-8924-3a53db822507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7bb9b170-e3e6-4463-8583-90eaaacea3c0 tempest-VolumeTypesAccessTest-1208870650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4151e059-e41a-48e7-8768-b673c09acbcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7bb9b170-e3e6-4463-8583-90eaaacea3c0 tempest-VolumeTypesAccessTest-1208870650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4151e059-e41a-48e7-8768-b673c09acbcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4465af46-9470-4a0e-a9e2-b72dcdd3e901', 'volume_name': 'volume-4465af46-9470-4a0e-a9e2-b72dcdd3e901', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7bb9b170-e3e6-4463-8583-90eaaacea3c0 tempest-VolumeTypesAccessTest-1208870650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3218d8f0-ee0d-4cb1-8b1a-0aa750b44a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7bb9b170-e3e6-4463-8583-90eaaacea3c0 tempest-VolumeTypesAccessTest-1208870650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3218d8f0-ee0d-4cb1-8b1a-0aa750b44a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:58:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7bb9b170-e3e6-4463-8583-90eaaacea3c0 tempest-VolumeTypesAccessTest-1208870650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e213c91-62d4-4340-9a72-75c59958b12d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:58:59 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-7bb9b170-e3e6-4463-8583-90eaaacea3c0 tempest-VolumeTypesAccessTest-1208870650 None] Volume 4465af46-9470-4a0e-a9e2-b72dcdd3e901: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4465af46-9470-4a0e-a9e2-b72dcdd3e901', 'volume_size': 1} Sep 04 17:58:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7bb9b170-e3e6-4463-8583-90eaaacea3c0 tempest-VolumeTypesAccessTest-1208870650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:58:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7bb9b170-e3e6-4463-8583-90eaaacea3c0 tempest-VolumeTypesAccessTest-1208870650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:58:59 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7bb9b170-e3e6-4463-8583-90eaaacea3c0 tempest-VolumeTypesAccessTest-1208870650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:58:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1662054072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4465af46-9470-4a0e-a9e2-b72dcdd3e901,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b58df43c0ca481ca9c889871c9e3a93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:58:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:58:59Z,use_quota=True,user_id='b6cf46de0871471787268f79bcc046f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70d05201-c4c5-4d79-b94f-fd59815b9dfe),volume_type_id=70d05201-c4c5-4d79-b94f-fd59815b9dfe)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:58:59 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-7bb9b170-e3e6-4463-8583-90eaaacea3c0 tempest-VolumeTypesAccessTest-1208870650 None] Creating volume 4465af46-9470-4a0e-a9e2-b72dcdd3e901 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:58:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7bb9b170-e3e6-4463-8583-90eaaacea3c0 tempest-VolumeTypesAccessTest-1208870650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:58:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7bb9b170-e3e6-4463-8583-90eaaacea3c0 tempest-VolumeTypesAccessTest-1208870650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:58:59 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7bb9b170-e3e6-4463-8583-90eaaacea3c0 tempest-VolumeTypesAccessTest-1208870650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:58:59 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7bb9b170-e3e6-4463-8583-90eaaacea3c0 tempest-VolumeTypesAccessTest-1208870650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:58:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7bb9b170-e3e6-4463-8583-90eaaacea3c0 tempest-VolumeTypesAccessTest-1208870650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:58:59 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7bb9b170-e3e6-4463-8583-90eaaacea3c0 tempest-VolumeTypesAccessTest-1208870650 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:58:59 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-7bb9b170-e3e6-4463-8583-90eaaacea3c0 tempest-VolumeTypesAccessTest-1208870650 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:58:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7bb9b170-e3e6-4463-8583-90eaaacea3c0 tempest-VolumeTypesAccessTest-1208870650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4465af46-9470-4a0e-a9e2-b72dcdd3e901 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:59 devstack sudo[98801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4465af46-9470-4a0e-a9e2-b72dcdd3e901 1073741824 Sep 04 17:58:59 devstack sudo[98801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:58:59 devstack sudo[98801]: pam_unix(sudo:session): session closed for user root Sep 04 17:58:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7bb9b170-e3e6-4463-8583-90eaaacea3c0 tempest-VolumeTypesAccessTest-1208870650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4465af46-9470-4a0e-a9e2-b72dcdd3e901 1073741824" returned: 0 in 0.515s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:58:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7bb9b170-e3e6-4463-8583-90eaaacea3c0 tempest-VolumeTypesAccessTest-1208870650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4465af46-9470-4a0e-a9e2-b72dcdd3e901 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:58:59 devstack sudo[98807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4465af46-9470-4a0e-a9e2-b72dcdd3e901 Sep 04 17:58:59 devstack sudo[98807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:59:00 devstack sudo[98807]: pam_unix(sudo:session): session closed for user root Sep 04 17:59:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7bb9b170-e3e6-4463-8583-90eaaacea3c0 tempest-VolumeTypesAccessTest-1208870650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4465af46-9470-4a0e-a9e2-b72dcdd3e901" returned: 0 in 0.287s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:59:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7bb9b170-e3e6-4463-8583-90eaaacea3c0 tempest-VolumeTypesAccessTest-1208870650 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:59:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7bb9b170-e3e6-4463-8583-90eaaacea3c0 tempest-VolumeTypesAccessTest-1208870650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:59:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7bb9b170-e3e6-4463-8583-90eaaacea3c0 tempest-VolumeTypesAccessTest-1208870650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e213c91-62d4-4340-9a72-75c59958b12d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4465af46-9470-4a0e-a9e2-b72dcdd3e901', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:59:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7bb9b170-e3e6-4463-8583-90eaaacea3c0 tempest-VolumeTypesAccessTest-1208870650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf49c880-34f1-4eb7-b037-ae5a469c72b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:59:00 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-7bb9b170-e3e6-4463-8583-90eaaacea3c0 tempest-VolumeTypesAccessTest-1208870650 None] Volume volume-4465af46-9470-4a0e-a9e2-b72dcdd3e901 (4465af46-9470-4a0e-a9e2-b72dcdd3e901): created successfully Sep 04 17:59:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7bb9b170-e3e6-4463-8583-90eaaacea3c0 tempest-VolumeTypesAccessTest-1208870650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf49c880-34f1-4eb7-b037-ae5a469c72b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:59:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7bb9b170-e3e6-4463-8583-90eaaacea3c0 tempest-VolumeTypesAccessTest-1208870650 None] Flow 'volume_create_manager' (4ddb0d16-1974-4362-b6ec-158874279bc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:59:00 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-7bb9b170-e3e6-4463-8583-90eaaacea3c0 tempest-VolumeTypesAccessTest-1208870650 None] Created volume successfully. Sep 04 17:59:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0d627d13-7870-4b6e-9532-bf8b112a4786 tempest-VolumeTypesAccessTest-1208870650 None] Acquiring lock "cinder-4465af46-9470-4a0e-a9e2-b72dcdd3e901-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:59:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0d627d13-7870-4b6e-9532-bf8b112a4786 tempest-VolumeTypesAccessTest-1208870650 None] Lock "cinder-4465af46-9470-4a0e-a9e2-b72dcdd3e901-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:59:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0d627d13-7870-4b6e-9532-bf8b112a4786 tempest-VolumeTypesAccessTest-1208870650 None] Acquiring lock "cinder-quobyte-4465af46-9470-4a0e-a9e2-b72dcdd3e901" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:59:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0d627d13-7870-4b6e-9532-bf8b112a4786 tempest-VolumeTypesAccessTest-1208870650 None] Lock "cinder-quobyte-4465af46-9470-4a0e-a9e2-b72dcdd3e901" acquired by "delete_volume" :: waited 0.036s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:59:01 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5d56f3-c8a2-4992-ade5-0248cedfbe6f]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:59:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0d627d13-7870-4b6e-9532-bf8b112a4786 tempest-VolumeTypesAccessTest-1208870650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4465af46-9470-4a0e-a9e2-b72dcdd3e901 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:59:01 devstack sudo[98817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4465af46-9470-4a0e-a9e2-b72dcdd3e901 Sep 04 17:59:01 devstack sudo[98817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:59:01 devstack sudo[98817]: pam_unix(sudo:session): session closed for user root Sep 04 17:59:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0d627d13-7870-4b6e-9532-bf8b112a4786 tempest-VolumeTypesAccessTest-1208870650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4465af46-9470-4a0e-a9e2-b72dcdd3e901" returned: 0 in 0.425s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:59:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0d627d13-7870-4b6e-9532-bf8b112a4786 tempest-VolumeTypesAccessTest-1208870650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4465af46-9470-4a0e-a9e2-b72dcdd3e901 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:59:01 devstack sudo[98822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4465af46-9470-4a0e-a9e2-b72dcdd3e901 Sep 04 17:59:01 devstack sudo[98822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:59:02 devstack sudo[98822]: pam_unix(sudo:session): session closed for user root Sep 04 17:59:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0d627d13-7870-4b6e-9532-bf8b112a4786 tempest-VolumeTypesAccessTest-1208870650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4465af46-9470-4a0e-a9e2-b72dcdd3e901" returned: 0 in 0.286s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:59:02 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0d627d13-7870-4b6e-9532-bf8b112a4786 tempest-VolumeTypesAccessTest-1208870650 None] Lock "cinder-quobyte-4465af46-9470-4a0e-a9e2-b72dcdd3e901" released by "delete_volume" :: held 0.773s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:59:02 devstack cinder-volume[87314]: WARNING cinder.quota [None req-0d627d13-7870-4b6e-9532-bf8b112a4786 tempest-VolumeTypesAccessTest-1208870650 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1699345702 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1699345702, it is now deprecated. Please use the default quota class for default quota. Sep 04 17:59:02 devstack cinder-volume[87314]: WARNING cinder.quota [None req-0d627d13-7870-4b6e-9532-bf8b112a4786 tempest-VolumeTypesAccessTest-1208870650 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1699345702 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1699345702, it is now deprecated. Please use the default quota class for default quota. Sep 04 17:59:02 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-0d627d13-7870-4b6e-9532-bf8b112a4786 tempest-VolumeTypesAccessTest-1208870650 None] Created reservations ['5fbeec55-c859-4589-ba9d-4f54338e5c8e', 'c19963f8-59f7-47e4-9f57-22f80763e164', 'b4ad1cec-3b4b-4a4c-9a0a-2ea8129aee22', '9b1171ec-9d6d-4c63-8f2a-20c9a080bb2a'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:59:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0d627d13-7870-4b6e-9532-bf8b112a4786 tempest-VolumeTypesAccessTest-1208870650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:59:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0d627d13-7870-4b6e-9532-bf8b112a4786 tempest-VolumeTypesAccessTest-1208870650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:59:02 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0d627d13-7870-4b6e-9532-bf8b112a4786 tempest-VolumeTypesAccessTest-1208870650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:59:02 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0d627d13-7870-4b6e-9532-bf8b112a4786 tempest-VolumeTypesAccessTest-1208870650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:59:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0d627d13-7870-4b6e-9532-bf8b112a4786 tempest-VolumeTypesAccessTest-1208870650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:59:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0d627d13-7870-4b6e-9532-bf8b112a4786 tempest-VolumeTypesAccessTest-1208870650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:59:02 devstack sudo[98825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:59:02 devstack sudo[98825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:59:02 devstack sudo[98825]: pam_unix(sudo:session): session closed for user root Sep 04 17:59:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0d627d13-7870-4b6e-9532-bf8b112a4786 tempest-VolumeTypesAccessTest-1208870650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.469s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:59:02 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-0d627d13-7870-4b6e-9532-bf8b112a4786 tempest-VolumeTypesAccessTest-1208870650 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:59:02 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-0d627d13-7870-4b6e-9532-bf8b112a4786 tempest-VolumeTypesAccessTest-1208870650 None] Deleted volume successfully. Sep 04 17:59:02 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0d627d13-7870-4b6e-9532-bf8b112a4786 tempest-VolumeTypesAccessTest-1208870650 None] Lock "cinder-4465af46-9470-4a0e-a9e2-b72dcdd3e901-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:59:03 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-09d41f0c-8103-4c61-a375-91ca770178af tempest-VolumesListAdminTestJSON-1993464386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:59:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-09d41f0c-8103-4c61-a375-91ca770178af tempest-VolumesListAdminTestJSON-1993464386 None] Flow 'volume_create_manager' (e9132f57-68f0-4476-b9b2-7729eb56422f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:59:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-09d41f0c-8103-4c61-a375-91ca770178af tempest-VolumesListAdminTestJSON-1993464386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b494c3b-0d89-4e5a-984e-ceb44410030e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:59:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-09d41f0c-8103-4c61-a375-91ca770178af tempest-VolumesListAdminTestJSON-1993464386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b494c3b-0d89-4e5a-984e-ceb44410030e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:59:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1816032053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=696c80e2-8c10-489a-8741-433628482920,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b9af09c5dbc4b3fb38a85b38539ff9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:59:03Z,use_quota=True,user_id='bf43170dd4334909afec42c51bc70468',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:59:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-09d41f0c-8103-4c61-a375-91ca770178af tempest-VolumesListAdminTestJSON-1993464386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9b0c300-b877-4079-9862-b226918a0f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:59:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-09d41f0c-8103-4c61-a375-91ca770178af tempest-VolumesListAdminTestJSON-1993464386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9b0c300-b877-4079-9862-b226918a0f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:59:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-09d41f0c-8103-4c61-a375-91ca770178af tempest-VolumesListAdminTestJSON-1993464386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (129cce87-1ed5-443e-b67b-6d107dd2cf76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:59:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-09d41f0c-8103-4c61-a375-91ca770178af tempest-VolumesListAdminTestJSON-1993464386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (129cce87-1ed5-443e-b67b-6d107dd2cf76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '696c80e2-8c10-489a-8741-433628482920', 'volume_name': 'volume-696c80e2-8c10-489a-8741-433628482920', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:59:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-09d41f0c-8103-4c61-a375-91ca770178af tempest-VolumesListAdminTestJSON-1993464386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfab9fc3-cc20-41fb-a3a5-22aa62fb6ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:59:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-09d41f0c-8103-4c61-a375-91ca770178af tempest-VolumesListAdminTestJSON-1993464386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfab9fc3-cc20-41fb-a3a5-22aa62fb6ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:59:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-09d41f0c-8103-4c61-a375-91ca770178af tempest-VolumesListAdminTestJSON-1993464386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5d948db-c027-466c-a58f-cd7aba339508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:59:03 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-09d41f0c-8103-4c61-a375-91ca770178af tempest-VolumesListAdminTestJSON-1993464386 None] Volume 696c80e2-8c10-489a-8741-433628482920: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-696c80e2-8c10-489a-8741-433628482920', 'volume_size': 1} Sep 04 17:59:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-09d41f0c-8103-4c61-a375-91ca770178af tempest-VolumesListAdminTestJSON-1993464386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:59:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-09d41f0c-8103-4c61-a375-91ca770178af tempest-VolumesListAdminTestJSON-1993464386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:59:03 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-09d41f0c-8103-4c61-a375-91ca770178af tempest-VolumesListAdminTestJSON-1993464386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:59:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1816032053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=696c80e2-8c10-489a-8741-433628482920,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b9af09c5dbc4b3fb38a85b38539ff9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:59:03Z,use_quota=True,user_id='bf43170dd4334909afec42c51bc70468',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:59:03 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-09d41f0c-8103-4c61-a375-91ca770178af tempest-VolumesListAdminTestJSON-1993464386 None] Creating volume 696c80e2-8c10-489a-8741-433628482920 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:59:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-09d41f0c-8103-4c61-a375-91ca770178af tempest-VolumesListAdminTestJSON-1993464386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:59:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-09d41f0c-8103-4c61-a375-91ca770178af tempest-VolumesListAdminTestJSON-1993464386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:59:03 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-09d41f0c-8103-4c61-a375-91ca770178af tempest-VolumesListAdminTestJSON-1993464386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:59:03 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-09d41f0c-8103-4c61-a375-91ca770178af tempest-VolumesListAdminTestJSON-1993464386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:59:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-09d41f0c-8103-4c61-a375-91ca770178af tempest-VolumesListAdminTestJSON-1993464386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:59:03 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-09d41f0c-8103-4c61-a375-91ca770178af tempest-VolumesListAdminTestJSON-1993464386 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:59:03 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-09d41f0c-8103-4c61-a375-91ca770178af tempest-VolumesListAdminTestJSON-1993464386 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:59:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-09d41f0c-8103-4c61-a375-91ca770178af tempest-VolumesListAdminTestJSON-1993464386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-696c80e2-8c10-489a-8741-433628482920 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:59:03 devstack sudo[98830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-696c80e2-8c10-489a-8741-433628482920 1073741824 Sep 04 17:59:03 devstack sudo[98830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:59:03 devstack sudo[98830]: pam_unix(sudo:session): session closed for user root Sep 04 17:59:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-09d41f0c-8103-4c61-a375-91ca770178af tempest-VolumesListAdminTestJSON-1993464386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-696c80e2-8c10-489a-8741-433628482920 1073741824" returned: 0 in 0.608s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:59:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-09d41f0c-8103-4c61-a375-91ca770178af tempest-VolumesListAdminTestJSON-1993464386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-696c80e2-8c10-489a-8741-433628482920 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:59:03 devstack sudo[98837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-696c80e2-8c10-489a-8741-433628482920 Sep 04 17:59:03 devstack sudo[98837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:59:04 devstack sudo[98837]: pam_unix(sudo:session): session closed for user root Sep 04 17:59:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-09d41f0c-8103-4c61-a375-91ca770178af tempest-VolumesListAdminTestJSON-1993464386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-696c80e2-8c10-489a-8741-433628482920" returned: 0 in 0.267s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:59:04 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-09d41f0c-8103-4c61-a375-91ca770178af tempest-VolumesListAdminTestJSON-1993464386 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:59:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-09d41f0c-8103-4c61-a375-91ca770178af tempest-VolumesListAdminTestJSON-1993464386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:59:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-09d41f0c-8103-4c61-a375-91ca770178af tempest-VolumesListAdminTestJSON-1993464386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5d948db-c027-466c-a58f-cd7aba339508) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-696c80e2-8c10-489a-8741-433628482920', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:59:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-09d41f0c-8103-4c61-a375-91ca770178af tempest-VolumesListAdminTestJSON-1993464386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f295206-1bf9-4cc9-a9fb-3462796839eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:59:04 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-09d41f0c-8103-4c61-a375-91ca770178af tempest-VolumesListAdminTestJSON-1993464386 None] Volume volume-696c80e2-8c10-489a-8741-433628482920 (696c80e2-8c10-489a-8741-433628482920): created successfully Sep 04 17:59:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-09d41f0c-8103-4c61-a375-91ca770178af tempest-VolumesListAdminTestJSON-1993464386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f295206-1bf9-4cc9-a9fb-3462796839eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:59:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-09d41f0c-8103-4c61-a375-91ca770178af tempest-VolumesListAdminTestJSON-1993464386 None] Flow 'volume_create_manager' (e9132f57-68f0-4476-b9b2-7729eb56422f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:59:04 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-09d41f0c-8103-4c61-a375-91ca770178af tempest-VolumesListAdminTestJSON-1993464386 None] Created volume successfully. Sep 04 17:59:06 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e02f937-3909-4846-8195-6296940943c1 tempest-VolumesListAdminTestJSON-1993464386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:59:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9e02f937-3909-4846-8195-6296940943c1 tempest-VolumesListAdminTestJSON-1993464386 None] Flow 'volume_create_manager' (ea6943f7-e2de-4843-ad9f-0575a0299c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:59:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9e02f937-3909-4846-8195-6296940943c1 tempest-VolumesListAdminTestJSON-1993464386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (863eb2f4-f509-44a7-9a21-769dd29cef26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:59:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9e02f937-3909-4846-8195-6296940943c1 tempest-VolumesListAdminTestJSON-1993464386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (863eb2f4-f509-44a7-9a21-769dd29cef26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:59:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1919618771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96d09463-4bef-4143-a187-ca61ba25a245,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b9af09c5dbc4b3fb38a85b38539ff9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:59:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:59:06Z,use_quota=True,user_id='bf43170dd4334909afec42c51bc70468',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:59:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9e02f937-3909-4846-8195-6296940943c1 tempest-VolumesListAdminTestJSON-1993464386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7dd519d-478c-441e-a472-0e373d43831b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:59:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9e02f937-3909-4846-8195-6296940943c1 tempest-VolumesListAdminTestJSON-1993464386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7dd519d-478c-441e-a472-0e373d43831b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:59:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9e02f937-3909-4846-8195-6296940943c1 tempest-VolumesListAdminTestJSON-1993464386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdaf4855-1574-434a-b483-e58262e18f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:59:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9e02f937-3909-4846-8195-6296940943c1 tempest-VolumesListAdminTestJSON-1993464386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdaf4855-1574-434a-b483-e58262e18f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96d09463-4bef-4143-a187-ca61ba25a245', 'volume_name': 'volume-96d09463-4bef-4143-a187-ca61ba25a245', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:59:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9e02f937-3909-4846-8195-6296940943c1 tempest-VolumesListAdminTestJSON-1993464386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f85d6f3c-ea1a-4d53-9cdf-20207bcd6756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:59:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9e02f937-3909-4846-8195-6296940943c1 tempest-VolumesListAdminTestJSON-1993464386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f85d6f3c-ea1a-4d53-9cdf-20207bcd6756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:59:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9e02f937-3909-4846-8195-6296940943c1 tempest-VolumesListAdminTestJSON-1993464386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (545ffa22-1bd7-4709-bb70-8a04ba8d9824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:59:06 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-9e02f937-3909-4846-8195-6296940943c1 tempest-VolumesListAdminTestJSON-1993464386 None] Volume 96d09463-4bef-4143-a187-ca61ba25a245: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96d09463-4bef-4143-a187-ca61ba25a245', 'volume_size': 1} Sep 04 17:59:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9e02f937-3909-4846-8195-6296940943c1 tempest-VolumesListAdminTestJSON-1993464386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:59:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9e02f937-3909-4846-8195-6296940943c1 tempest-VolumesListAdminTestJSON-1993464386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:59:06 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9e02f937-3909-4846-8195-6296940943c1 tempest-VolumesListAdminTestJSON-1993464386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:59:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1919618771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96d09463-4bef-4143-a187-ca61ba25a245,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b9af09c5dbc4b3fb38a85b38539ff9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:59:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:59:06Z,use_quota=True,user_id='bf43170dd4334909afec42c51bc70468',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:59:06 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-9e02f937-3909-4846-8195-6296940943c1 tempest-VolumesListAdminTestJSON-1993464386 None] Creating volume 96d09463-4bef-4143-a187-ca61ba25a245 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:59:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9e02f937-3909-4846-8195-6296940943c1 tempest-VolumesListAdminTestJSON-1993464386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:59:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9e02f937-3909-4846-8195-6296940943c1 tempest-VolumesListAdminTestJSON-1993464386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:59:06 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9e02f937-3909-4846-8195-6296940943c1 tempest-VolumesListAdminTestJSON-1993464386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:59:06 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9e02f937-3909-4846-8195-6296940943c1 tempest-VolumesListAdminTestJSON-1993464386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:59:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9e02f937-3909-4846-8195-6296940943c1 tempest-VolumesListAdminTestJSON-1993464386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:59:06 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9e02f937-3909-4846-8195-6296940943c1 tempest-VolumesListAdminTestJSON-1993464386 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:59:06 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-9e02f937-3909-4846-8195-6296940943c1 tempest-VolumesListAdminTestJSON-1993464386 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:59:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9e02f937-3909-4846-8195-6296940943c1 tempest-VolumesListAdminTestJSON-1993464386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-96d09463-4bef-4143-a187-ca61ba25a245 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:59:06 devstack sudo[98841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-96d09463-4bef-4143-a187-ca61ba25a245 1073741824 Sep 04 17:59:06 devstack sudo[98841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:59:06 devstack sudo[98841]: pam_unix(sudo:session): session closed for user root Sep 04 17:59:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9e02f937-3909-4846-8195-6296940943c1 tempest-VolumesListAdminTestJSON-1993464386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-96d09463-4bef-4143-a187-ca61ba25a245 1073741824" returned: 0 in 0.566s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:59:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9e02f937-3909-4846-8195-6296940943c1 tempest-VolumesListAdminTestJSON-1993464386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-96d09463-4bef-4143-a187-ca61ba25a245 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:59:06 devstack sudo[98848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-96d09463-4bef-4143-a187-ca61ba25a245 Sep 04 17:59:06 devstack sudo[98848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:59:07 devstack sudo[98848]: pam_unix(sudo:session): session closed for user root Sep 04 17:59:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9e02f937-3909-4846-8195-6296940943c1 tempest-VolumesListAdminTestJSON-1993464386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-96d09463-4bef-4143-a187-ca61ba25a245" returned: 0 in 0.313s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:59:07 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9e02f937-3909-4846-8195-6296940943c1 tempest-VolumesListAdminTestJSON-1993464386 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:59:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9e02f937-3909-4846-8195-6296940943c1 tempest-VolumesListAdminTestJSON-1993464386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:59:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9e02f937-3909-4846-8195-6296940943c1 tempest-VolumesListAdminTestJSON-1993464386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (545ffa22-1bd7-4709-bb70-8a04ba8d9824) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96d09463-4bef-4143-a187-ca61ba25a245', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:59:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9e02f937-3909-4846-8195-6296940943c1 tempest-VolumesListAdminTestJSON-1993464386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00b3871a-f517-496d-8ad4-74cc862c0ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:59:07 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-9e02f937-3909-4846-8195-6296940943c1 tempest-VolumesListAdminTestJSON-1993464386 None] Volume volume-96d09463-4bef-4143-a187-ca61ba25a245 (96d09463-4bef-4143-a187-ca61ba25a245): created successfully Sep 04 17:59:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9e02f937-3909-4846-8195-6296940943c1 tempest-VolumesListAdminTestJSON-1993464386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00b3871a-f517-496d-8ad4-74cc862c0ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:59:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9e02f937-3909-4846-8195-6296940943c1 tempest-VolumesListAdminTestJSON-1993464386 None] Flow 'volume_create_manager' (ea6943f7-e2de-4843-ad9f-0575a0299c6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:59:07 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-9e02f937-3909-4846-8195-6296940943c1 tempest-VolumesListAdminTestJSON-1993464386 None] Created volume successfully. Sep 04 17:59:08 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-9301bed9-da3d-4c47-8585-e69607c25a4e tempest-VolumesListAdminTestJSON-1993464386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:59:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9301bed9-da3d-4c47-8585-e69607c25a4e tempest-VolumesListAdminTestJSON-1993464386 None] Flow 'volume_create_manager' (02178ebf-35bc-4d9f-9f87-affb7d59d669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:59:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9301bed9-da3d-4c47-8585-e69607c25a4e tempest-VolumesListAdminTestJSON-1993464386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (357cc0aa-15c2-4e39-bdf2-42acef5643d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:59:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9301bed9-da3d-4c47-8585-e69607c25a4e tempest-VolumesListAdminTestJSON-1993464386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (357cc0aa-15c2-4e39-bdf2-42acef5643d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:59:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1417764727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8255eb11-37a6-446e-96d6-309ec8adf4ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b9af09c5dbc4b3fb38a85b38539ff9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:59:09Z,use_quota=True,user_id='bf43170dd4334909afec42c51bc70468',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:59:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9301bed9-da3d-4c47-8585-e69607c25a4e tempest-VolumesListAdminTestJSON-1993464386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (212fe6fe-66b0-483d-b3a5-d479706f7600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:59:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9301bed9-da3d-4c47-8585-e69607c25a4e tempest-VolumesListAdminTestJSON-1993464386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (212fe6fe-66b0-483d-b3a5-d479706f7600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:59:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9301bed9-da3d-4c47-8585-e69607c25a4e tempest-VolumesListAdminTestJSON-1993464386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e7098b4-ede3-4994-affd-579e0f7888c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:59:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9301bed9-da3d-4c47-8585-e69607c25a4e tempest-VolumesListAdminTestJSON-1993464386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e7098b4-ede3-4994-affd-579e0f7888c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8255eb11-37a6-446e-96d6-309ec8adf4ff', 'volume_name': 'volume-8255eb11-37a6-446e-96d6-309ec8adf4ff', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:59:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9301bed9-da3d-4c47-8585-e69607c25a4e tempest-VolumesListAdminTestJSON-1993464386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8ded9e7-cd8a-4184-aeff-cbb572437045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:59:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9301bed9-da3d-4c47-8585-e69607c25a4e tempest-VolumesListAdminTestJSON-1993464386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8ded9e7-cd8a-4184-aeff-cbb572437045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:59:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9301bed9-da3d-4c47-8585-e69607c25a4e tempest-VolumesListAdminTestJSON-1993464386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4be532e1-b971-4446-974e-f6683f292715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:59:08 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-9301bed9-da3d-4c47-8585-e69607c25a4e tempest-VolumesListAdminTestJSON-1993464386 None] Volume 8255eb11-37a6-446e-96d6-309ec8adf4ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8255eb11-37a6-446e-96d6-309ec8adf4ff', 'volume_size': 1} Sep 04 17:59:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9301bed9-da3d-4c47-8585-e69607c25a4e tempest-VolumesListAdminTestJSON-1993464386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:59:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9301bed9-da3d-4c47-8585-e69607c25a4e tempest-VolumesListAdminTestJSON-1993464386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:59:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9301bed9-da3d-4c47-8585-e69607c25a4e tempest-VolumesListAdminTestJSON-1993464386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:59:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1417764727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8255eb11-37a6-446e-96d6-309ec8adf4ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b9af09c5dbc4b3fb38a85b38539ff9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:59:09Z,use_quota=True,user_id='bf43170dd4334909afec42c51bc70468',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:59:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-9301bed9-da3d-4c47-8585-e69607c25a4e tempest-VolumesListAdminTestJSON-1993464386 None] Creating volume 8255eb11-37a6-446e-96d6-309ec8adf4ff {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:59:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9301bed9-da3d-4c47-8585-e69607c25a4e tempest-VolumesListAdminTestJSON-1993464386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:59:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9301bed9-da3d-4c47-8585-e69607c25a4e tempest-VolumesListAdminTestJSON-1993464386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:59:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9301bed9-da3d-4c47-8585-e69607c25a4e tempest-VolumesListAdminTestJSON-1993464386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:59:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9301bed9-da3d-4c47-8585-e69607c25a4e tempest-VolumesListAdminTestJSON-1993464386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:59:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9301bed9-da3d-4c47-8585-e69607c25a4e tempest-VolumesListAdminTestJSON-1993464386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:59:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9301bed9-da3d-4c47-8585-e69607c25a4e tempest-VolumesListAdminTestJSON-1993464386 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:59:08 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-9301bed9-da3d-4c47-8585-e69607c25a4e tempest-VolumesListAdminTestJSON-1993464386 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:59:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9301bed9-da3d-4c47-8585-e69607c25a4e tempest-VolumesListAdminTestJSON-1993464386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8255eb11-37a6-446e-96d6-309ec8adf4ff 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:59:08 devstack sudo[98851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8255eb11-37a6-446e-96d6-309ec8adf4ff 1073741824 Sep 04 17:59:08 devstack sudo[98851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:59:09 devstack sudo[98851]: pam_unix(sudo:session): session closed for user root Sep 04 17:59:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9301bed9-da3d-4c47-8585-e69607c25a4e tempest-VolumesListAdminTestJSON-1993464386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8255eb11-37a6-446e-96d6-309ec8adf4ff 1073741824" returned: 0 in 0.657s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:59:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9301bed9-da3d-4c47-8585-e69607c25a4e tempest-VolumesListAdminTestJSON-1993464386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8255eb11-37a6-446e-96d6-309ec8adf4ff {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:59:09 devstack sudo[98856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8255eb11-37a6-446e-96d6-309ec8adf4ff Sep 04 17:59:09 devstack sudo[98856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:59:09 devstack sudo[98856]: pam_unix(sudo:session): session closed for user root Sep 04 17:59:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9301bed9-da3d-4c47-8585-e69607c25a4e tempest-VolumesListAdminTestJSON-1993464386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8255eb11-37a6-446e-96d6-309ec8adf4ff" returned: 0 in 0.335s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:59:09 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9301bed9-da3d-4c47-8585-e69607c25a4e tempest-VolumesListAdminTestJSON-1993464386 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:59:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9301bed9-da3d-4c47-8585-e69607c25a4e tempest-VolumesListAdminTestJSON-1993464386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:59:10 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9301bed9-da3d-4c47-8585-e69607c25a4e tempest-VolumesListAdminTestJSON-1993464386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4be532e1-b971-4446-974e-f6683f292715) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8255eb11-37a6-446e-96d6-309ec8adf4ff', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:59:10 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9301bed9-da3d-4c47-8585-e69607c25a4e tempest-VolumesListAdminTestJSON-1993464386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0d81098-0959-4699-bebf-13cecf8ffabb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:59:10 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-9301bed9-da3d-4c47-8585-e69607c25a4e tempest-VolumesListAdminTestJSON-1993464386 None] Volume volume-8255eb11-37a6-446e-96d6-309ec8adf4ff (8255eb11-37a6-446e-96d6-309ec8adf4ff): created successfully Sep 04 17:59:10 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9301bed9-da3d-4c47-8585-e69607c25a4e tempest-VolumesListAdminTestJSON-1993464386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0d81098-0959-4699-bebf-13cecf8ffabb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:59:10 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9301bed9-da3d-4c47-8585-e69607c25a4e tempest-VolumesListAdminTestJSON-1993464386 None] Flow 'volume_create_manager' (02178ebf-35bc-4d9f-9f87-affb7d59d669) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:59:10 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-9301bed9-da3d-4c47-8585-e69607c25a4e tempest-VolumesListAdminTestJSON-1993464386 None] Created volume successfully. Sep 04 17:59:12 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a5fdb87-7507-4be0-8fc6-a0b9480222f3 tempest-VolumesListAdminTestJSON-438567355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:59:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9a5fdb87-7507-4be0-8fc6-a0b9480222f3 tempest-VolumesListAdminTestJSON-438567355 None] Flow 'volume_create_manager' (c1c1c79c-d37d-4829-9b49-d368441208b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:59:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9a5fdb87-7507-4be0-8fc6-a0b9480222f3 tempest-VolumesListAdminTestJSON-438567355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32ea04a3-d737-4b4d-a6f6-2c1dbcd0e641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:59:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9a5fdb87-7507-4be0-8fc6-a0b9480222f3 tempest-VolumesListAdminTestJSON-438567355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32ea04a3-d737-4b4d-a6f6-2c1dbcd0e641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:59:12Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db3ebe4c-2161-49b7-b7db-28b8bad10e0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e3485214c904802a53836de68c62583',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:59:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:59:12Z,use_quota=True,user_id='e78d9697de724590bca2a4e022d0bacf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:59:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9a5fdb87-7507-4be0-8fc6-a0b9480222f3 tempest-VolumesListAdminTestJSON-438567355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c2b9c61-0f56-4866-99f2-c29830074263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:59:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9a5fdb87-7507-4be0-8fc6-a0b9480222f3 tempest-VolumesListAdminTestJSON-438567355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c2b9c61-0f56-4866-99f2-c29830074263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:59:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9a5fdb87-7507-4be0-8fc6-a0b9480222f3 tempest-VolumesListAdminTestJSON-438567355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56ec144a-072c-497d-9b16-466e6c526284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:59:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9a5fdb87-7507-4be0-8fc6-a0b9480222f3 tempest-VolumesListAdminTestJSON-438567355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56ec144a-072c-497d-9b16-466e6c526284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db3ebe4c-2161-49b7-b7db-28b8bad10e0f', 'volume_name': 'volume-db3ebe4c-2161-49b7-b7db-28b8bad10e0f', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:59:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9a5fdb87-7507-4be0-8fc6-a0b9480222f3 tempest-VolumesListAdminTestJSON-438567355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d57523a-077c-4658-b619-61eafafe2cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:59:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9a5fdb87-7507-4be0-8fc6-a0b9480222f3 tempest-VolumesListAdminTestJSON-438567355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d57523a-077c-4658-b619-61eafafe2cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:59:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9a5fdb87-7507-4be0-8fc6-a0b9480222f3 tempest-VolumesListAdminTestJSON-438567355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee6f2bf6-4f75-4c51-bd29-150aa1819dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:59:12 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-9a5fdb87-7507-4be0-8fc6-a0b9480222f3 tempest-VolumesListAdminTestJSON-438567355 None] Volume db3ebe4c-2161-49b7-b7db-28b8bad10e0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db3ebe4c-2161-49b7-b7db-28b8bad10e0f', 'volume_size': 1} Sep 04 17:59:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9a5fdb87-7507-4be0-8fc6-a0b9480222f3 tempest-VolumesListAdminTestJSON-438567355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:59:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9a5fdb87-7507-4be0-8fc6-a0b9480222f3 tempest-VolumesListAdminTestJSON-438567355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:59:12 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9a5fdb87-7507-4be0-8fc6-a0b9480222f3 tempest-VolumesListAdminTestJSON-438567355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:59:12Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db3ebe4c-2161-49b7-b7db-28b8bad10e0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e3485214c904802a53836de68c62583',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:59:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:59:12Z,use_quota=True,user_id='e78d9697de724590bca2a4e022d0bacf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:59:12 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-9a5fdb87-7507-4be0-8fc6-a0b9480222f3 tempest-VolumesListAdminTestJSON-438567355 None] Creating volume db3ebe4c-2161-49b7-b7db-28b8bad10e0f {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:59:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9a5fdb87-7507-4be0-8fc6-a0b9480222f3 tempest-VolumesListAdminTestJSON-438567355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:59:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9a5fdb87-7507-4be0-8fc6-a0b9480222f3 tempest-VolumesListAdminTestJSON-438567355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:59:12 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9a5fdb87-7507-4be0-8fc6-a0b9480222f3 tempest-VolumesListAdminTestJSON-438567355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:59:12 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9a5fdb87-7507-4be0-8fc6-a0b9480222f3 tempest-VolumesListAdminTestJSON-438567355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:59:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9a5fdb87-7507-4be0-8fc6-a0b9480222f3 tempest-VolumesListAdminTestJSON-438567355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:59:12 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9a5fdb87-7507-4be0-8fc6-a0b9480222f3 tempest-VolumesListAdminTestJSON-438567355 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:59:12 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-9a5fdb87-7507-4be0-8fc6-a0b9480222f3 tempest-VolumesListAdminTestJSON-438567355 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:59:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9a5fdb87-7507-4be0-8fc6-a0b9480222f3 tempest-VolumesListAdminTestJSON-438567355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-db3ebe4c-2161-49b7-b7db-28b8bad10e0f 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:59:12 devstack sudo[98859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-db3ebe4c-2161-49b7-b7db-28b8bad10e0f 1073741824 Sep 04 17:59:12 devstack sudo[98859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:59:12 devstack sudo[98859]: pam_unix(sudo:session): session closed for user root Sep 04 17:59:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9a5fdb87-7507-4be0-8fc6-a0b9480222f3 tempest-VolumesListAdminTestJSON-438567355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-db3ebe4c-2161-49b7-b7db-28b8bad10e0f 1073741824" returned: 0 in 0.518s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:59:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9a5fdb87-7507-4be0-8fc6-a0b9480222f3 tempest-VolumesListAdminTestJSON-438567355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-db3ebe4c-2161-49b7-b7db-28b8bad10e0f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:59:12 devstack sudo[98865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-db3ebe4c-2161-49b7-b7db-28b8bad10e0f Sep 04 17:59:12 devstack sudo[98865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:59:12 devstack sudo[98865]: pam_unix(sudo:session): session closed for user root Sep 04 17:59:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9a5fdb87-7507-4be0-8fc6-a0b9480222f3 tempest-VolumesListAdminTestJSON-438567355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-db3ebe4c-2161-49b7-b7db-28b8bad10e0f" returned: 0 in 0.300s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:59:12 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9a5fdb87-7507-4be0-8fc6-a0b9480222f3 tempest-VolumesListAdminTestJSON-438567355 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:59:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9a5fdb87-7507-4be0-8fc6-a0b9480222f3 tempest-VolumesListAdminTestJSON-438567355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:59:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9a5fdb87-7507-4be0-8fc6-a0b9480222f3 tempest-VolumesListAdminTestJSON-438567355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee6f2bf6-4f75-4c51-bd29-150aa1819dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db3ebe4c-2161-49b7-b7db-28b8bad10e0f', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:59:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9a5fdb87-7507-4be0-8fc6-a0b9480222f3 tempest-VolumesListAdminTestJSON-438567355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8eaf0d0-0a23-49bc-b8ec-613b879590f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:59:13 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-9a5fdb87-7507-4be0-8fc6-a0b9480222f3 tempest-VolumesListAdminTestJSON-438567355 None] Volume volume-db3ebe4c-2161-49b7-b7db-28b8bad10e0f (db3ebe4c-2161-49b7-b7db-28b8bad10e0f): created successfully Sep 04 17:59:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9a5fdb87-7507-4be0-8fc6-a0b9480222f3 tempest-VolumesListAdminTestJSON-438567355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8eaf0d0-0a23-49bc-b8ec-613b879590f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:59:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9a5fdb87-7507-4be0-8fc6-a0b9480222f3 tempest-VolumesListAdminTestJSON-438567355 None] Flow 'volume_create_manager' (c1c1c79c-d37d-4829-9b49-d368441208b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:59:13 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-9a5fdb87-7507-4be0-8fc6-a0b9480222f3 tempest-VolumesListAdminTestJSON-438567355 None] Created volume successfully. Sep 04 17:59:14 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-35a0d2cb-6bb6-4377-9303-d0a265fe7ceb tempest-VolumesListAdminTestJSON-438567355 None] Acquiring lock "cinder-db3ebe4c-2161-49b7-b7db-28b8bad10e0f-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:59:14 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-35a0d2cb-6bb6-4377-9303-d0a265fe7ceb tempest-VolumesListAdminTestJSON-438567355 None] Lock "cinder-db3ebe4c-2161-49b7-b7db-28b8bad10e0f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:59:14 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-35a0d2cb-6bb6-4377-9303-d0a265fe7ceb tempest-VolumesListAdminTestJSON-438567355 None] Acquiring lock "cinder-quobyte-db3ebe4c-2161-49b7-b7db-28b8bad10e0f" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:59:14 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-35a0d2cb-6bb6-4377-9303-d0a265fe7ceb tempest-VolumesListAdminTestJSON-438567355 None] Lock "cinder-quobyte-db3ebe4c-2161-49b7-b7db-28b8bad10e0f" acquired by "delete_volume" :: waited 0.019s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:59:14 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4634644-3ada-499e-a2dd-2e35cb661fea]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:59:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-35a0d2cb-6bb6-4377-9303-d0a265fe7ceb tempest-VolumesListAdminTestJSON-438567355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-db3ebe4c-2161-49b7-b7db-28b8bad10e0f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:59:14 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-51ba05ba-a590-4f17-a739-6598cd8d8f73 tempest-VolumesListAdminTestJSON-1993464386 None] Acquiring lock "cinder-8255eb11-37a6-446e-96d6-309ec8adf4ff-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:59:14 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-51ba05ba-a590-4f17-a739-6598cd8d8f73 tempest-VolumesListAdminTestJSON-1993464386 None] Lock "cinder-8255eb11-37a6-446e-96d6-309ec8adf4ff-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:59:14 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-51ba05ba-a590-4f17-a739-6598cd8d8f73 tempest-VolumesListAdminTestJSON-1993464386 None] Acquiring lock "cinder-quobyte-8255eb11-37a6-446e-96d6-309ec8adf4ff" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:59:14 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-51ba05ba-a590-4f17-a739-6598cd8d8f73 tempest-VolumesListAdminTestJSON-1993464386 None] Lock "cinder-quobyte-8255eb11-37a6-446e-96d6-309ec8adf4ff" acquired by "delete_volume" :: waited 0.019s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:59:14 devstack sudo[98869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-db3ebe4c-2161-49b7-b7db-28b8bad10e0f Sep 04 17:59:14 devstack sudo[98869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:59:14 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1c5b30-74a2-4c86-babb-e77f64cfc562]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:59:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-51ba05ba-a590-4f17-a739-6598cd8d8f73 tempest-VolumesListAdminTestJSON-1993464386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8255eb11-37a6-446e-96d6-309ec8adf4ff {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:59:14 devstack sudo[98871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8255eb11-37a6-446e-96d6-309ec8adf4ff Sep 04 17:59:14 devstack sudo[98871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:59:14 devstack sudo[98869]: pam_unix(sudo:session): session closed for user root Sep 04 17:59:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-35a0d2cb-6bb6-4377-9303-d0a265fe7ceb tempest-VolumesListAdminTestJSON-438567355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-db3ebe4c-2161-49b7-b7db-28b8bad10e0f" returned: 0 in 0.544s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:59:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-35a0d2cb-6bb6-4377-9303-d0a265fe7ceb tempest-VolumesListAdminTestJSON-438567355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-db3ebe4c-2161-49b7-b7db-28b8bad10e0f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:59:14 devstack sudo[98877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-db3ebe4c-2161-49b7-b7db-28b8bad10e0f Sep 04 17:59:14 devstack sudo[98877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:59:15 devstack sudo[98871]: pam_unix(sudo:session): session closed for user root Sep 04 17:59:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-51ba05ba-a590-4f17-a739-6598cd8d8f73 tempest-VolumesListAdminTestJSON-1993464386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8255eb11-37a6-446e-96d6-309ec8adf4ff" returned: 0 in 0.496s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:59:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-51ba05ba-a590-4f17-a739-6598cd8d8f73 tempest-VolumesListAdminTestJSON-1993464386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8255eb11-37a6-446e-96d6-309ec8adf4ff {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:59:15 devstack sudo[98883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8255eb11-37a6-446e-96d6-309ec8adf4ff Sep 04 17:59:15 devstack sudo[98883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:59:15 devstack sudo[98877]: pam_unix(sudo:session): session closed for user root Sep 04 17:59:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-35a0d2cb-6bb6-4377-9303-d0a265fe7ceb tempest-VolumesListAdminTestJSON-438567355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-db3ebe4c-2161-49b7-b7db-28b8bad10e0f" returned: 0 in 0.266s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:59:15 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-35a0d2cb-6bb6-4377-9303-d0a265fe7ceb tempest-VolumesListAdminTestJSON-438567355 None] Lock "cinder-quobyte-db3ebe4c-2161-49b7-b7db-28b8bad10e0f" released by "delete_volume" :: held 0.868s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:59:15 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-35a0d2cb-6bb6-4377-9303-d0a265fe7ceb tempest-VolumesListAdminTestJSON-438567355 None] Created reservations ['9a7ceebc-391a-47c4-b9be-bb406712e4f9', '3027f815-09eb-4fa9-9474-594100154164', '5792f291-4396-4829-98c5-55b09659eff3', '6b2b8fa9-bc62-4014-8480-61f6e9f979ae'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:59:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-35a0d2cb-6bb6-4377-9303-d0a265fe7ceb tempest-VolumesListAdminTestJSON-438567355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:59:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-35a0d2cb-6bb6-4377-9303-d0a265fe7ceb tempest-VolumesListAdminTestJSON-438567355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:59:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-35a0d2cb-6bb6-4377-9303-d0a265fe7ceb tempest-VolumesListAdminTestJSON-438567355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:59:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-35a0d2cb-6bb6-4377-9303-d0a265fe7ceb tempest-VolumesListAdminTestJSON-438567355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:59:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-35a0d2cb-6bb6-4377-9303-d0a265fe7ceb tempest-VolumesListAdminTestJSON-438567355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:59:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-35a0d2cb-6bb6-4377-9303-d0a265fe7ceb tempest-VolumesListAdminTestJSON-438567355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:59:15 devstack sudo[98887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:59:15 devstack sudo[98887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:59:15 devstack sudo[98883]: pam_unix(sudo:session): session closed for user root Sep 04 17:59:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-51ba05ba-a590-4f17-a739-6598cd8d8f73 tempest-VolumesListAdminTestJSON-1993464386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8255eb11-37a6-446e-96d6-309ec8adf4ff" returned: 0 in 0.302s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:59:15 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-51ba05ba-a590-4f17-a739-6598cd8d8f73 tempest-VolumesListAdminTestJSON-1993464386 None] Lock "cinder-quobyte-8255eb11-37a6-446e-96d6-309ec8adf4ff" released by "delete_volume" :: held 0.854s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:59:15 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-51ba05ba-a590-4f17-a739-6598cd8d8f73 tempest-VolumesListAdminTestJSON-1993464386 None] Created reservations ['15e58b2b-1e64-49c7-9fef-33e532df879c', 'abeca4d2-248c-407b-9a94-1a826f8e8e97', 'd97799a1-c574-4f06-bf2d-cac5f57bfda9', '0e266cf8-89b4-497f-8379-d72e57a19773'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:59:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-51ba05ba-a590-4f17-a739-6598cd8d8f73 tempest-VolumesListAdminTestJSON-1993464386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:59:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-51ba05ba-a590-4f17-a739-6598cd8d8f73 tempest-VolumesListAdminTestJSON-1993464386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:59:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-51ba05ba-a590-4f17-a739-6598cd8d8f73 tempest-VolumesListAdminTestJSON-1993464386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:59:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-51ba05ba-a590-4f17-a739-6598cd8d8f73 tempest-VolumesListAdminTestJSON-1993464386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:59:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-51ba05ba-a590-4f17-a739-6598cd8d8f73 tempest-VolumesListAdminTestJSON-1993464386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:59:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-51ba05ba-a590-4f17-a739-6598cd8d8f73 tempest-VolumesListAdminTestJSON-1993464386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:59:15 devstack sudo[98889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:59:15 devstack sudo[98889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:59:15 devstack sudo[98887]: pam_unix(sudo:session): session closed for user root Sep 04 17:59:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-35a0d2cb-6bb6-4377-9303-d0a265fe7ceb tempest-VolumesListAdminTestJSON-438567355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.359s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:59:15 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-35a0d2cb-6bb6-4377-9303-d0a265fe7ceb tempest-VolumesListAdminTestJSON-438567355 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:59:15 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-35a0d2cb-6bb6-4377-9303-d0a265fe7ceb tempest-VolumesListAdminTestJSON-438567355 None] Deleted volume successfully. Sep 04 17:59:15 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-35a0d2cb-6bb6-4377-9303-d0a265fe7ceb tempest-VolumesListAdminTestJSON-438567355 None] Lock "cinder-db3ebe4c-2161-49b7-b7db-28b8bad10e0f-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:59:15 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-447838d8-b75e-4bce-ade2-f013da5861ee tempest-VolumesListAdminTestJSON-1993464386 None] Acquiring lock "cinder-96d09463-4bef-4143-a187-ca61ba25a245-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:59:15 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-447838d8-b75e-4bce-ade2-f013da5861ee tempest-VolumesListAdminTestJSON-1993464386 None] Lock "cinder-96d09463-4bef-4143-a187-ca61ba25a245-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:59:15 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-447838d8-b75e-4bce-ade2-f013da5861ee tempest-VolumesListAdminTestJSON-1993464386 None] Acquiring lock "cinder-quobyte-96d09463-4bef-4143-a187-ca61ba25a245" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:59:15 devstack sudo[98889]: pam_unix(sudo:session): session closed for user root Sep 04 17:59:15 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-447838d8-b75e-4bce-ade2-f013da5861ee tempest-VolumesListAdminTestJSON-1993464386 None] Lock "cinder-quobyte-96d09463-4bef-4143-a187-ca61ba25a245" acquired by "delete_volume" :: waited 0.028s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:59:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-51ba05ba-a590-4f17-a739-6598cd8d8f73 tempest-VolumesListAdminTestJSON-1993464386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.336s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:59:15 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-51ba05ba-a590-4f17-a739-6598cd8d8f73 tempest-VolumesListAdminTestJSON-1993464386 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:59:15 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-51ba05ba-a590-4f17-a739-6598cd8d8f73 tempest-VolumesListAdminTestJSON-1993464386 None] Deleted volume successfully. Sep 04 17:59:15 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfac09ff-c410-4e64-8ab3-befd9c4d360e]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:59:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-447838d8-b75e-4bce-ade2-f013da5861ee tempest-VolumesListAdminTestJSON-1993464386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-96d09463-4bef-4143-a187-ca61ba25a245 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:59:15 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-51ba05ba-a590-4f17-a739-6598cd8d8f73 tempest-VolumesListAdminTestJSON-1993464386 None] Lock "cinder-8255eb11-37a6-446e-96d6-309ec8adf4ff-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:59:16 devstack sudo[98893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-96d09463-4bef-4143-a187-ca61ba25a245 Sep 04 17:59:16 devstack sudo[98893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:59:16 devstack sudo[98893]: pam_unix(sudo:session): session closed for user root Sep 04 17:59:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-447838d8-b75e-4bce-ade2-f013da5861ee tempest-VolumesListAdminTestJSON-1993464386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-96d09463-4bef-4143-a187-ca61ba25a245" returned: 0 in 0.484s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:59:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-447838d8-b75e-4bce-ade2-f013da5861ee tempest-VolumesListAdminTestJSON-1993464386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-96d09463-4bef-4143-a187-ca61ba25a245 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:59:16 devstack sudo[98898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-96d09463-4bef-4143-a187-ca61ba25a245 Sep 04 17:59:16 devstack sudo[98898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:59:16 devstack sudo[98898]: pam_unix(sudo:session): session closed for user root Sep 04 17:59:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-447838d8-b75e-4bce-ade2-f013da5861ee tempest-VolumesListAdminTestJSON-1993464386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-96d09463-4bef-4143-a187-ca61ba25a245" returned: 0 in 0.282s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:59:16 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-447838d8-b75e-4bce-ade2-f013da5861ee tempest-VolumesListAdminTestJSON-1993464386 None] Lock "cinder-quobyte-96d09463-4bef-4143-a187-ca61ba25a245" released by "delete_volume" :: held 0.834s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:59:16 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-447838d8-b75e-4bce-ade2-f013da5861ee tempest-VolumesListAdminTestJSON-1993464386 None] Created reservations ['94c71a0b-1fce-4f0e-81f9-1e72024f7a5f', '6ad92996-881d-483d-b7e7-807530c8a871', '5dc0609e-bfcf-4862-98bc-33cad19f0674', '854bda9c-475b-4c40-9893-1b866cbd154d'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:59:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-447838d8-b75e-4bce-ade2-f013da5861ee tempest-VolumesListAdminTestJSON-1993464386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:59:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-447838d8-b75e-4bce-ade2-f013da5861ee tempest-VolumesListAdminTestJSON-1993464386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:59:16 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-447838d8-b75e-4bce-ade2-f013da5861ee tempest-VolumesListAdminTestJSON-1993464386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:59:16 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-447838d8-b75e-4bce-ade2-f013da5861ee tempest-VolumesListAdminTestJSON-1993464386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:59:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-447838d8-b75e-4bce-ade2-f013da5861ee tempest-VolumesListAdminTestJSON-1993464386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:59:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-447838d8-b75e-4bce-ade2-f013da5861ee tempest-VolumesListAdminTestJSON-1993464386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:59:16 devstack sudo[98901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:59:16 devstack sudo[98901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:59:17 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fc1e5b67-f7e5-4657-bb1e-3e4825223e62 tempest-VolumesListAdminTestJSON-1993464386 None] Acquiring lock "cinder-696c80e2-8c10-489a-8741-433628482920-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:59:17 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fc1e5b67-f7e5-4657-bb1e-3e4825223e62 tempest-VolumesListAdminTestJSON-1993464386 None] Lock "cinder-696c80e2-8c10-489a-8741-433628482920-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:59:17 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fc1e5b67-f7e5-4657-bb1e-3e4825223e62 tempest-VolumesListAdminTestJSON-1993464386 None] Acquiring lock "cinder-quobyte-696c80e2-8c10-489a-8741-433628482920" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:59:17 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fc1e5b67-f7e5-4657-bb1e-3e4825223e62 tempest-VolumesListAdminTestJSON-1993464386 None] Lock "cinder-quobyte-696c80e2-8c10-489a-8741-433628482920" acquired by "delete_volume" :: waited 0.015s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:59:17 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59c50f0-d34c-4e27-a3b6-18e313cd4ace]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:59:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fc1e5b67-f7e5-4657-bb1e-3e4825223e62 tempest-VolumesListAdminTestJSON-1993464386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-696c80e2-8c10-489a-8741-433628482920 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:59:17 devstack sudo[98901]: pam_unix(sudo:session): session closed for user root Sep 04 17:59:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-447838d8-b75e-4bce-ade2-f013da5861ee tempest-VolumesListAdminTestJSON-1993464386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.333s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:59:17 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-447838d8-b75e-4bce-ade2-f013da5861ee tempest-VolumesListAdminTestJSON-1993464386 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:59:17 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-447838d8-b75e-4bce-ade2-f013da5861ee tempest-VolumesListAdminTestJSON-1993464386 None] Deleted volume successfully. Sep 04 17:59:17 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-447838d8-b75e-4bce-ade2-f013da5861ee tempest-VolumesListAdminTestJSON-1993464386 None] Lock "cinder-96d09463-4bef-4143-a187-ca61ba25a245-delete_volume" released by "delete_volume" :: held 1.444s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:59:17 devstack sudo[98904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-696c80e2-8c10-489a-8741-433628482920 Sep 04 17:59:17 devstack sudo[98904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:59:17 devstack sudo[98904]: pam_unix(sudo:session): session closed for user root Sep 04 17:59:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fc1e5b67-f7e5-4657-bb1e-3e4825223e62 tempest-VolumesListAdminTestJSON-1993464386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-696c80e2-8c10-489a-8741-433628482920" returned: 0 in 0.391s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:59:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fc1e5b67-f7e5-4657-bb1e-3e4825223e62 tempest-VolumesListAdminTestJSON-1993464386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-696c80e2-8c10-489a-8741-433628482920 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:59:17 devstack sudo[98909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-696c80e2-8c10-489a-8741-433628482920 Sep 04 17:59:17 devstack sudo[98909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:59:17 devstack sudo[98909]: pam_unix(sudo:session): session closed for user root Sep 04 17:59:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fc1e5b67-f7e5-4657-bb1e-3e4825223e62 tempest-VolumesListAdminTestJSON-1993464386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-696c80e2-8c10-489a-8741-433628482920" returned: 0 in 0.277s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:59:17 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fc1e5b67-f7e5-4657-bb1e-3e4825223e62 tempest-VolumesListAdminTestJSON-1993464386 None] Lock "cinder-quobyte-696c80e2-8c10-489a-8741-433628482920" released by "delete_volume" :: held 0.714s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:59:17 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-fc1e5b67-f7e5-4657-bb1e-3e4825223e62 tempest-VolumesListAdminTestJSON-1993464386 None] Created reservations ['e89c7a97-4b8a-4099-ab67-540698d1a44a', '6b3028e1-c733-4369-aaa6-3b1ce117f974', '82e663e6-5249-43c2-8ece-5b9c8e5e775d', '5712a862-56e7-4f1e-adc0-721f2c8f8f92'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:59:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fc1e5b67-f7e5-4657-bb1e-3e4825223e62 tempest-VolumesListAdminTestJSON-1993464386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:59:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fc1e5b67-f7e5-4657-bb1e-3e4825223e62 tempest-VolumesListAdminTestJSON-1993464386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:59:18 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-fc1e5b67-f7e5-4657-bb1e-3e4825223e62 tempest-VolumesListAdminTestJSON-1993464386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:59:18 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-fc1e5b67-f7e5-4657-bb1e-3e4825223e62 tempest-VolumesListAdminTestJSON-1993464386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:59:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fc1e5b67-f7e5-4657-bb1e-3e4825223e62 tempest-VolumesListAdminTestJSON-1993464386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:59:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fc1e5b67-f7e5-4657-bb1e-3e4825223e62 tempest-VolumesListAdminTestJSON-1993464386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:59:18 devstack sudo[98912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:59:18 devstack sudo[98912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:59:18 devstack sudo[98912]: pam_unix(sudo:session): session closed for user root Sep 04 17:59:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fc1e5b67-f7e5-4657-bb1e-3e4825223e62 tempest-VolumesListAdminTestJSON-1993464386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.307s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:59:18 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-fc1e5b67-f7e5-4657-bb1e-3e4825223e62 tempest-VolumesListAdminTestJSON-1993464386 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:59:18 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-fc1e5b67-f7e5-4657-bb1e-3e4825223e62 tempest-VolumesListAdminTestJSON-1993464386 None] Deleted volume successfully. Sep 04 17:59:18 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fc1e5b67-f7e5-4657-bb1e-3e4825223e62 tempest-VolumesListAdminTestJSON-1993464386 None] Lock "cinder-696c80e2-8c10-489a-8741-433628482920-delete_volume" released by "delete_volume" :: held 1.283s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:59:21 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 17:59:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:59:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:59:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:59:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:59:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:59:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:59:21 devstack sudo[98915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:59:21 devstack sudo[98915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:59:21 devstack sudo[98915]: pam_unix(sudo:session): session closed for user root Sep 04 17:59:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.373s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:59:21 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:59:21 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running periodic task VolumeManager._thread_info {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 17:59:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] thread count: 28 {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 17:59:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] thread info: [<_MainThread(MainThread, started 139900377723008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 17:59:25 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3af6e39-0e4d-450e-856d-2bd2faaf1b69 tempest-SnapshotMetadataTestJSON-51499906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:59:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a3af6e39-0e4d-450e-856d-2bd2faaf1b69 tempest-SnapshotMetadataTestJSON-51499906 None] Flow 'volume_create_manager' (b31bd824-5691-4892-b337-ad1822569621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:59:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a3af6e39-0e4d-450e-856d-2bd2faaf1b69 tempest-SnapshotMetadataTestJSON-51499906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bf2d22b-7d41-4ad2-857b-13a2d29640ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:59:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a3af6e39-0e4d-450e-856d-2bd2faaf1b69 tempest-SnapshotMetadataTestJSON-51499906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bf2d22b-7d41-4ad2-857b-13a2d29640ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:59:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1134500198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74d922bf-290f-4180-a4ce-7ca3d1ef3e5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1224736c2c94d98a4aeff6909789398',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:59:25Z,use_quota=True,user_id='5e973f722f5249ca9f269ac3c8c0179e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:59:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a3af6e39-0e4d-450e-856d-2bd2faaf1b69 tempest-SnapshotMetadataTestJSON-51499906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71e1c30f-ebee-4fe8-b2c5-12b438d7a726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:59:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a3af6e39-0e4d-450e-856d-2bd2faaf1b69 tempest-SnapshotMetadataTestJSON-51499906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71e1c30f-ebee-4fe8-b2c5-12b438d7a726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:59:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a3af6e39-0e4d-450e-856d-2bd2faaf1b69 tempest-SnapshotMetadataTestJSON-51499906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce527fca-f0a8-4b2b-b34c-3faf70166a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:59:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a3af6e39-0e4d-450e-856d-2bd2faaf1b69 tempest-SnapshotMetadataTestJSON-51499906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce527fca-f0a8-4b2b-b34c-3faf70166a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74d922bf-290f-4180-a4ce-7ca3d1ef3e5b', 'volume_name': 'volume-74d922bf-290f-4180-a4ce-7ca3d1ef3e5b', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:59:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a3af6e39-0e4d-450e-856d-2bd2faaf1b69 tempest-SnapshotMetadataTestJSON-51499906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06732ee7-d4ae-4beb-bd00-075807505f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:59:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a3af6e39-0e4d-450e-856d-2bd2faaf1b69 tempest-SnapshotMetadataTestJSON-51499906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06732ee7-d4ae-4beb-bd00-075807505f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:59:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a3af6e39-0e4d-450e-856d-2bd2faaf1b69 tempest-SnapshotMetadataTestJSON-51499906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc1abfc0-5467-4d00-8022-087a5d586d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:59:25 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-a3af6e39-0e4d-450e-856d-2bd2faaf1b69 tempest-SnapshotMetadataTestJSON-51499906 None] Volume 74d922bf-290f-4180-a4ce-7ca3d1ef3e5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74d922bf-290f-4180-a4ce-7ca3d1ef3e5b', 'volume_size': 1} Sep 04 17:59:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a3af6e39-0e4d-450e-856d-2bd2faaf1b69 tempest-SnapshotMetadataTestJSON-51499906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:59:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a3af6e39-0e4d-450e-856d-2bd2faaf1b69 tempest-SnapshotMetadataTestJSON-51499906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:59:25 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a3af6e39-0e4d-450e-856d-2bd2faaf1b69 tempest-SnapshotMetadataTestJSON-51499906 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:59:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1134500198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74d922bf-290f-4180-a4ce-7ca3d1ef3e5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1224736c2c94d98a4aeff6909789398',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:59:25Z,use_quota=True,user_id='5e973f722f5249ca9f269ac3c8c0179e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:59:25 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-a3af6e39-0e4d-450e-856d-2bd2faaf1b69 tempest-SnapshotMetadataTestJSON-51499906 None] Creating volume 74d922bf-290f-4180-a4ce-7ca3d1ef3e5b {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:59:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a3af6e39-0e4d-450e-856d-2bd2faaf1b69 tempest-SnapshotMetadataTestJSON-51499906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:59:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a3af6e39-0e4d-450e-856d-2bd2faaf1b69 tempest-SnapshotMetadataTestJSON-51499906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:59:25 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a3af6e39-0e4d-450e-856d-2bd2faaf1b69 tempest-SnapshotMetadataTestJSON-51499906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:59:25 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a3af6e39-0e4d-450e-856d-2bd2faaf1b69 tempest-SnapshotMetadataTestJSON-51499906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:59:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a3af6e39-0e4d-450e-856d-2bd2faaf1b69 tempest-SnapshotMetadataTestJSON-51499906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:59:25 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a3af6e39-0e4d-450e-856d-2bd2faaf1b69 tempest-SnapshotMetadataTestJSON-51499906 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:59:25 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-a3af6e39-0e4d-450e-856d-2bd2faaf1b69 tempest-SnapshotMetadataTestJSON-51499906 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:59:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a3af6e39-0e4d-450e-856d-2bd2faaf1b69 tempest-SnapshotMetadataTestJSON-51499906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-74d922bf-290f-4180-a4ce-7ca3d1ef3e5b 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:59:25 devstack sudo[98921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-74d922bf-290f-4180-a4ce-7ca3d1ef3e5b 1073741824 Sep 04 17:59:25 devstack sudo[98921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:59:25 devstack sudo[98921]: pam_unix(sudo:session): session closed for user root Sep 04 17:59:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a3af6e39-0e4d-450e-856d-2bd2faaf1b69 tempest-SnapshotMetadataTestJSON-51499906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-74d922bf-290f-4180-a4ce-7ca3d1ef3e5b 1073741824" returned: 0 in 0.517s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:59:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a3af6e39-0e4d-450e-856d-2bd2faaf1b69 tempest-SnapshotMetadataTestJSON-51499906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-74d922bf-290f-4180-a4ce-7ca3d1ef3e5b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:59:26 devstack sudo[98927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-74d922bf-290f-4180-a4ce-7ca3d1ef3e5b Sep 04 17:59:26 devstack sudo[98927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:59:26 devstack sudo[98927]: pam_unix(sudo:session): session closed for user root Sep 04 17:59:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a3af6e39-0e4d-450e-856d-2bd2faaf1b69 tempest-SnapshotMetadataTestJSON-51499906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-74d922bf-290f-4180-a4ce-7ca3d1ef3e5b" returned: 0 in 0.279s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:59:26 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a3af6e39-0e4d-450e-856d-2bd2faaf1b69 tempest-SnapshotMetadataTestJSON-51499906 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:59:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a3af6e39-0e4d-450e-856d-2bd2faaf1b69 tempest-SnapshotMetadataTestJSON-51499906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:59:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a3af6e39-0e4d-450e-856d-2bd2faaf1b69 tempest-SnapshotMetadataTestJSON-51499906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc1abfc0-5467-4d00-8022-087a5d586d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74d922bf-290f-4180-a4ce-7ca3d1ef3e5b', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:59:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a3af6e39-0e4d-450e-856d-2bd2faaf1b69 tempest-SnapshotMetadataTestJSON-51499906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a219c356-3f58-4dad-8084-48a13f730bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:59:26 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-a3af6e39-0e4d-450e-856d-2bd2faaf1b69 tempest-SnapshotMetadataTestJSON-51499906 None] Volume volume-74d922bf-290f-4180-a4ce-7ca3d1ef3e5b (74d922bf-290f-4180-a4ce-7ca3d1ef3e5b): created successfully Sep 04 17:59:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a3af6e39-0e4d-450e-856d-2bd2faaf1b69 tempest-SnapshotMetadataTestJSON-51499906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a219c356-3f58-4dad-8084-48a13f730bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:59:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a3af6e39-0e4d-450e-856d-2bd2faaf1b69 tempest-SnapshotMetadataTestJSON-51499906 None] Flow 'volume_create_manager' (b31bd824-5691-4892-b337-ad1822569621) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:59:26 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-a3af6e39-0e4d-450e-856d-2bd2faaf1b69 tempest-SnapshotMetadataTestJSON-51499906 None] Created volume successfully. Sep 04 17:59:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d95e196d-f6b5-419a-844e-32be5e736236 tempest-SnapshotMetadataTestJSON-51499906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:59:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d95e196d-f6b5-419a-844e-32be5e736236 tempest-SnapshotMetadataTestJSON-51499906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:59:27 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-d95e196d-f6b5-419a-844e-32be5e736236 tempest-SnapshotMetadataTestJSON-51499906 None] Creating offline snapshot 060c8412-1aab-4066-afbe-f51a28452705 of volume 74d922bf-290f-4180-a4ce-7ca3d1ef3e5b {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 17:59:27 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d5a6ad-7cb8-4053-a74f-686c27ae977d]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:59:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d95e196d-f6b5-419a-844e-32be5e736236 tempest-SnapshotMetadataTestJSON-51499906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-74d922bf-290f-4180-a4ce-7ca3d1ef3e5b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:59:27 devstack sudo[98930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-74d922bf-290f-4180-a4ce-7ca3d1ef3e5b Sep 04 17:59:27 devstack sudo[98930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:59:28 devstack sudo[98930]: pam_unix(sudo:session): session closed for user root Sep 04 17:59:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d95e196d-f6b5-419a-844e-32be5e736236 tempest-SnapshotMetadataTestJSON-51499906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-74d922bf-290f-4180-a4ce-7ca3d1ef3e5b" returned: 0 in 0.467s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:59:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d95e196d-f6b5-419a-844e-32be5e736236 tempest-SnapshotMetadataTestJSON-51499906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-74d922bf-290f-4180-a4ce-7ca3d1ef3e5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-74d922bf-290f-4180-a4ce-7ca3d1ef3e5b.060c8412-1aab-4066-afbe-f51a28452705 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:59:28 devstack sudo[98938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-74d922bf-290f-4180-a4ce-7ca3d1ef3e5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-74d922bf-290f-4180-a4ce-7ca3d1ef3e5b.060c8412-1aab-4066-afbe-f51a28452705 1G Sep 04 17:59:28 devstack sudo[98938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:59:28 devstack sudo[98938]: pam_unix(sudo:session): session closed for user root Sep 04 17:59:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d95e196d-f6b5-419a-844e-32be5e736236 tempest-SnapshotMetadataTestJSON-51499906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-74d922bf-290f-4180-a4ce-7ca3d1ef3e5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-74d922bf-290f-4180-a4ce-7ca3d1ef3e5b.060c8412-1aab-4066-afbe-f51a28452705 1G" returned: 0 in 0.526s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:59:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d95e196d-f6b5-419a-844e-32be5e736236 tempest-SnapshotMetadataTestJSON-51499906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74d922bf-290f-4180-a4ce-7ca3d1ef3e5b -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-74d922bf-290f-4180-a4ce-7ca3d1ef3e5b.060c8412-1aab-4066-afbe-f51a28452705 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:59:28 devstack sudo[98944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74d922bf-290f-4180-a4ce-7ca3d1ef3e5b -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-74d922bf-290f-4180-a4ce-7ca3d1ef3e5b.060c8412-1aab-4066-afbe-f51a28452705 Sep 04 17:59:28 devstack sudo[98944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:59:29 devstack sudo[98944]: pam_unix(sudo:session): session closed for user root Sep 04 17:59:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d95e196d-f6b5-419a-844e-32be5e736236 tempest-SnapshotMetadataTestJSON-51499906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74d922bf-290f-4180-a4ce-7ca3d1ef3e5b -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-74d922bf-290f-4180-a4ce-7ca3d1ef3e5b.060c8412-1aab-4066-afbe-f51a28452705" returned: 0 in 0.382s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:59:29 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-d95e196d-f6b5-419a-844e-32be5e736236 tempest-SnapshotMetadataTestJSON-51499906 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-74d922bf-290f-4180-a4ce-7ca3d1ef3e5b.060c8412-1aab-4066-afbe-f51a28452705 is being set with open permissions: ugo+rw Sep 04 17:59:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d95e196d-f6b5-419a-844e-32be5e736236 tempest-SnapshotMetadataTestJSON-51499906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-74d922bf-290f-4180-a4ce-7ca3d1ef3e5b.060c8412-1aab-4066-afbe-f51a28452705 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:59:29 devstack sudo[98949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-74d922bf-290f-4180-a4ce-7ca3d1ef3e5b.060c8412-1aab-4066-afbe-f51a28452705 Sep 04 17:59:29 devstack sudo[98949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:59:29 devstack sudo[98949]: pam_unix(sudo:session): session closed for user root Sep 04 17:59:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d95e196d-f6b5-419a-844e-32be5e736236 tempest-SnapshotMetadataTestJSON-51499906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-74d922bf-290f-4180-a4ce-7ca3d1ef3e5b.060c8412-1aab-4066-afbe-f51a28452705" returned: 0 in 0.327s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:59:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d95e196d-f6b5-419a-844e-32be5e736236 tempest-SnapshotMetadataTestJSON-51499906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-74d922bf-290f-4180-a4ce-7ca3d1ef3e5b.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:59:29 devstack sudo[98952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-74d922bf-290f-4180-a4ce-7ca3d1ef3e5b.info Sep 04 17:59:29 devstack sudo[98952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:59:29 devstack sudo[98952]: pam_unix(sudo:session): session closed for user root Sep 04 17:59:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d95e196d-f6b5-419a-844e-32be5e736236 tempest-SnapshotMetadataTestJSON-51499906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-74d922bf-290f-4180-a4ce-7ca3d1ef3e5b.info" returned: 0 in 0.337s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:59:29 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-d95e196d-f6b5-419a-844e-32be5e736236 tempest-SnapshotMetadataTestJSON-51499906 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-74d922bf-290f-4180-a4ce-7ca3d1ef3e5b.info is being set with open permissions: ugo+rw Sep 04 17:59:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d95e196d-f6b5-419a-844e-32be5e736236 tempest-SnapshotMetadataTestJSON-51499906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-74d922bf-290f-4180-a4ce-7ca3d1ef3e5b.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:59:29 devstack sudo[98955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-74d922bf-290f-4180-a4ce-7ca3d1ef3e5b.info Sep 04 17:59:29 devstack sudo[98955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:59:30 devstack sudo[98955]: pam_unix(sudo:session): session closed for user root Sep 04 17:59:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d95e196d-f6b5-419a-844e-32be5e736236 tempest-SnapshotMetadataTestJSON-51499906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-74d922bf-290f-4180-a4ce-7ca3d1ef3e5b.info" returned: 0 in 0.286s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:59:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d95e196d-f6b5-419a-844e-32be5e736236 tempest-SnapshotMetadataTestJSON-51499906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.462s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:59:30 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-d95e196d-f6b5-419a-844e-32be5e736236 tempest-SnapshotMetadataTestJSON-51499906 None] Create snapshot completed successfully Sep 04 17:59:31 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4b5c169b-d75c-40a7-837d-adf369f7d266 tempest-SnapshotMetadataTestJSON-51499906 None] Acquiring lock "cinder-060c8412-1aab-4066-afbe-f51a28452705-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:59:32 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4b5c169b-d75c-40a7-837d-adf369f7d266 tempest-SnapshotMetadataTestJSON-51499906 None] Lock "cinder-060c8412-1aab-4066-afbe-f51a28452705-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:59:32 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4b5c169b-d75c-40a7-837d-adf369f7d266 tempest-SnapshotMetadataTestJSON-51499906 None] Acquiring lock "cinder-quobyte-74d922bf-290f-4180-a4ce-7ca3d1ef3e5b" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:59:32 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4b5c169b-d75c-40a7-837d-adf369f7d266 tempest-SnapshotMetadataTestJSON-51499906 None] Lock "cinder-quobyte-74d922bf-290f-4180-a4ce-7ca3d1ef3e5b" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:59:32 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4b5c169b-d75c-40a7-837d-adf369f7d266 tempest-SnapshotMetadataTestJSON-51499906 None] Acquiring lock "cinder-quobyte-060c8412-1aab-4066-afbe-f51a28452705" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:59:32 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4b5c169b-d75c-40a7-837d-adf369f7d266 tempest-SnapshotMetadataTestJSON-51499906 None] Lock "cinder-quobyte-060c8412-1aab-4066-afbe-f51a28452705" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:59:32 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-4b5c169b-d75c-40a7-837d-adf369f7d266 tempest-SnapshotMetadataTestJSON-51499906 None] Deleting offline snapshot 060c8412-1aab-4066-afbe-f51a28452705 of volume 74d922bf-290f-4180-a4ce-7ca3d1ef3e5b {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 17:59:32 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-4b5c169b-d75c-40a7-837d-adf369f7d266 tempest-SnapshotMetadataTestJSON-51499906 None] snapshot_file for this snap is: volume-74d922bf-290f-4180-a4ce-7ca3d1ef3e5b.060c8412-1aab-4066-afbe-f51a28452705 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 17:59:32 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[45687eca-faf1-4f42-b4d1-0caa673e7501]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:59:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4b5c169b-d75c-40a7-837d-adf369f7d266 tempest-SnapshotMetadataTestJSON-51499906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-74d922bf-290f-4180-a4ce-7ca3d1ef3e5b.060c8412-1aab-4066-afbe-f51a28452705 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:59:32 devstack sudo[98987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-74d922bf-290f-4180-a4ce-7ca3d1ef3e5b.060c8412-1aab-4066-afbe-f51a28452705 Sep 04 17:59:32 devstack sudo[98987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:59:32 devstack sudo[98987]: pam_unix(sudo:session): session closed for user root Sep 04 17:59:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4b5c169b-d75c-40a7-837d-adf369f7d266 tempest-SnapshotMetadataTestJSON-51499906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-74d922bf-290f-4180-a4ce-7ca3d1ef3e5b.060c8412-1aab-4066-afbe-f51a28452705" returned: 0 in 0.494s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:59:32 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-4b5c169b-d75c-40a7-837d-adf369f7d266 tempest-SnapshotMetadataTestJSON-51499906 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74d922bf-290f-4180-a4ce-7ca3d1ef3e5b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 17:59:32 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ed924a-37c5-47fe-bc8c-de4a229c8d7a]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:59:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4b5c169b-d75c-40a7-837d-adf369f7d266 tempest-SnapshotMetadataTestJSON-51499906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-74d922bf-290f-4180-a4ce-7ca3d1ef3e5b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:59:32 devstack sudo[98996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-74d922bf-290f-4180-a4ce-7ca3d1ef3e5b Sep 04 17:59:32 devstack sudo[98996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:59:33 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-657b7da3-8690-481a-b89f-402002c2dc06 tempest-VolumesActionsTest-1660328580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:59:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-657b7da3-8690-481a-b89f-402002c2dc06 tempest-VolumesActionsTest-1660328580 None] Flow 'volume_create_manager' (d988475c-e559-411d-a505-2102abf29109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:59:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-657b7da3-8690-481a-b89f-402002c2dc06 tempest-VolumesActionsTest-1660328580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (074615c2-5a39-4799-be84-c73b370d6369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:59:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-657b7da3-8690-481a-b89f-402002c2dc06 tempest-VolumesActionsTest-1660328580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (074615c2-5a39-4799-be84-c73b370d6369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:59:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1870868197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0c12227-25e5-4bff-8312-c8f4c6baf37c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34f093c9ab6241c1bc6f375dea6bc741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:59:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:59:33Z,use_quota=True,user_id='32d905e88e544a3caa43142dbaf42b51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:59:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-657b7da3-8690-481a-b89f-402002c2dc06 tempest-VolumesActionsTest-1660328580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0ffc712-cfb7-4330-bfe1-02f7547b82e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:59:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-657b7da3-8690-481a-b89f-402002c2dc06 tempest-VolumesActionsTest-1660328580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0ffc712-cfb7-4330-bfe1-02f7547b82e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:59:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-657b7da3-8690-481a-b89f-402002c2dc06 tempest-VolumesActionsTest-1660328580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58e6fe77-13a2-4420-8aaa-0c98f7491853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:59:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-657b7da3-8690-481a-b89f-402002c2dc06 tempest-VolumesActionsTest-1660328580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58e6fe77-13a2-4420-8aaa-0c98f7491853) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0c12227-25e5-4bff-8312-c8f4c6baf37c', 'volume_name': 'volume-a0c12227-25e5-4bff-8312-c8f4c6baf37c', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:59:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-657b7da3-8690-481a-b89f-402002c2dc06 tempest-VolumesActionsTest-1660328580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c08dbf95-a2e5-48fa-b1b9-cf2703ad5c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:59:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-657b7da3-8690-481a-b89f-402002c2dc06 tempest-VolumesActionsTest-1660328580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c08dbf95-a2e5-48fa-b1b9-cf2703ad5c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:59:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-657b7da3-8690-481a-b89f-402002c2dc06 tempest-VolumesActionsTest-1660328580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe7c61c0-a849-4e87-a7e2-b10f58723df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:59:33 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-657b7da3-8690-481a-b89f-402002c2dc06 tempest-VolumesActionsTest-1660328580 None] Volume a0c12227-25e5-4bff-8312-c8f4c6baf37c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0c12227-25e5-4bff-8312-c8f4c6baf37c', 'volume_size': 1} Sep 04 17:59:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-657b7da3-8690-481a-b89f-402002c2dc06 tempest-VolumesActionsTest-1660328580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:59:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-657b7da3-8690-481a-b89f-402002c2dc06 tempest-VolumesActionsTest-1660328580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:59:33 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-657b7da3-8690-481a-b89f-402002c2dc06 tempest-VolumesActionsTest-1660328580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:59:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1870868197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0c12227-25e5-4bff-8312-c8f4c6baf37c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34f093c9ab6241c1bc6f375dea6bc741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:59:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:59:33Z,use_quota=True,user_id='32d905e88e544a3caa43142dbaf42b51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:59:33 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-657b7da3-8690-481a-b89f-402002c2dc06 tempest-VolumesActionsTest-1660328580 None] Creating volume a0c12227-25e5-4bff-8312-c8f4c6baf37c {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:59:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-657b7da3-8690-481a-b89f-402002c2dc06 tempest-VolumesActionsTest-1660328580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:59:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-657b7da3-8690-481a-b89f-402002c2dc06 tempest-VolumesActionsTest-1660328580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:59:33 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-657b7da3-8690-481a-b89f-402002c2dc06 tempest-VolumesActionsTest-1660328580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:59:33 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-657b7da3-8690-481a-b89f-402002c2dc06 tempest-VolumesActionsTest-1660328580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:59:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-657b7da3-8690-481a-b89f-402002c2dc06 tempest-VolumesActionsTest-1660328580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:59:33 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-657b7da3-8690-481a-b89f-402002c2dc06 tempest-VolumesActionsTest-1660328580 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:59:33 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-657b7da3-8690-481a-b89f-402002c2dc06 tempest-VolumesActionsTest-1660328580 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:59:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-657b7da3-8690-481a-b89f-402002c2dc06 tempest-VolumesActionsTest-1660328580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0c12227-25e5-4bff-8312-c8f4c6baf37c 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:59:33 devstack sudo[99001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0c12227-25e5-4bff-8312-c8f4c6baf37c 1073741824 Sep 04 17:59:33 devstack sudo[99001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:59:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4b5c169b-d75c-40a7-837d-adf369f7d266 tempest-SnapshotMetadataTestJSON-51499906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-74d922bf-290f-4180-a4ce-7ca3d1ef3e5b" returned: 0 in 0.473s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:59:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4b5c169b-d75c-40a7-837d-adf369f7d266 tempest-SnapshotMetadataTestJSON-51499906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-74d922bf-290f-4180-a4ce-7ca3d1ef3e5b.060c8412-1aab-4066-afbe-f51a28452705 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:59:33 devstack sudo[98996]: pam_unix(sudo:session): session closed for user root Sep 04 17:59:33 devstack sudo[99003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-74d922bf-290f-4180-a4ce-7ca3d1ef3e5b.060c8412-1aab-4066-afbe-f51a28452705 Sep 04 17:59:33 devstack sudo[99003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:59:33 devstack sudo[99003]: pam_unix(sudo:session): session closed for user root Sep 04 17:59:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4b5c169b-d75c-40a7-837d-adf369f7d266 tempest-SnapshotMetadataTestJSON-51499906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-74d922bf-290f-4180-a4ce-7ca3d1ef3e5b.060c8412-1aab-4066-afbe-f51a28452705" returned: 0 in 0.695s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:59:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4b5c169b-d75c-40a7-837d-adf369f7d266 tempest-SnapshotMetadataTestJSON-51499906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-74d922bf-290f-4180-a4ce-7ca3d1ef3e5b.060c8412-1aab-4066-afbe-f51a28452705 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:59:33 devstack sudo[99067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-74d922bf-290f-4180-a4ce-7ca3d1ef3e5b.060c8412-1aab-4066-afbe-f51a28452705 Sep 04 17:59:33 devstack sudo[99067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:59:34 devstack sudo[99001]: pam_unix(sudo:session): session closed for user root Sep 04 17:59:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-657b7da3-8690-481a-b89f-402002c2dc06 tempest-VolumesActionsTest-1660328580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0c12227-25e5-4bff-8312-c8f4c6baf37c 1073741824" returned: 0 in 0.940s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:59:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-657b7da3-8690-481a-b89f-402002c2dc06 tempest-VolumesActionsTest-1660328580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0c12227-25e5-4bff-8312-c8f4c6baf37c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:59:34 devstack sudo[99076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0c12227-25e5-4bff-8312-c8f4c6baf37c Sep 04 17:59:34 devstack sudo[99076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:59:34 devstack sudo[99067]: pam_unix(sudo:session): session closed for user root Sep 04 17:59:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4b5c169b-d75c-40a7-837d-adf369f7d266 tempest-SnapshotMetadataTestJSON-51499906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-74d922bf-290f-4180-a4ce-7ca3d1ef3e5b.060c8412-1aab-4066-afbe-f51a28452705" returned: 0 in 0.468s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:59:34 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4b5c169b-d75c-40a7-837d-adf369f7d266 tempest-SnapshotMetadataTestJSON-51499906 None] Lock "cinder-quobyte-060c8412-1aab-4066-afbe-f51a28452705" released by "_delete_snapshot" :: held 2.341s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:59:34 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4b5c169b-d75c-40a7-837d-adf369f7d266 tempest-SnapshotMetadataTestJSON-51499906 None] Lock "cinder-quobyte-74d922bf-290f-4180-a4ce-7ca3d1ef3e5b" released by "delete_snapshot" :: held 2.394s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:59:34 devstack sudo[99076]: pam_unix(sudo:session): session closed for user root Sep 04 17:59:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-657b7da3-8690-481a-b89f-402002c2dc06 tempest-VolumesActionsTest-1660328580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0c12227-25e5-4bff-8312-c8f4c6baf37c" returned: 0 in 0.355s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:59:34 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-657b7da3-8690-481a-b89f-402002c2dc06 tempest-VolumesActionsTest-1660328580 None] <== create_volume: return (1375ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:59:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-657b7da3-8690-481a-b89f-402002c2dc06 tempest-VolumesActionsTest-1660328580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.378s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:59:34 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-4b5c169b-d75c-40a7-837d-adf369f7d266 tempest-SnapshotMetadataTestJSON-51499906 None] Created reservations ['9b5ad615-30c9-42a2-8e5a-26b9a0ed9ed1', 'b1e963ab-0538-4dab-8767-ea563ab996cd', '3aed1f1f-a6f5-4ea4-86d1-6d5aacff4d0f', '472f1e4b-259c-447d-b186-d48c534277f4'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:59:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-657b7da3-8690-481a-b89f-402002c2dc06 tempest-VolumesActionsTest-1660328580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe7c61c0-a849-4e87-a7e2-b10f58723df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0c12227-25e5-4bff-8312-c8f4c6baf37c', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:59:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-657b7da3-8690-481a-b89f-402002c2dc06 tempest-VolumesActionsTest-1660328580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f76b85ef-39f9-4a63-ab7d-088fd7dd8211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:59:34 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-657b7da3-8690-481a-b89f-402002c2dc06 tempest-VolumesActionsTest-1660328580 None] Volume volume-a0c12227-25e5-4bff-8312-c8f4c6baf37c (a0c12227-25e5-4bff-8312-c8f4c6baf37c): created successfully Sep 04 17:59:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-657b7da3-8690-481a-b89f-402002c2dc06 tempest-VolumesActionsTest-1660328580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f76b85ef-39f9-4a63-ab7d-088fd7dd8211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:59:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-657b7da3-8690-481a-b89f-402002c2dc06 tempest-VolumesActionsTest-1660328580 None] Flow 'volume_create_manager' (d988475c-e559-411d-a505-2102abf29109) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:59:34 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-657b7da3-8690-481a-b89f-402002c2dc06 tempest-VolumesActionsTest-1660328580 None] Created volume successfully. Sep 04 17:59:34 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-4b5c169b-d75c-40a7-837d-adf369f7d266 tempest-SnapshotMetadataTestJSON-51499906 None] Delete snapshot completed successfully. Sep 04 17:59:34 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4b5c169b-d75c-40a7-837d-adf369f7d266 tempest-SnapshotMetadataTestJSON-51499906 None] Lock "cinder-060c8412-1aab-4066-afbe-f51a28452705-delete_snapshot" released by "delete_snapshot" :: held 2.623s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:59:35 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-646545fc-3778-4c94-b3eb-de09a1d6b872 tempest-SnapshotMetadataTestJSON-51499906 None] Acquiring lock "cinder-74d922bf-290f-4180-a4ce-7ca3d1ef3e5b-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:59:35 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-646545fc-3778-4c94-b3eb-de09a1d6b872 tempest-SnapshotMetadataTestJSON-51499906 None] Lock "cinder-74d922bf-290f-4180-a4ce-7ca3d1ef3e5b-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:59:35 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-646545fc-3778-4c94-b3eb-de09a1d6b872 tempest-SnapshotMetadataTestJSON-51499906 None] Acquiring lock "cinder-quobyte-74d922bf-290f-4180-a4ce-7ca3d1ef3e5b" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:59:35 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-646545fc-3778-4c94-b3eb-de09a1d6b872 tempest-SnapshotMetadataTestJSON-51499906 None] Lock "cinder-quobyte-74d922bf-290f-4180-a4ce-7ca3d1ef3e5b" acquired by "delete_volume" :: waited 0.028s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:59:35 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28899d7-9b14-4c94-b2ab-d44791206387]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:59:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-646545fc-3778-4c94-b3eb-de09a1d6b872 tempest-SnapshotMetadataTestJSON-51499906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-74d922bf-290f-4180-a4ce-7ca3d1ef3e5b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:59:35 devstack sudo[99087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-74d922bf-290f-4180-a4ce-7ca3d1ef3e5b Sep 04 17:59:35 devstack sudo[99087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:59:35 devstack sudo[99087]: pam_unix(sudo:session): session closed for user root Sep 04 17:59:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-646545fc-3778-4c94-b3eb-de09a1d6b872 tempest-SnapshotMetadataTestJSON-51499906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-74d922bf-290f-4180-a4ce-7ca3d1ef3e5b" returned: 0 in 0.392s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:59:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-646545fc-3778-4c94-b3eb-de09a1d6b872 tempest-SnapshotMetadataTestJSON-51499906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-74d922bf-290f-4180-a4ce-7ca3d1ef3e5b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:59:36 devstack sudo[99092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-74d922bf-290f-4180-a4ce-7ca3d1ef3e5b Sep 04 17:59:36 devstack sudo[99092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:59:36 devstack sudo[99092]: pam_unix(sudo:session): session closed for user root Sep 04 17:59:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-646545fc-3778-4c94-b3eb-de09a1d6b872 tempest-SnapshotMetadataTestJSON-51499906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-74d922bf-290f-4180-a4ce-7ca3d1ef3e5b" returned: 0 in 0.288s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:59:36 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-646545fc-3778-4c94-b3eb-de09a1d6b872 tempest-SnapshotMetadataTestJSON-51499906 None] Lock "cinder-quobyte-74d922bf-290f-4180-a4ce-7ca3d1ef3e5b" released by "delete_volume" :: held 0.779s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:59:36 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-646545fc-3778-4c94-b3eb-de09a1d6b872 tempest-SnapshotMetadataTestJSON-51499906 None] Created reservations ['310416ac-3380-45ab-bf57-391ed7d2f473', '138fea29-ce36-461f-b544-da535757e5da', '12a83db3-cba3-41ec-a8f9-021874d117c6', 'd715b7ba-00de-4ecc-a794-00151dc031a4'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:59:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-646545fc-3778-4c94-b3eb-de09a1d6b872 tempest-SnapshotMetadataTestJSON-51499906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:59:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-646545fc-3778-4c94-b3eb-de09a1d6b872 tempest-SnapshotMetadataTestJSON-51499906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:59:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-646545fc-3778-4c94-b3eb-de09a1d6b872 tempest-SnapshotMetadataTestJSON-51499906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:59:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-646545fc-3778-4c94-b3eb-de09a1d6b872 tempest-SnapshotMetadataTestJSON-51499906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:59:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-646545fc-3778-4c94-b3eb-de09a1d6b872 tempest-SnapshotMetadataTestJSON-51499906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:59:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-646545fc-3778-4c94-b3eb-de09a1d6b872 tempest-SnapshotMetadataTestJSON-51499906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:59:36 devstack sudo[99098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:59:36 devstack sudo[99098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:59:36 devstack sudo[99098]: pam_unix(sudo:session): session closed for user root Sep 04 17:59:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-646545fc-3778-4c94-b3eb-de09a1d6b872 tempest-SnapshotMetadataTestJSON-51499906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.416s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:59:36 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-646545fc-3778-4c94-b3eb-de09a1d6b872 tempest-SnapshotMetadataTestJSON-51499906 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:59:36 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-646545fc-3778-4c94-b3eb-de09a1d6b872 tempest-SnapshotMetadataTestJSON-51499906 None] Deleted volume successfully. Sep 04 17:59:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-646545fc-3778-4c94-b3eb-de09a1d6b872 tempest-SnapshotMetadataTestJSON-51499906 None] Lock "cinder-74d922bf-290f-4180-a4ce-7ca3d1ef3e5b-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:59:39 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=106,cinder:INSERT=42,cinder:UPDATE=154,cinder:DELETE=13 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 17:59:39 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff171a7a-0bf5-4718-a93c-7b8cd30948b6 tempest-TestMinimumBasicScenario-1450520566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:59:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ff171a7a-0bf5-4718-a93c-7b8cd30948b6 tempest-TestMinimumBasicScenario-1450520566 None] Flow 'volume_create_manager' (1f249155-dca0-4adf-991e-d702b4442ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:59:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ff171a7a-0bf5-4718-a93c-7b8cd30948b6 tempest-TestMinimumBasicScenario-1450520566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b2580ed-3be8-4ec1-bd15-bb2291fced61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:59:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ff171a7a-0bf5-4718-a93c-7b8cd30948b6 tempest-TestMinimumBasicScenario-1450520566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b2580ed-3be8-4ec1-bd15-bb2291fced61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:59:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-430987230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc69fb22-62b7-4d6b-9530-7dbb33fe1b74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efa54c6ca6924df790c55be426e9dc9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:59:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:59:39Z,use_quota=True,user_id='0ff5c4cad71d4e26b9aa6d50aa9d03a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:59:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ff171a7a-0bf5-4718-a93c-7b8cd30948b6 tempest-TestMinimumBasicScenario-1450520566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41951b67-9a80-4cb9-ab87-5f8d438d93dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:59:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ff171a7a-0bf5-4718-a93c-7b8cd30948b6 tempest-TestMinimumBasicScenario-1450520566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41951b67-9a80-4cb9-ab87-5f8d438d93dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:59:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ff171a7a-0bf5-4718-a93c-7b8cd30948b6 tempest-TestMinimumBasicScenario-1450520566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a478447c-6c39-4d7f-bc97-0113145890fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:59:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ff171a7a-0bf5-4718-a93c-7b8cd30948b6 tempest-TestMinimumBasicScenario-1450520566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a478447c-6c39-4d7f-bc97-0113145890fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc69fb22-62b7-4d6b-9530-7dbb33fe1b74', 'volume_name': 'volume-cc69fb22-62b7-4d6b-9530-7dbb33fe1b74', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:59:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ff171a7a-0bf5-4718-a93c-7b8cd30948b6 tempest-TestMinimumBasicScenario-1450520566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4d3346b-26b7-49ce-81ff-b922dea59ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:59:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ff171a7a-0bf5-4718-a93c-7b8cd30948b6 tempest-TestMinimumBasicScenario-1450520566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4d3346b-26b7-49ce-81ff-b922dea59ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:59:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ff171a7a-0bf5-4718-a93c-7b8cd30948b6 tempest-TestMinimumBasicScenario-1450520566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e27d344-ce82-4682-84fe-a5d3c5f93453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:59:39 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-ff171a7a-0bf5-4718-a93c-7b8cd30948b6 tempest-TestMinimumBasicScenario-1450520566 None] Volume cc69fb22-62b7-4d6b-9530-7dbb33fe1b74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc69fb22-62b7-4d6b-9530-7dbb33fe1b74', 'volume_size': 1} Sep 04 17:59:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ff171a7a-0bf5-4718-a93c-7b8cd30948b6 tempest-TestMinimumBasicScenario-1450520566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:59:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ff171a7a-0bf5-4718-a93c-7b8cd30948b6 tempest-TestMinimumBasicScenario-1450520566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:59:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ff171a7a-0bf5-4718-a93c-7b8cd30948b6 tempest-TestMinimumBasicScenario-1450520566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:59:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-430987230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc69fb22-62b7-4d6b-9530-7dbb33fe1b74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efa54c6ca6924df790c55be426e9dc9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:59:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:59:39Z,use_quota=True,user_id='0ff5c4cad71d4e26b9aa6d50aa9d03a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:59:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-ff171a7a-0bf5-4718-a93c-7b8cd30948b6 tempest-TestMinimumBasicScenario-1450520566 None] Creating volume cc69fb22-62b7-4d6b-9530-7dbb33fe1b74 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:59:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ff171a7a-0bf5-4718-a93c-7b8cd30948b6 tempest-TestMinimumBasicScenario-1450520566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:59:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ff171a7a-0bf5-4718-a93c-7b8cd30948b6 tempest-TestMinimumBasicScenario-1450520566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:59:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ff171a7a-0bf5-4718-a93c-7b8cd30948b6 tempest-TestMinimumBasicScenario-1450520566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:59:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ff171a7a-0bf5-4718-a93c-7b8cd30948b6 tempest-TestMinimumBasicScenario-1450520566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:59:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ff171a7a-0bf5-4718-a93c-7b8cd30948b6 tempest-TestMinimumBasicScenario-1450520566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:59:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ff171a7a-0bf5-4718-a93c-7b8cd30948b6 tempest-TestMinimumBasicScenario-1450520566 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:59:39 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-ff171a7a-0bf5-4718-a93c-7b8cd30948b6 tempest-TestMinimumBasicScenario-1450520566 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:59:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ff171a7a-0bf5-4718-a93c-7b8cd30948b6 tempest-TestMinimumBasicScenario-1450520566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cc69fb22-62b7-4d6b-9530-7dbb33fe1b74 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:59:39 devstack sudo[99114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cc69fb22-62b7-4d6b-9530-7dbb33fe1b74 1073741824 Sep 04 17:59:39 devstack sudo[99114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:59:40 devstack sudo[99114]: pam_unix(sudo:session): session closed for user root Sep 04 17:59:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ff171a7a-0bf5-4718-a93c-7b8cd30948b6 tempest-TestMinimumBasicScenario-1450520566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cc69fb22-62b7-4d6b-9530-7dbb33fe1b74 1073741824" returned: 0 in 0.775s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:59:40 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:UPDATE=150,cinder:SELECT=114,cinder:INSERT=32,cinder:DELETE=13 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 17:59:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ff171a7a-0bf5-4718-a93c-7b8cd30948b6 tempest-TestMinimumBasicScenario-1450520566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cc69fb22-62b7-4d6b-9530-7dbb33fe1b74 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:59:40 devstack sudo[99122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cc69fb22-62b7-4d6b-9530-7dbb33fe1b74 Sep 04 17:59:40 devstack sudo[99122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:59:40 devstack sudo[99122]: pam_unix(sudo:session): session closed for user root Sep 04 17:59:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ff171a7a-0bf5-4718-a93c-7b8cd30948b6 tempest-TestMinimumBasicScenario-1450520566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cc69fb22-62b7-4d6b-9530-7dbb33fe1b74" returned: 0 in 0.396s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:59:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ff171a7a-0bf5-4718-a93c-7b8cd30948b6 tempest-TestMinimumBasicScenario-1450520566 None] <== create_volume: return (1256ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:59:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ff171a7a-0bf5-4718-a93c-7b8cd30948b6 tempest-TestMinimumBasicScenario-1450520566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.259s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:59:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ff171a7a-0bf5-4718-a93c-7b8cd30948b6 tempest-TestMinimumBasicScenario-1450520566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e27d344-ce82-4682-84fe-a5d3c5f93453) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc69fb22-62b7-4d6b-9530-7dbb33fe1b74', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:59:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ff171a7a-0bf5-4718-a93c-7b8cd30948b6 tempest-TestMinimumBasicScenario-1450520566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f88937a2-8ea9-45f7-ab3f-484616b67328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:59:40 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-ff171a7a-0bf5-4718-a93c-7b8cd30948b6 tempest-TestMinimumBasicScenario-1450520566 None] Volume volume-cc69fb22-62b7-4d6b-9530-7dbb33fe1b74 (cc69fb22-62b7-4d6b-9530-7dbb33fe1b74): created successfully Sep 04 17:59:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ff171a7a-0bf5-4718-a93c-7b8cd30948b6 tempest-TestMinimumBasicScenario-1450520566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f88937a2-8ea9-45f7-ab3f-484616b67328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:59:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ff171a7a-0bf5-4718-a93c-7b8cd30948b6 tempest-TestMinimumBasicScenario-1450520566 None] Flow 'volume_create_manager' (1f249155-dca0-4adf-991e-d702b4442ee1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:59:40 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-ff171a7a-0bf5-4718-a93c-7b8cd30948b6 tempest-TestMinimumBasicScenario-1450520566 None] Created volume successfully. Sep 04 17:59:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-39330826-33ba-4d4f-bb98-37637e5798e2 req-481f9a6c-48c5-4fef-950f-5bd6fa26be83 tempest-TestMinimumBasicScenario-1450520566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:59:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-39330826-33ba-4d4f-bb98-37637e5798e2 req-481f9a6c-48c5-4fef-950f-5bd6fa26be83 tempest-TestMinimumBasicScenario-1450520566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:59:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-39330826-33ba-4d4f-bb98-37637e5798e2 req-481f9a6c-48c5-4fef-950f-5bd6fa26be83 tempest-TestMinimumBasicScenario-1450520566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.058s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:59:43 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-39330826-33ba-4d4f-bb98-37637e5798e2 req-481f9a6c-48c5-4fef-950f-5bd6fa26be83 tempest-TestMinimumBasicScenario-1450520566 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a', 'name': 'volume-cc69fb22-62b7-4d6b-9530-7dbb33fe1b74', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a7e3e9f1-613d-4f8c-8532-4171d6e3408a', 'enforce_multipath': True} {{(pid=87314) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 17:59:43 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-39330826-33ba-4d4f-bb98-37637e5798e2 req-481f9a6c-48c5-4fef-950f-5bd6fa26be83 tempest-TestMinimumBasicScenario-1450520566 None] attachment_update completed successfully. Sep 04 17:59:46 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-c296e971-d8c0-4d40-856b-af75b477a8bb tempest-VolumesTransfersV355Test-1003352914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:59:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c296e971-d8c0-4d40-856b-af75b477a8bb tempest-VolumesTransfersV355Test-1003352914 None] Flow 'volume_create_manager' (f1ef3abf-34a6-41e6-8758-d81e050be1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:59:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c296e971-d8c0-4d40-856b-af75b477a8bb tempest-VolumesTransfersV355Test-1003352914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b61ce5dd-9c1c-420b-9aaa-5dfefbe50c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:59:46 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a523d438-8237-409f-926e-f3aa8135508f tempest-VolumesActionsTest-1660328580 None] Acquiring lock "cinder-a0c12227-25e5-4bff-8312-c8f4c6baf37c" by "attach_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:59:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c296e971-d8c0-4d40-856b-af75b477a8bb tempest-VolumesTransfersV355Test-1003352914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b61ce5dd-9c1c-420b-9aaa-5dfefbe50c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:59:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-356361202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b3a9a1c-45dd-4943-a1d0-de7e00b8e00b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b82cffd32b4d422d81942156fe577150',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:59:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:59:46Z,use_quota=True,user_id='16c6bd487aa94e9592be70a1047f9d36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:59:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c296e971-d8c0-4d40-856b-af75b477a8bb tempest-VolumesTransfersV355Test-1003352914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dc0d6c9-0761-4672-9158-bccb07ba418c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:59:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c296e971-d8c0-4d40-856b-af75b477a8bb tempest-VolumesTransfersV355Test-1003352914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dc0d6c9-0761-4672-9158-bccb07ba418c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:59:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c296e971-d8c0-4d40-856b-af75b477a8bb tempest-VolumesTransfersV355Test-1003352914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f418721f-29d6-49f9-86c1-a6dbf7358bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:59:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c296e971-d8c0-4d40-856b-af75b477a8bb tempest-VolumesTransfersV355Test-1003352914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f418721f-29d6-49f9-86c1-a6dbf7358bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b3a9a1c-45dd-4943-a1d0-de7e00b8e00b', 'volume_name': 'volume-5b3a9a1c-45dd-4943-a1d0-de7e00b8e00b', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:59:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c296e971-d8c0-4d40-856b-af75b477a8bb tempest-VolumesTransfersV355Test-1003352914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eb2c759-8799-4873-95c1-87f13198fd07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:59:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c296e971-d8c0-4d40-856b-af75b477a8bb tempest-VolumesTransfersV355Test-1003352914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eb2c759-8799-4873-95c1-87f13198fd07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:59:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c296e971-d8c0-4d40-856b-af75b477a8bb tempest-VolumesTransfersV355Test-1003352914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08807b34-41da-4667-817e-4cf8dba9a48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:59:46 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-c296e971-d8c0-4d40-856b-af75b477a8bb tempest-VolumesTransfersV355Test-1003352914 None] Volume 5b3a9a1c-45dd-4943-a1d0-de7e00b8e00b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b3a9a1c-45dd-4943-a1d0-de7e00b8e00b', 'volume_size': 1} Sep 04 17:59:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c296e971-d8c0-4d40-856b-af75b477a8bb tempest-VolumesTransfersV355Test-1003352914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:59:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c296e971-d8c0-4d40-856b-af75b477a8bb tempest-VolumesTransfersV355Test-1003352914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:59:46 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c296e971-d8c0-4d40-856b-af75b477a8bb tempest-VolumesTransfersV355Test-1003352914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:59:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-356361202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b3a9a1c-45dd-4943-a1d0-de7e00b8e00b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b82cffd32b4d422d81942156fe577150',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:59:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:59:46Z,use_quota=True,user_id='16c6bd487aa94e9592be70a1047f9d36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:59:46 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-c296e971-d8c0-4d40-856b-af75b477a8bb tempest-VolumesTransfersV355Test-1003352914 None] Creating volume 5b3a9a1c-45dd-4943-a1d0-de7e00b8e00b {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:59:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c296e971-d8c0-4d40-856b-af75b477a8bb tempest-VolumesTransfersV355Test-1003352914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:59:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c296e971-d8c0-4d40-856b-af75b477a8bb tempest-VolumesTransfersV355Test-1003352914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:59:46 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c296e971-d8c0-4d40-856b-af75b477a8bb tempest-VolumesTransfersV355Test-1003352914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:59:46 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c296e971-d8c0-4d40-856b-af75b477a8bb tempest-VolumesTransfersV355Test-1003352914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:59:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c296e971-d8c0-4d40-856b-af75b477a8bb tempest-VolumesTransfersV355Test-1003352914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:59:46 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c296e971-d8c0-4d40-856b-af75b477a8bb tempest-VolumesTransfersV355Test-1003352914 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:59:46 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-c296e971-d8c0-4d40-856b-af75b477a8bb tempest-VolumesTransfersV355Test-1003352914 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:59:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c296e971-d8c0-4d40-856b-af75b477a8bb tempest-VolumesTransfersV355Test-1003352914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5b3a9a1c-45dd-4943-a1d0-de7e00b8e00b 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:59:46 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a523d438-8237-409f-926e-f3aa8135508f tempest-VolumesActionsTest-1660328580 None] Lock "cinder-a0c12227-25e5-4bff-8312-c8f4c6baf37c" acquired by "attach_volume" :: waited 0.161s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:59:46 devstack sudo[99625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5b3a9a1c-45dd-4943-a1d0-de7e00b8e00b 1073741824 Sep 04 17:59:46 devstack sudo[99625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:59:46 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-a523d438-8237-409f-926e-f3aa8135508f tempest-VolumesActionsTest-1660328580 None] Attaching volume a0c12227-25e5-4bff-8312-c8f4c6baf37c to instance 1af4a333-de5f-48f4-a75c-35307191e599 at mountpoint /dev/vdb on host None. Sep 04 17:59:46 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-a523d438-8237-409f-926e-f3aa8135508f tempest-VolumesActionsTest-1660328580 None] Attach volume completed successfully. Sep 04 17:59:46 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a523d438-8237-409f-926e-f3aa8135508f tempest-VolumesActionsTest-1660328580 None] Lock "cinder-a0c12227-25e5-4bff-8312-c8f4c6baf37c" released by "attach_volume" :: held 0.194s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:59:46 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-851b4f86-16f8-426f-b608-2ec39e834b81 tempest-VolumesActionsTest-1660328580 None] Acquiring lock "cinder-a0c12227-25e5-4bff-8312-c8f4c6baf37c-detach_volume" by "detach_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:59:46 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-851b4f86-16f8-426f-b608-2ec39e834b81 tempest-VolumesActionsTest-1660328580 None] Lock "cinder-a0c12227-25e5-4bff-8312-c8f4c6baf37c-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:59:46 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-851b4f86-16f8-426f-b608-2ec39e834b81 tempest-VolumesActionsTest-1660328580 None] Detaching volume a0c12227-25e5-4bff-8312-c8f4c6baf37c from instance 1af4a333-de5f-48f4-a75c-35307191e599. Sep 04 17:59:46 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-851b4f86-16f8-426f-b608-2ec39e834b81 tempest-VolumesActionsTest-1660328580 None] Detach volume completed successfully. Sep 04 17:59:46 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-851b4f86-16f8-426f-b608-2ec39e834b81 tempest-VolumesActionsTest-1660328580 None] Lock "cinder-a0c12227-25e5-4bff-8312-c8f4c6baf37c-detach_volume" released by "detach_volume" :: held 0.124s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:59:47 devstack sudo[99625]: pam_unix(sudo:session): session closed for user root Sep 04 17:59:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c296e971-d8c0-4d40-856b-af75b477a8bb tempest-VolumesTransfersV355Test-1003352914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5b3a9a1c-45dd-4943-a1d0-de7e00b8e00b 1073741824" returned: 0 in 0.819s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:59:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c296e971-d8c0-4d40-856b-af75b477a8bb tempest-VolumesTransfersV355Test-1003352914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5b3a9a1c-45dd-4943-a1d0-de7e00b8e00b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:59:47 devstack sudo[99630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5b3a9a1c-45dd-4943-a1d0-de7e00b8e00b Sep 04 17:59:47 devstack sudo[99630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:59:47 devstack sudo[99630]: pam_unix(sudo:session): session closed for user root Sep 04 17:59:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c296e971-d8c0-4d40-856b-af75b477a8bb tempest-VolumesTransfersV355Test-1003352914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5b3a9a1c-45dd-4943-a1d0-de7e00b8e00b" returned: 0 in 0.417s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:59:47 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c296e971-d8c0-4d40-856b-af75b477a8bb tempest-VolumesTransfersV355Test-1003352914 None] <== create_volume: return (1301ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:59:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c296e971-d8c0-4d40-856b-af75b477a8bb tempest-VolumesTransfersV355Test-1003352914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.305s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:59:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c296e971-d8c0-4d40-856b-af75b477a8bb tempest-VolumesTransfersV355Test-1003352914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08807b34-41da-4667-817e-4cf8dba9a48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b3a9a1c-45dd-4943-a1d0-de7e00b8e00b', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:59:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c296e971-d8c0-4d40-856b-af75b477a8bb tempest-VolumesTransfersV355Test-1003352914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9eb8d30-c97a-4b1a-a677-06093f58b5e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:59:47 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-c296e971-d8c0-4d40-856b-af75b477a8bb tempest-VolumesTransfersV355Test-1003352914 None] Volume volume-5b3a9a1c-45dd-4943-a1d0-de7e00b8e00b (5b3a9a1c-45dd-4943-a1d0-de7e00b8e00b): created successfully Sep 04 17:59:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c296e971-d8c0-4d40-856b-af75b477a8bb tempest-VolumesTransfersV355Test-1003352914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9eb8d30-c97a-4b1a-a677-06093f58b5e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:59:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c296e971-d8c0-4d40-856b-af75b477a8bb tempest-VolumesTransfersV355Test-1003352914 None] Flow 'volume_create_manager' (f1ef3abf-34a6-41e6-8758-d81e050be1a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:59:47 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-c296e971-d8c0-4d40-856b-af75b477a8bb tempest-VolumesTransfersV355Test-1003352914 None] Created volume successfully. Sep 04 17:59:49 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-436ffe2b-8b81-421b-8ae0-15d04f51acf2 tempest-VolumesTransfersV355Test-1691952831 None] Transfer volume completed successfully. Sep 04 17:59:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7a9c580b-f22f-4e67-a46a-1d3d7c558ab0 tempest-VolumesTransfersV355Test-1813897106 None] Acquiring lock "cinder-5b3a9a1c-45dd-4943-a1d0-de7e00b8e00b-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:59:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7a9c580b-f22f-4e67-a46a-1d3d7c558ab0 tempest-VolumesTransfersV355Test-1813897106 None] Lock "cinder-5b3a9a1c-45dd-4943-a1d0-de7e00b8e00b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:59:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7a9c580b-f22f-4e67-a46a-1d3d7c558ab0 tempest-VolumesTransfersV355Test-1813897106 None] Acquiring lock "cinder-quobyte-5b3a9a1c-45dd-4943-a1d0-de7e00b8e00b" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:59:50 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7a9c580b-f22f-4e67-a46a-1d3d7c558ab0 tempest-VolumesTransfersV355Test-1813897106 None] Lock "cinder-quobyte-5b3a9a1c-45dd-4943-a1d0-de7e00b8e00b" acquired by "delete_volume" :: waited 0.028s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:59:50 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[432677af-5773-4716-b6c1-a0eda712ade9]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:59:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7a9c580b-f22f-4e67-a46a-1d3d7c558ab0 tempest-VolumesTransfersV355Test-1813897106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5b3a9a1c-45dd-4943-a1d0-de7e00b8e00b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:59:50 devstack sudo[99691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5b3a9a1c-45dd-4943-a1d0-de7e00b8e00b Sep 04 17:59:50 devstack sudo[99691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:59:50 devstack sudo[99691]: pam_unix(sudo:session): session closed for user root Sep 04 17:59:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7a9c580b-f22f-4e67-a46a-1d3d7c558ab0 tempest-VolumesTransfersV355Test-1813897106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5b3a9a1c-45dd-4943-a1d0-de7e00b8e00b" returned: 0 in 0.412s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:59:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7a9c580b-f22f-4e67-a46a-1d3d7c558ab0 tempest-VolumesTransfersV355Test-1813897106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5b3a9a1c-45dd-4943-a1d0-de7e00b8e00b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:59:50 devstack sudo[99697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5b3a9a1c-45dd-4943-a1d0-de7e00b8e00b Sep 04 17:59:50 devstack sudo[99697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:59:50 devstack sudo[99697]: pam_unix(sudo:session): session closed for user root Sep 04 17:59:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7a9c580b-f22f-4e67-a46a-1d3d7c558ab0 tempest-VolumesTransfersV355Test-1813897106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5b3a9a1c-45dd-4943-a1d0-de7e00b8e00b" returned: 0 in 0.411s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:59:50 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7a9c580b-f22f-4e67-a46a-1d3d7c558ab0 tempest-VolumesTransfersV355Test-1813897106 None] Lock "cinder-quobyte-5b3a9a1c-45dd-4943-a1d0-de7e00b8e00b" released by "delete_volume" :: held 0.888s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:59:50 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-7a9c580b-f22f-4e67-a46a-1d3d7c558ab0 tempest-VolumesTransfersV355Test-1813897106 None] Created reservations ['c5032a97-c81b-48b5-a007-3e21a83a7755', '447dc270-0bdc-435d-894c-96e993aa01b9', '2c26f191-251c-466c-974c-21e738ad1293', 'a774b9e5-36b5-4768-8275-a5ad1011dd79'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:59:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7a9c580b-f22f-4e67-a46a-1d3d7c558ab0 tempest-VolumesTransfersV355Test-1813897106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:59:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7a9c580b-f22f-4e67-a46a-1d3d7c558ab0 tempest-VolumesTransfersV355Test-1813897106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:59:51 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7a9c580b-f22f-4e67-a46a-1d3d7c558ab0 tempest-VolumesTransfersV355Test-1813897106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:59:51 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7a9c580b-f22f-4e67-a46a-1d3d7c558ab0 tempest-VolumesTransfersV355Test-1813897106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:59:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7a9c580b-f22f-4e67-a46a-1d3d7c558ab0 tempest-VolumesTransfersV355Test-1813897106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:59:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7a9c580b-f22f-4e67-a46a-1d3d7c558ab0 tempest-VolumesTransfersV355Test-1813897106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:59:51 devstack sudo[99700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:59:51 devstack sudo[99700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:59:51 devstack sudo[99700]: pam_unix(sudo:session): session closed for user root Sep 04 17:59:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7a9c580b-f22f-4e67-a46a-1d3d7c558ab0 tempest-VolumesTransfersV355Test-1813897106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.348s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:59:51 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-7a9c580b-f22f-4e67-a46a-1d3d7c558ab0 tempest-VolumesTransfersV355Test-1813897106 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:59:51 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-7a9c580b-f22f-4e67-a46a-1d3d7c558ab0 tempest-VolumesTransfersV355Test-1813897106 None] Deleted volume successfully. Sep 04 17:59:51 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7a9c580b-f22f-4e67-a46a-1d3d7c558ab0 tempest-VolumesTransfersV355Test-1813897106 None] Lock "cinder-5b3a9a1c-45dd-4943-a1d0-de7e00b8e00b-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:59:51 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4e4abb7-fca0-4a84-821b-48634538e400 tempest-VolumesTransfersV355Test-1003352914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 17:59:51 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d4e4abb7-fca0-4a84-821b-48634538e400 tempest-VolumesTransfersV355Test-1003352914 None] Flow 'volume_create_manager' (7d2f38af-0cee-4f57-8440-b76d3ca4c77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:59:51 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d4e4abb7-fca0-4a84-821b-48634538e400 tempest-VolumesTransfersV355Test-1003352914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06c340da-12af-4e2d-9c23-2c8a723405ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:59:51 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d4e4abb7-fca0-4a84-821b-48634538e400 tempest-VolumesTransfersV355Test-1003352914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06c340da-12af-4e2d-9c23-2c8a723405ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:59:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-473666641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ae99b51-ee01-4240-8d7c-094db3159218,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b82cffd32b4d422d81942156fe577150',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:59:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:59:52Z,use_quota=True,user_id='16c6bd487aa94e9592be70a1047f9d36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:59:51 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d4e4abb7-fca0-4a84-821b-48634538e400 tempest-VolumesTransfersV355Test-1003352914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (659e750a-9f83-41a0-8102-f7166fb9d424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:59:51 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d4e4abb7-fca0-4a84-821b-48634538e400 tempest-VolumesTransfersV355Test-1003352914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (659e750a-9f83-41a0-8102-f7166fb9d424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:59:51 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d4e4abb7-fca0-4a84-821b-48634538e400 tempest-VolumesTransfersV355Test-1003352914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a97c3de0-5b95-411b-a932-756758795842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:59:51 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d4e4abb7-fca0-4a84-821b-48634538e400 tempest-VolumesTransfersV355Test-1003352914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a97c3de0-5b95-411b-a932-756758795842) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ae99b51-ee01-4240-8d7c-094db3159218', 'volume_name': 'volume-1ae99b51-ee01-4240-8d7c-094db3159218', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:59:51 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d4e4abb7-fca0-4a84-821b-48634538e400 tempest-VolumesTransfersV355Test-1003352914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb6aa508-8279-4a65-95bb-0a728f0737b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:59:51 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d4e4abb7-fca0-4a84-821b-48634538e400 tempest-VolumesTransfersV355Test-1003352914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb6aa508-8279-4a65-95bb-0a728f0737b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:59:51 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d4e4abb7-fca0-4a84-821b-48634538e400 tempest-VolumesTransfersV355Test-1003352914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42410227-5452-469a-ba34-c65e61e1a802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:59:51 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-d4e4abb7-fca0-4a84-821b-48634538e400 tempest-VolumesTransfersV355Test-1003352914 None] Volume 1ae99b51-ee01-4240-8d7c-094db3159218: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ae99b51-ee01-4240-8d7c-094db3159218', 'volume_size': 1} Sep 04 17:59:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d4e4abb7-fca0-4a84-821b-48634538e400 tempest-VolumesTransfersV355Test-1003352914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:59:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d4e4abb7-fca0-4a84-821b-48634538e400 tempest-VolumesTransfersV355Test-1003352914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:59:51 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d4e4abb7-fca0-4a84-821b-48634538e400 tempest-VolumesTransfersV355Test-1003352914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T15:59:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-473666641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ae99b51-ee01-4240-8d7c-094db3159218,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b82cffd32b4d422d81942156fe577150',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T15:59:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T15:59:52Z,use_quota=True,user_id='16c6bd487aa94e9592be70a1047f9d36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 17:59:51 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-d4e4abb7-fca0-4a84-821b-48634538e400 tempest-VolumesTransfersV355Test-1003352914 None] Creating volume 1ae99b51-ee01-4240-8d7c-094db3159218 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 17:59:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d4e4abb7-fca0-4a84-821b-48634538e400 tempest-VolumesTransfersV355Test-1003352914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:59:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d4e4abb7-fca0-4a84-821b-48634538e400 tempest-VolumesTransfersV355Test-1003352914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:59:51 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d4e4abb7-fca0-4a84-821b-48634538e400 tempest-VolumesTransfersV355Test-1003352914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:59:51 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d4e4abb7-fca0-4a84-821b-48634538e400 tempest-VolumesTransfersV355Test-1003352914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:59:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d4e4abb7-fca0-4a84-821b-48634538e400 tempest-VolumesTransfersV355Test-1003352914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:59:51 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d4e4abb7-fca0-4a84-821b-48634538e400 tempest-VolumesTransfersV355Test-1003352914 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 17:59:51 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-d4e4abb7-fca0-4a84-821b-48634538e400 tempest-VolumesTransfersV355Test-1003352914 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 17:59:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d4e4abb7-fca0-4a84-821b-48634538e400 tempest-VolumesTransfersV355Test-1003352914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1ae99b51-ee01-4240-8d7c-094db3159218 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:59:51 devstack sudo[99706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1ae99b51-ee01-4240-8d7c-094db3159218 1073741824 Sep 04 17:59:51 devstack sudo[99706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:59:52 devstack sudo[99706]: pam_unix(sudo:session): session closed for user root Sep 04 17:59:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d4e4abb7-fca0-4a84-821b-48634538e400 tempest-VolumesTransfersV355Test-1003352914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1ae99b51-ee01-4240-8d7c-094db3159218 1073741824" returned: 0 in 0.523s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:59:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d4e4abb7-fca0-4a84-821b-48634538e400 tempest-VolumesTransfersV355Test-1003352914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1ae99b51-ee01-4240-8d7c-094db3159218 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:59:52 devstack sudo[99712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1ae99b51-ee01-4240-8d7c-094db3159218 Sep 04 17:59:52 devstack sudo[99712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:59:52 devstack sudo[99712]: pam_unix(sudo:session): session closed for user root Sep 04 17:59:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d4e4abb7-fca0-4a84-821b-48634538e400 tempest-VolumesTransfersV355Test-1003352914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1ae99b51-ee01-4240-8d7c-094db3159218" returned: 0 in 0.358s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:59:52 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d4e4abb7-fca0-4a84-821b-48634538e400 tempest-VolumesTransfersV355Test-1003352914 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 17:59:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d4e4abb7-fca0-4a84-821b-48634538e400 tempest-VolumesTransfersV355Test-1003352914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:59:52 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d4e4abb7-fca0-4a84-821b-48634538e400 tempest-VolumesTransfersV355Test-1003352914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42410227-5452-469a-ba34-c65e61e1a802) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ae99b51-ee01-4240-8d7c-094db3159218', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:59:52 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d4e4abb7-fca0-4a84-821b-48634538e400 tempest-VolumesTransfersV355Test-1003352914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12f7027b-c879-484b-8bbc-fe2976c16fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 17:59:52 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-d4e4abb7-fca0-4a84-821b-48634538e400 tempest-VolumesTransfersV355Test-1003352914 None] Volume volume-1ae99b51-ee01-4240-8d7c-094db3159218 (1ae99b51-ee01-4240-8d7c-094db3159218): created successfully Sep 04 17:59:52 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d4e4abb7-fca0-4a84-821b-48634538e400 tempest-VolumesTransfersV355Test-1003352914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12f7027b-c879-484b-8bbc-fe2976c16fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 17:59:52 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d4e4abb7-fca0-4a84-821b-48634538e400 tempest-VolumesTransfersV355Test-1003352914 None] Flow 'volume_create_manager' (7d2f38af-0cee-4f57-8440-b76d3ca4c77b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 17:59:52 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-d4e4abb7-fca0-4a84-821b-48634538e400 tempest-VolumesTransfersV355Test-1003352914 None] Created volume successfully. Sep 04 17:59:54 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ee89ea14-e8cd-4841-8562-41b636cda908 tempest-VolumesTransfersV355Test-1813897106 None] Acquiring lock "cinder-1ae99b51-ee01-4240-8d7c-094db3159218-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:59:54 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ee89ea14-e8cd-4841-8562-41b636cda908 tempest-VolumesTransfersV355Test-1813897106 None] Lock "cinder-1ae99b51-ee01-4240-8d7c-094db3159218-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:59:54 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ee89ea14-e8cd-4841-8562-41b636cda908 tempest-VolumesTransfersV355Test-1813897106 None] Acquiring lock "cinder-quobyte-1ae99b51-ee01-4240-8d7c-094db3159218" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 17:59:54 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ee89ea14-e8cd-4841-8562-41b636cda908 tempest-VolumesTransfersV355Test-1813897106 None] Lock "cinder-quobyte-1ae99b51-ee01-4240-8d7c-094db3159218" acquired by "delete_volume" :: waited 0.026s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 17:59:54 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a11d19-c96a-4531-b6f8-8979691ee563]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 17:59:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ee89ea14-e8cd-4841-8562-41b636cda908 tempest-VolumesTransfersV355Test-1813897106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1ae99b51-ee01-4240-8d7c-094db3159218 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:59:54 devstack sudo[99732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1ae99b51-ee01-4240-8d7c-094db3159218 Sep 04 17:59:54 devstack sudo[99732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:59:55 devstack sudo[99732]: pam_unix(sudo:session): session closed for user root Sep 04 17:59:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ee89ea14-e8cd-4841-8562-41b636cda908 tempest-VolumesTransfersV355Test-1813897106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1ae99b51-ee01-4240-8d7c-094db3159218" returned: 0 in 0.439s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:59:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ee89ea14-e8cd-4841-8562-41b636cda908 tempest-VolumesTransfersV355Test-1813897106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1ae99b51-ee01-4240-8d7c-094db3159218 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:59:55 devstack sudo[99738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1ae99b51-ee01-4240-8d7c-094db3159218 Sep 04 17:59:55 devstack sudo[99738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:59:55 devstack sudo[99738]: pam_unix(sudo:session): session closed for user root Sep 04 17:59:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ee89ea14-e8cd-4841-8562-41b636cda908 tempest-VolumesTransfersV355Test-1813897106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1ae99b51-ee01-4240-8d7c-094db3159218" returned: 0 in 0.335s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:59:55 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ee89ea14-e8cd-4841-8562-41b636cda908 tempest-VolumesTransfersV355Test-1813897106 None] Lock "cinder-quobyte-1ae99b51-ee01-4240-8d7c-094db3159218" released by "delete_volume" :: held 0.833s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 17:59:55 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-ee89ea14-e8cd-4841-8562-41b636cda908 tempest-VolumesTransfersV355Test-1813897106 None] Created reservations ['651d754c-6de0-4e28-b4bb-6d0a44c41f69', '2a41d108-d785-445b-95aa-094be0156315', '6e6d66b0-a51d-4a7d-ae07-19dab0ccd677', '4cd22006-f85f-4ca7-844e-ca11d0cde1f5'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 17:59:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ee89ea14-e8cd-4841-8562-41b636cda908 tempest-VolumesTransfersV355Test-1813897106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 17:59:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ee89ea14-e8cd-4841-8562-41b636cda908 tempest-VolumesTransfersV355Test-1813897106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 17:59:55 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ee89ea14-e8cd-4841-8562-41b636cda908 tempest-VolumesTransfersV355Test-1813897106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 17:59:55 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ee89ea14-e8cd-4841-8562-41b636cda908 tempest-VolumesTransfersV355Test-1813897106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 17:59:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ee89ea14-e8cd-4841-8562-41b636cda908 tempest-VolumesTransfersV355Test-1813897106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 17:59:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ee89ea14-e8cd-4841-8562-41b636cda908 tempest-VolumesTransfersV355Test-1813897106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 17:59:55 devstack sudo[99741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 17:59:55 devstack sudo[99741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 17:59:56 devstack sudo[99741]: pam_unix(sudo:session): session closed for user root Sep 04 17:59:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ee89ea14-e8cd-4841-8562-41b636cda908 tempest-VolumesTransfersV355Test-1813897106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.461s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 17:59:56 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-ee89ea14-e8cd-4841-8562-41b636cda908 tempest-VolumesTransfersV355Test-1813897106 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 17:59:56 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-ee89ea14-e8cd-4841-8562-41b636cda908 tempest-VolumesTransfersV355Test-1813897106 None] Deleted volume successfully. Sep 04 17:59:56 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ee89ea14-e8cd-4841-8562-41b636cda908 tempest-VolumesTransfersV355Test-1813897106 None] Lock "cinder-1ae99b51-ee01-4240-8d7c-094db3159218-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:00:00 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e7c0eba7-1f68-4437-ad97-7a6af5b5e835 tempest-VolumesActionsTest-1660328580 None] Acquiring lock "cinder-a0c12227-25e5-4bff-8312-c8f4c6baf37c" by "attach_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:00:00 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e7c0eba7-1f68-4437-ad97-7a6af5b5e835 tempest-VolumesActionsTest-1660328580 None] Lock "cinder-a0c12227-25e5-4bff-8312-c8f4c6baf37c" acquired by "attach_volume" :: waited 0.025s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:00:00 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-e7c0eba7-1f68-4437-ad97-7a6af5b5e835 tempest-VolumesActionsTest-1660328580 None] Attaching volume a0c12227-25e5-4bff-8312-c8f4c6baf37c to instance 9c2b5d9d-fc83-4d12-83af-6ad28e776c9b at mountpoint /dev/vdb on host None. Sep 04 18:00:00 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-e7c0eba7-1f68-4437-ad97-7a6af5b5e835 tempest-VolumesActionsTest-1660328580 None] Attach volume completed successfully. Sep 04 18:00:00 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e7c0eba7-1f68-4437-ad97-7a6af5b5e835 tempest-VolumesActionsTest-1660328580 None] Lock "cinder-a0c12227-25e5-4bff-8312-c8f4c6baf37c" released by "attach_volume" :: held 0.165s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:00:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4a9a2951-357d-492f-81a2-f8522ce755e3 tempest-VolumesActionsTest-1660328580 None] Acquiring lock "cinder-a0c12227-25e5-4bff-8312-c8f4c6baf37c-detach_volume" by "detach_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:00:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4a9a2951-357d-492f-81a2-f8522ce755e3 tempest-VolumesActionsTest-1660328580 None] Lock "cinder-a0c12227-25e5-4bff-8312-c8f4c6baf37c-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:00:01 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-4a9a2951-357d-492f-81a2-f8522ce755e3 tempest-VolumesActionsTest-1660328580 None] Detaching volume a0c12227-25e5-4bff-8312-c8f4c6baf37c from instance 9c2b5d9d-fc83-4d12-83af-6ad28e776c9b. Sep 04 18:00:01 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-4a9a2951-357d-492f-81a2-f8522ce755e3 tempest-VolumesActionsTest-1660328580 None] Detach volume completed successfully. Sep 04 18:00:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4a9a2951-357d-492f-81a2-f8522ce755e3 tempest-VolumesActionsTest-1660328580 None] Lock "cinder-a0c12227-25e5-4bff-8312-c8f4c6baf37c-detach_volume" released by "detach_volume" :: held 0.087s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:00:06 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-639c318e-4c1b-45dc-b0c5-dbe3e888be98 tempest-VolumesTransfersV357Test-609279018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:00:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-639c318e-4c1b-45dc-b0c5-dbe3e888be98 tempest-VolumesTransfersV357Test-609279018 None] Flow 'volume_create_manager' (45adc9d5-32d3-48be-a1f0-d3f4ab401906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:00:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-639c318e-4c1b-45dc-b0c5-dbe3e888be98 tempest-VolumesTransfersV357Test-609279018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c73bede3-8d21-496a-b034-013a00f2ee34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:00:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-639c318e-4c1b-45dc-b0c5-dbe3e888be98 tempest-VolumesTransfersV357Test-609279018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c73bede3-8d21-496a-b034-013a00f2ee34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:00:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-273829295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da41dfd7-126c-4934-a1ca-703b878f457c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3c721da41d246cab094a614b828a87d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:00:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:00:06Z,use_quota=True,user_id='7548bf3161624de5bbc229f064526229',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:00:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-639c318e-4c1b-45dc-b0c5-dbe3e888be98 tempest-VolumesTransfersV357Test-609279018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d30b4ae-0f7b-4abb-8ac4-7812f811d333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:00:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-639c318e-4c1b-45dc-b0c5-dbe3e888be98 tempest-VolumesTransfersV357Test-609279018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d30b4ae-0f7b-4abb-8ac4-7812f811d333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:00:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-639c318e-4c1b-45dc-b0c5-dbe3e888be98 tempest-VolumesTransfersV357Test-609279018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6256b89-20bf-40bb-ad8e-4452cb8fac5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:00:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-639c318e-4c1b-45dc-b0c5-dbe3e888be98 tempest-VolumesTransfersV357Test-609279018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6256b89-20bf-40bb-ad8e-4452cb8fac5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da41dfd7-126c-4934-a1ca-703b878f457c', 'volume_name': 'volume-da41dfd7-126c-4934-a1ca-703b878f457c', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:00:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-639c318e-4c1b-45dc-b0c5-dbe3e888be98 tempest-VolumesTransfersV357Test-609279018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e47c8335-d41b-4d41-b4f8-fe18fd60a0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:00:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-639c318e-4c1b-45dc-b0c5-dbe3e888be98 tempest-VolumesTransfersV357Test-609279018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e47c8335-d41b-4d41-b4f8-fe18fd60a0c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:00:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-639c318e-4c1b-45dc-b0c5-dbe3e888be98 tempest-VolumesTransfersV357Test-609279018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a74856d0-8082-477a-a182-fb81028faacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:00:06 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-639c318e-4c1b-45dc-b0c5-dbe3e888be98 tempest-VolumesTransfersV357Test-609279018 None] Volume da41dfd7-126c-4934-a1ca-703b878f457c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da41dfd7-126c-4934-a1ca-703b878f457c', 'volume_size': 1} Sep 04 18:00:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-639c318e-4c1b-45dc-b0c5-dbe3e888be98 tempest-VolumesTransfersV357Test-609279018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:00:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-639c318e-4c1b-45dc-b0c5-dbe3e888be98 tempest-VolumesTransfersV357Test-609279018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:00:06 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-639c318e-4c1b-45dc-b0c5-dbe3e888be98 tempest-VolumesTransfersV357Test-609279018 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:00:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-273829295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da41dfd7-126c-4934-a1ca-703b878f457c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3c721da41d246cab094a614b828a87d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:00:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:00:06Z,use_quota=True,user_id='7548bf3161624de5bbc229f064526229',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:00:06 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-639c318e-4c1b-45dc-b0c5-dbe3e888be98 tempest-VolumesTransfersV357Test-609279018 None] Creating volume da41dfd7-126c-4934-a1ca-703b878f457c {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:00:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-639c318e-4c1b-45dc-b0c5-dbe3e888be98 tempest-VolumesTransfersV357Test-609279018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:00:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-639c318e-4c1b-45dc-b0c5-dbe3e888be98 tempest-VolumesTransfersV357Test-609279018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:00:06 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-639c318e-4c1b-45dc-b0c5-dbe3e888be98 tempest-VolumesTransfersV357Test-609279018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:00:06 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-639c318e-4c1b-45dc-b0c5-dbe3e888be98 tempest-VolumesTransfersV357Test-609279018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:00:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-639c318e-4c1b-45dc-b0c5-dbe3e888be98 tempest-VolumesTransfersV357Test-609279018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:00:06 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-639c318e-4c1b-45dc-b0c5-dbe3e888be98 tempest-VolumesTransfersV357Test-609279018 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:00:06 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-639c318e-4c1b-45dc-b0c5-dbe3e888be98 tempest-VolumesTransfersV357Test-609279018 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:00:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-639c318e-4c1b-45dc-b0c5-dbe3e888be98 tempest-VolumesTransfersV357Test-609279018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-da41dfd7-126c-4934-a1ca-703b878f457c 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:00:06 devstack sudo[99905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-da41dfd7-126c-4934-a1ca-703b878f457c 1073741824 Sep 04 18:00:06 devstack sudo[99905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:00:06 devstack sudo[99905]: pam_unix(sudo:session): session closed for user root Sep 04 18:00:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-639c318e-4c1b-45dc-b0c5-dbe3e888be98 tempest-VolumesTransfersV357Test-609279018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-da41dfd7-126c-4934-a1ca-703b878f457c 1073741824" returned: 0 in 0.620s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:00:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-12e633aa-d9b8-43d1-97e5-91b0c899eb16 tempest-VolumesActionsTest-1660328580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:00:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-639c318e-4c1b-45dc-b0c5-dbe3e888be98 tempest-VolumesTransfersV357Test-609279018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-da41dfd7-126c-4934-a1ca-703b878f457c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:00:06 devstack sudo[99911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-da41dfd7-126c-4934-a1ca-703b878f457c Sep 04 18:00:06 devstack sudo[99911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:00:07 devstack sudo[99911]: pam_unix(sudo:session): session closed for user root Sep 04 18:00:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-639c318e-4c1b-45dc-b0c5-dbe3e888be98 tempest-VolumesTransfersV357Test-609279018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-da41dfd7-126c-4934-a1ca-703b878f457c" returned: 0 in 0.276s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:00:07 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-639c318e-4c1b-45dc-b0c5-dbe3e888be98 tempest-VolumesTransfersV357Test-609279018 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:00:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-639c318e-4c1b-45dc-b0c5-dbe3e888be98 tempest-VolumesTransfersV357Test-609279018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:00:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-12e633aa-d9b8-43d1-97e5-91b0c899eb16 tempest-VolumesActionsTest-1660328580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.312s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:00:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-639c318e-4c1b-45dc-b0c5-dbe3e888be98 tempest-VolumesTransfersV357Test-609279018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a74856d0-8082-477a-a182-fb81028faacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da41dfd7-126c-4934-a1ca-703b878f457c', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:00:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-639c318e-4c1b-45dc-b0c5-dbe3e888be98 tempest-VolumesTransfersV357Test-609279018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44ccb030-0476-4569-9695-2c1c89e88cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:00:07 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b555f8-4c76-4c88-a8ec-bf6027306d30]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:00:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-12e633aa-d9b8-43d1-97e5-91b0c899eb16 tempest-VolumesActionsTest-1660328580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0c12227-25e5-4bff-8312-c8f4c6baf37c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:00:07 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-639c318e-4c1b-45dc-b0c5-dbe3e888be98 tempest-VolumesTransfersV357Test-609279018 None] Volume volume-da41dfd7-126c-4934-a1ca-703b878f457c (da41dfd7-126c-4934-a1ca-703b878f457c): created successfully Sep 04 18:00:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-639c318e-4c1b-45dc-b0c5-dbe3e888be98 tempest-VolumesTransfersV357Test-609279018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44ccb030-0476-4569-9695-2c1c89e88cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:00:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-639c318e-4c1b-45dc-b0c5-dbe3e888be98 tempest-VolumesTransfersV357Test-609279018 None] Flow 'volume_create_manager' (45adc9d5-32d3-48be-a1f0-d3f4ab401906) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:00:07 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-639c318e-4c1b-45dc-b0c5-dbe3e888be98 tempest-VolumesTransfersV357Test-609279018 None] Created volume successfully. Sep 04 18:00:07 devstack sudo[99915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0c12227-25e5-4bff-8312-c8f4c6baf37c Sep 04 18:00:07 devstack sudo[99915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:00:07 devstack sudo[99915]: pam_unix(sudo:session): session closed for user root Sep 04 18:00:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-12e633aa-d9b8-43d1-97e5-91b0c899eb16 tempest-VolumesActionsTest-1660328580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0c12227-25e5-4bff-8312-c8f4c6baf37c" returned: 0 in 0.458s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:00:07 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c0d849-4ca4-4cbd-b77e-f8102edbbfee]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:00:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-12e633aa-d9b8-43d1-97e5-91b0c899eb16 tempest-VolumesActionsTest-1660328580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0c12227-25e5-4bff-8312-c8f4c6baf37c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:00:07 devstack sudo[99927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0c12227-25e5-4bff-8312-c8f4c6baf37c Sep 04 18:00:07 devstack sudo[99927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:00:08 devstack sudo[99927]: pam_unix(sudo:session): session closed for user root Sep 04 18:00:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-12e633aa-d9b8-43d1-97e5-91b0c899eb16 tempest-VolumesActionsTest-1660328580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0c12227-25e5-4bff-8312-c8f4c6baf37c" returned: 0 in 0.431s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:00:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-12e633aa-d9b8-43d1-97e5-91b0c899eb16 tempest-VolumesActionsTest-1660328580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0c12227-25e5-4bff-8312-c8f4c6baf37c /opt/stack/data/cinder/conversion/a0c12227-25e5-4bff-8312-c8f4c6baf37c.temp_image.c4bd125f-a7c8-454a-a289-f9f84e87b74907iuxqdd.img {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:00:08 devstack sudo[99932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0c12227-25e5-4bff-8312-c8f4c6baf37c /opt/stack/data/cinder/conversion/a0c12227-25e5-4bff-8312-c8f4c6baf37c.temp_image.c4bd125f-a7c8-454a-a289-f9f84e87b74907iuxqdd.img Sep 04 18:00:08 devstack sudo[99932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:00:09 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-66820bbf-7d12-4a69-8d4a-291024e2842a tempest-VolumesTransfersV357Test-523958195 None] Transfer volume completed successfully. Sep 04 18:00:11 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c0b7bbd4-f0ef-43ee-b12b-d7db62ab20f9 tempest-VolumesTransfersV357Test-1028595556 None] Acquiring lock "cinder-da41dfd7-126c-4934-a1ca-703b878f457c-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:00:11 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c0b7bbd4-f0ef-43ee-b12b-d7db62ab20f9 tempest-VolumesTransfersV357Test-1028595556 None] Lock "cinder-da41dfd7-126c-4934-a1ca-703b878f457c-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:00:11 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c0b7bbd4-f0ef-43ee-b12b-d7db62ab20f9 tempest-VolumesTransfersV357Test-1028595556 None] Acquiring lock "cinder-quobyte-da41dfd7-126c-4934-a1ca-703b878f457c" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:00:11 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c0b7bbd4-f0ef-43ee-b12b-d7db62ab20f9 tempest-VolumesTransfersV357Test-1028595556 None] Lock "cinder-quobyte-da41dfd7-126c-4934-a1ca-703b878f457c" acquired by "delete_volume" :: waited 0.034s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:00:11 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f94309-5cab-43b7-85e4-203a48bcdb08]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:00:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c0b7bbd4-f0ef-43ee-b12b-d7db62ab20f9 tempest-VolumesTransfersV357Test-1028595556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-da41dfd7-126c-4934-a1ca-703b878f457c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:00:11 devstack sudo[99945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-da41dfd7-126c-4934-a1ca-703b878f457c Sep 04 18:00:11 devstack sudo[99945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:00:12 devstack sudo[99945]: pam_unix(sudo:session): session closed for user root Sep 04 18:00:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c0b7bbd4-f0ef-43ee-b12b-d7db62ab20f9 tempest-VolumesTransfersV357Test-1028595556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-da41dfd7-126c-4934-a1ca-703b878f457c" returned: 0 in 0.724s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:00:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c0b7bbd4-f0ef-43ee-b12b-d7db62ab20f9 tempest-VolumesTransfersV357Test-1028595556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-da41dfd7-126c-4934-a1ca-703b878f457c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:00:12 devstack sudo[99951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-da41dfd7-126c-4934-a1ca-703b878f457c Sep 04 18:00:12 devstack sudo[99951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:00:13 devstack sudo[99951]: pam_unix(sudo:session): session closed for user root Sep 04 18:00:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c0b7bbd4-f0ef-43ee-b12b-d7db62ab20f9 tempest-VolumesTransfersV357Test-1028595556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-da41dfd7-126c-4934-a1ca-703b878f457c" returned: 0 in 0.983s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:00:13 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c0b7bbd4-f0ef-43ee-b12b-d7db62ab20f9 tempest-VolumesTransfersV357Test-1028595556 None] Lock "cinder-quobyte-da41dfd7-126c-4934-a1ca-703b878f457c" released by "delete_volume" :: held 1.842s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:00:13 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-c0b7bbd4-f0ef-43ee-b12b-d7db62ab20f9 tempest-VolumesTransfersV357Test-1028595556 None] Created reservations ['79979760-2ea5-4308-8953-bb28c3a5821e', '605f3738-db2a-45d1-8006-e366850d59c8', 'decb2197-716a-432e-9968-7ee38a3f753d', '4c2ea52f-79e5-43fb-9865-71cee56fc9ea'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:00:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c0b7bbd4-f0ef-43ee-b12b-d7db62ab20f9 tempest-VolumesTransfersV357Test-1028595556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:00:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c0b7bbd4-f0ef-43ee-b12b-d7db62ab20f9 tempest-VolumesTransfersV357Test-1028595556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:00:13 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c0b7bbd4-f0ef-43ee-b12b-d7db62ab20f9 tempest-VolumesTransfersV357Test-1028595556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:00:13 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c0b7bbd4-f0ef-43ee-b12b-d7db62ab20f9 tempest-VolumesTransfersV357Test-1028595556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:00:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c0b7bbd4-f0ef-43ee-b12b-d7db62ab20f9 tempest-VolumesTransfersV357Test-1028595556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:00:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c0b7bbd4-f0ef-43ee-b12b-d7db62ab20f9 tempest-VolumesTransfersV357Test-1028595556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:00:13 devstack sudo[99955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:00:13 devstack sudo[99955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:00:14 devstack sudo[99955]: pam_unix(sudo:session): session closed for user root Sep 04 18:00:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c0b7bbd4-f0ef-43ee-b12b-d7db62ab20f9 tempest-VolumesTransfersV357Test-1028595556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.531s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:00:14 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-c0b7bbd4-f0ef-43ee-b12b-d7db62ab20f9 tempest-VolumesTransfersV357Test-1028595556 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:00:14 devstack sudo[99932]: pam_unix(sudo:session): session closed for user root Sep 04 18:00:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-12e633aa-d9b8-43d1-97e5-91b0c899eb16 tempest-VolumesActionsTest-1660328580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0c12227-25e5-4bff-8312-c8f4c6baf37c /opt/stack/data/cinder/conversion/a0c12227-25e5-4bff-8312-c8f4c6baf37c.temp_image.c4bd125f-a7c8-454a-a289-f9f84e87b74907iuxqdd.img" returned: 0 in 6.076s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:00:14 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef45b61-26aa-462e-b181-2bbc98eac42b]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:00:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-12e633aa-d9b8-43d1-97e5-91b0c899eb16 tempest-VolumesActionsTest-1660328580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0c12227-25e5-4bff-8312-c8f4c6baf37c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:00:14 devstack sudo[99958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0c12227-25e5-4bff-8312-c8f4c6baf37c Sep 04 18:00:14 devstack sudo[99958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:00:14 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-c0b7bbd4-f0ef-43ee-b12b-d7db62ab20f9 tempest-VolumesTransfersV357Test-1028595556 None] Deleted volume successfully. Sep 04 18:00:14 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c0b7bbd4-f0ef-43ee-b12b-d7db62ab20f9 tempest-VolumesTransfersV357Test-1028595556 None] Lock "cinder-da41dfd7-126c-4934-a1ca-703b878f457c-delete_volume" released by "delete_volume" :: held 3.198s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:00:14 devstack sudo[99958]: pam_unix(sudo:session): session closed for user root Sep 04 18:00:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-12e633aa-d9b8-43d1-97e5-91b0c899eb16 tempest-VolumesActionsTest-1660328580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0c12227-25e5-4bff-8312-c8f4c6baf37c" returned: 0 in 0.603s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:00:14 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-12e633aa-d9b8-43d1-97e5-91b0c899eb16 tempest-VolumesActionsTest-1660328580 None] Image conversion details: src /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0c12227-25e5-4bff-8312-c8f4c6baf37c, size 1024.00 MB, duration 6.08 sec, destination /opt/stack/data/cinder/conversion/a0c12227-25e5-4bff-8312-c8f4c6baf37c.temp_image.c4bd125f-a7c8-454a-a289-f9f84e87b74907iuxqdd.img {{(pid=87314) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 18:00:14 devstack cinder-volume[87314]: INFO cinder.image.image_utils [None req-12e633aa-d9b8-43d1-97e5-91b0c899eb16 tempest-VolumesActionsTest-1660328580 None] Converted 1024.00 MB image at 168.52 MB/s Sep 04 18:00:14 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-12e633aa-d9b8-43d1-97e5-91b0c899eb16 tempest-VolumesActionsTest-1660328580 None] c4bd125f-a7c8-454a-a289-f9f84e87b749 was raw, no need to convert to raw {{(pid=87314) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 04 18:00:15 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-14196fb0-6334-4f9f-81e2-ece84e169188 tempest-VolumesTransfersV357Test-609279018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:00:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-14196fb0-6334-4f9f-81e2-ece84e169188 tempest-VolumesTransfersV357Test-609279018 None] Flow 'volume_create_manager' (aa255b7d-4002-44b8-ae17-3f5f41f31341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:00:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-14196fb0-6334-4f9f-81e2-ece84e169188 tempest-VolumesTransfersV357Test-609279018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb5cc7e3-1b62-4320-9cde-bf5291796cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:00:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-14196fb0-6334-4f9f-81e2-ece84e169188 tempest-VolumesTransfersV357Test-609279018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb5cc7e3-1b62-4320-9cde-bf5291796cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:00:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1447132756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc741c0d-8c51-4cfa-98e4-d159810f8aa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3c721da41d246cab094a614b828a87d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:00:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:00:15Z,use_quota=True,user_id='7548bf3161624de5bbc229f064526229',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:00:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-14196fb0-6334-4f9f-81e2-ece84e169188 tempest-VolumesTransfersV357Test-609279018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b625c08-dbb6-4dff-a75a-693e1df4ea13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:00:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-14196fb0-6334-4f9f-81e2-ece84e169188 tempest-VolumesTransfersV357Test-609279018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b625c08-dbb6-4dff-a75a-693e1df4ea13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:00:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-14196fb0-6334-4f9f-81e2-ece84e169188 tempest-VolumesTransfersV357Test-609279018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87289e71-9a05-4ebc-8ca2-9cd7c3218089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:00:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-14196fb0-6334-4f9f-81e2-ece84e169188 tempest-VolumesTransfersV357Test-609279018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87289e71-9a05-4ebc-8ca2-9cd7c3218089) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc741c0d-8c51-4cfa-98e4-d159810f8aa3', 'volume_name': 'volume-fc741c0d-8c51-4cfa-98e4-d159810f8aa3', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:00:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-14196fb0-6334-4f9f-81e2-ece84e169188 tempest-VolumesTransfersV357Test-609279018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (291c76e6-5760-4fc3-be44-2156a4c7ca69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:00:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-14196fb0-6334-4f9f-81e2-ece84e169188 tempest-VolumesTransfersV357Test-609279018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (291c76e6-5760-4fc3-be44-2156a4c7ca69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:00:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-14196fb0-6334-4f9f-81e2-ece84e169188 tempest-VolumesTransfersV357Test-609279018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8232c43-293d-4560-98d0-46930d79c433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:00:15 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-14196fb0-6334-4f9f-81e2-ece84e169188 tempest-VolumesTransfersV357Test-609279018 None] Volume fc741c0d-8c51-4cfa-98e4-d159810f8aa3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc741c0d-8c51-4cfa-98e4-d159810f8aa3', 'volume_size': 1} Sep 04 18:00:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-14196fb0-6334-4f9f-81e2-ece84e169188 tempest-VolumesTransfersV357Test-609279018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:00:21 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 18:00:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:00:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:00:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:00:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:00:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:00:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:00:21 devstack sudo[99968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:00:21 devstack sudo[99968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:00:21 devstack sudo[99968]: pam_unix(sudo:session): session closed for user root Sep 04 18:00:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.276s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:00:21 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:00:21 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running periodic task VolumeManager._thread_info {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 18:00:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] thread count: 28 {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 18:00:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] thread info: [<_MainThread(MainThread, started 139900377723008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 18:00:25 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:UPDATE=46,cinder:SELECT=46,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 18:00:25 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:UPDATE=42,cinder:DELETE=6,cinder:SELECT=44,cinder:INSERT=14 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 18:00:31 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-d1a37fd5-329c-4df0-82d1-b9fa6cb2fe4c req-2d203bb5-3b0a-45e3-b770-b774aa993ef3 tempest-TestMinimumBasicScenario-1450520566 None] Terminate volume connection completed successfully. Sep 04 18:00:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-d1a37fd5-329c-4df0-82d1-b9fa6cb2fe4c req-2d203bb5-3b0a-45e3-b770-b774aa993ef3 tempest-TestMinimumBasicScenario-1450520566 None] Deleting attachment a7e3e9f1-613d-4f8c-8532-4171d6e3408a. {{(pid=87314) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 18:00:32 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-67311715-bbeb-4942-833b-229c25a484fa tempest-TestMinimumBasicScenario-1450520566 None] Acquiring lock "cinder-cc69fb22-62b7-4d6b-9530-7dbb33fe1b74-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:00:32 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-67311715-bbeb-4942-833b-229c25a484fa tempest-TestMinimumBasicScenario-1450520566 None] Lock "cinder-cc69fb22-62b7-4d6b-9530-7dbb33fe1b74-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:00:32 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-67311715-bbeb-4942-833b-229c25a484fa tempest-TestMinimumBasicScenario-1450520566 None] Acquiring lock "cinder-quobyte-cc69fb22-62b7-4d6b-9530-7dbb33fe1b74" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:00:32 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-67311715-bbeb-4942-833b-229c25a484fa tempest-TestMinimumBasicScenario-1450520566 None] Lock "cinder-quobyte-cc69fb22-62b7-4d6b-9530-7dbb33fe1b74" acquired by "delete_volume" :: waited 0.019s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:00:32 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[209c5a0d-aef3-406d-b65f-9ba9943f4e1a]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:00:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-67311715-bbeb-4942-833b-229c25a484fa tempest-TestMinimumBasicScenario-1450520566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cc69fb22-62b7-4d6b-9530-7dbb33fe1b74 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:00:33 devstack sudo[99984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cc69fb22-62b7-4d6b-9530-7dbb33fe1b74 Sep 04 18:00:33 devstack sudo[99984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:00:33 devstack sudo[99984]: pam_unix(sudo:session): session closed for user root Sep 04 18:00:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-67311715-bbeb-4942-833b-229c25a484fa tempest-TestMinimumBasicScenario-1450520566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cc69fb22-62b7-4d6b-9530-7dbb33fe1b74" returned: 0 in 0.391s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:00:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-67311715-bbeb-4942-833b-229c25a484fa tempest-TestMinimumBasicScenario-1450520566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cc69fb22-62b7-4d6b-9530-7dbb33fe1b74 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:00:33 devstack sudo[99989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cc69fb22-62b7-4d6b-9530-7dbb33fe1b74 Sep 04 18:00:33 devstack sudo[99989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:00:33 devstack sudo[99989]: pam_unix(sudo:session): session closed for user root Sep 04 18:00:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-67311715-bbeb-4942-833b-229c25a484fa tempest-TestMinimumBasicScenario-1450520566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cc69fb22-62b7-4d6b-9530-7dbb33fe1b74" returned: 0 in 0.278s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:00:33 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-67311715-bbeb-4942-833b-229c25a484fa tempest-TestMinimumBasicScenario-1450520566 None] Lock "cinder-quobyte-cc69fb22-62b7-4d6b-9530-7dbb33fe1b74" released by "delete_volume" :: held 0.716s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:00:33 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-67311715-bbeb-4942-833b-229c25a484fa tempest-TestMinimumBasicScenario-1450520566 None] Created reservations ['6093f98a-4a0b-43f2-89de-f73ce6832c75', '2b7619ca-c08d-435c-badb-76f45e54c0fd', 'c3980570-faf3-4189-be6d-b46ac182a7ff', '3cbce155-8335-4cb9-9a68-144c9926d2c4'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:00:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-67311715-bbeb-4942-833b-229c25a484fa tempest-TestMinimumBasicScenario-1450520566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:00:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-67311715-bbeb-4942-833b-229c25a484fa tempest-TestMinimumBasicScenario-1450520566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:00:33 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-67311715-bbeb-4942-833b-229c25a484fa tempest-TestMinimumBasicScenario-1450520566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:00:33 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-67311715-bbeb-4942-833b-229c25a484fa tempest-TestMinimumBasicScenario-1450520566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:00:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-67311715-bbeb-4942-833b-229c25a484fa tempest-TestMinimumBasicScenario-1450520566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:00:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-67311715-bbeb-4942-833b-229c25a484fa tempest-TestMinimumBasicScenario-1450520566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:00:33 devstack sudo[99993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:00:33 devstack sudo[99993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:00:33 devstack sudo[99993]: pam_unix(sudo:session): session closed for user root Sep 04 18:00:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-67311715-bbeb-4942-833b-229c25a484fa tempest-TestMinimumBasicScenario-1450520566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.255s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:00:33 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-67311715-bbeb-4942-833b-229c25a484fa tempest-TestMinimumBasicScenario-1450520566 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:00:34 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-67311715-bbeb-4942-833b-229c25a484fa tempest-TestMinimumBasicScenario-1450520566 None] Deleted volume successfully. Sep 04 18:00:34 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-67311715-bbeb-4942-833b-229c25a484fa tempest-TestMinimumBasicScenario-1450520566 None] Lock "cinder-cc69fb22-62b7-4d6b-9530-7dbb33fe1b74-delete_volume" released by "delete_volume" :: held 1.201s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:00:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-12e633aa-d9b8-43d1-97e5-91b0c899eb16 tempest-VolumesActionsTest-1660328580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.570s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:00:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-12e633aa-d9b8-43d1-97e5-91b0c899eb16 tempest-VolumesActionsTest-1660328580 None] Uploaded volume to glance image-id: c4bd125f-a7c8-454a-a289-f9f84e87b749. {{(pid=87314) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 04 18:00:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-14196fb0-6334-4f9f-81e2-ece84e169188 tempest-VolumesTransfersV357Test-609279018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.632s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:00:34 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-14196fb0-6334-4f9f-81e2-ece84e169188 tempest-VolumesTransfersV357Test-609279018 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:00:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1447132756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc741c0d-8c51-4cfa-98e4-d159810f8aa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3c721da41d246cab094a614b828a87d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:00:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:00:15Z,use_quota=True,user_id='7548bf3161624de5bbc229f064526229',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:00:34 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-14196fb0-6334-4f9f-81e2-ece84e169188 tempest-VolumesTransfersV357Test-609279018 None] Creating volume fc741c0d-8c51-4cfa-98e4-d159810f8aa3 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:00:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-14196fb0-6334-4f9f-81e2-ece84e169188 tempest-VolumesTransfersV357Test-609279018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:00:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-14196fb0-6334-4f9f-81e2-ece84e169188 tempest-VolumesTransfersV357Test-609279018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:00:34 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-14196fb0-6334-4f9f-81e2-ece84e169188 tempest-VolumesTransfersV357Test-609279018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:00:34 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-14196fb0-6334-4f9f-81e2-ece84e169188 tempest-VolumesTransfersV357Test-609279018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:00:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-14196fb0-6334-4f9f-81e2-ece84e169188 tempest-VolumesTransfersV357Test-609279018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:00:34 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-14196fb0-6334-4f9f-81e2-ece84e169188 tempest-VolumesTransfersV357Test-609279018 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:00:34 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-14196fb0-6334-4f9f-81e2-ece84e169188 tempest-VolumesTransfersV357Test-609279018 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:00:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-14196fb0-6334-4f9f-81e2-ece84e169188 tempest-VolumesTransfersV357Test-609279018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-fc741c0d-8c51-4cfa-98e4-d159810f8aa3 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:00:34 devstack sudo[100016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-fc741c0d-8c51-4cfa-98e4-d159810f8aa3 1073741824 Sep 04 18:00:34 devstack sudo[100016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:00:34 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-12e633aa-d9b8-43d1-97e5-91b0c899eb16 tempest-VolumesActionsTest-1660328580 None] Copy volume to image completed successfully. Sep 04 18:00:35 devstack sudo[100016]: pam_unix(sudo:session): session closed for user root Sep 04 18:00:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-14196fb0-6334-4f9f-81e2-ece84e169188 tempest-VolumesTransfersV357Test-609279018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-fc741c0d-8c51-4cfa-98e4-d159810f8aa3 1073741824" returned: 0 in 0.553s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:00:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-14196fb0-6334-4f9f-81e2-ece84e169188 tempest-VolumesTransfersV357Test-609279018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-fc741c0d-8c51-4cfa-98e4-d159810f8aa3 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:00:35 devstack sudo[100023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-fc741c0d-8c51-4cfa-98e4-d159810f8aa3 Sep 04 18:00:35 devstack sudo[100023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:00:35 devstack sudo[100023]: pam_unix(sudo:session): session closed for user root Sep 04 18:00:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-14196fb0-6334-4f9f-81e2-ece84e169188 tempest-VolumesTransfersV357Test-609279018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-fc741c0d-8c51-4cfa-98e4-d159810f8aa3" returned: 0 in 0.310s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:00:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-14196fb0-6334-4f9f-81e2-ece84e169188 tempest-VolumesTransfersV357Test-609279018 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:00:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-14196fb0-6334-4f9f-81e2-ece84e169188 tempest-VolumesTransfersV357Test-609279018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:00:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-14196fb0-6334-4f9f-81e2-ece84e169188 tempest-VolumesTransfersV357Test-609279018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8232c43-293d-4560-98d0-46930d79c433) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc741c0d-8c51-4cfa-98e4-d159810f8aa3', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:00:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-14196fb0-6334-4f9f-81e2-ece84e169188 tempest-VolumesTransfersV357Test-609279018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89f11b61-eac6-406c-8afe-d8e278f5c8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:00:35 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-14196fb0-6334-4f9f-81e2-ece84e169188 tempest-VolumesTransfersV357Test-609279018 None] Volume volume-fc741c0d-8c51-4cfa-98e4-d159810f8aa3 (fc741c0d-8c51-4cfa-98e4-d159810f8aa3): created successfully Sep 04 18:00:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-14196fb0-6334-4f9f-81e2-ece84e169188 tempest-VolumesTransfersV357Test-609279018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89f11b61-eac6-406c-8afe-d8e278f5c8b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:00:35 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-14196fb0-6334-4f9f-81e2-ece84e169188 tempest-VolumesTransfersV357Test-609279018 None] Flow 'volume_create_manager' (aa255b7d-4002-44b8-ae17-3f5f41f31341) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:00:35 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-14196fb0-6334-4f9f-81e2-ece84e169188 tempest-VolumesTransfersV357Test-609279018 None] Created volume successfully. Sep 04 18:00:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-488d6f27-27cf-4652-a96d-27283def6487 tempest-VolumesActionsTest-1660328580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:00:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-488d6f27-27cf-4652-a96d-27283def6487 tempest-VolumesActionsTest-1660328580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:00:36 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[791df708-c73e-4ad1-a558-3fbac3b1e722]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:00:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-488d6f27-27cf-4652-a96d-27283def6487 tempest-VolumesActionsTest-1660328580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0c12227-25e5-4bff-8312-c8f4c6baf37c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:00:36 devstack sudo[100026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0c12227-25e5-4bff-8312-c8f4c6baf37c Sep 04 18:00:36 devstack sudo[100026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:00:36 devstack sudo[100026]: pam_unix(sudo:session): session closed for user root Sep 04 18:00:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-488d6f27-27cf-4652-a96d-27283def6487 tempest-VolumesActionsTest-1660328580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0c12227-25e5-4bff-8312-c8f4c6baf37c" returned: 0 in 0.348s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:00:36 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d755d80-f857-403f-9222-709d96ea037a]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:00:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-488d6f27-27cf-4652-a96d-27283def6487 tempest-VolumesActionsTest-1660328580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0c12227-25e5-4bff-8312-c8f4c6baf37c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:00:36 devstack sudo[100032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0c12227-25e5-4bff-8312-c8f4c6baf37c Sep 04 18:00:36 devstack sudo[100032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:00:36 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6a37f90c-234f-4ecb-950a-794241313f01 tempest-VolumesTransfersV357Test-1028595556 None] Acquiring lock "cinder-fc741c0d-8c51-4cfa-98e4-d159810f8aa3-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:00:36 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6a37f90c-234f-4ecb-950a-794241313f01 tempest-VolumesTransfersV357Test-1028595556 None] Lock "cinder-fc741c0d-8c51-4cfa-98e4-d159810f8aa3-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:00:36 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6a37f90c-234f-4ecb-950a-794241313f01 tempest-VolumesTransfersV357Test-1028595556 None] Acquiring lock "cinder-quobyte-fc741c0d-8c51-4cfa-98e4-d159810f8aa3" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:00:36 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6a37f90c-234f-4ecb-950a-794241313f01 tempest-VolumesTransfersV357Test-1028595556 None] Lock "cinder-quobyte-fc741c0d-8c51-4cfa-98e4-d159810f8aa3" acquired by "delete_volume" :: waited 0.024s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:00:36 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[43fd297c-a978-489d-af75-29910c310b17]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:00:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6a37f90c-234f-4ecb-950a-794241313f01 tempest-VolumesTransfersV357Test-1028595556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-fc741c0d-8c51-4cfa-98e4-d159810f8aa3 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:00:36 devstack sudo[100032]: pam_unix(sudo:session): session closed for user root Sep 04 18:00:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-488d6f27-27cf-4652-a96d-27283def6487 tempest-VolumesActionsTest-1660328580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0c12227-25e5-4bff-8312-c8f4c6baf37c" returned: 0 in 0.465s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:00:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-488d6f27-27cf-4652-a96d-27283def6487 tempest-VolumesActionsTest-1660328580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0c12227-25e5-4bff-8312-c8f4c6baf37c /opt/stack/data/cinder/conversion/a0c12227-25e5-4bff-8312-c8f4c6baf37c.temp_image.49476a31-11be-46c9-adc6-381a2741217f8zbakhdl.img {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:00:36 devstack sudo[100038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0c12227-25e5-4bff-8312-c8f4c6baf37c /opt/stack/data/cinder/conversion/a0c12227-25e5-4bff-8312-c8f4c6baf37c.temp_image.49476a31-11be-46c9-adc6-381a2741217f8zbakhdl.img Sep 04 18:00:36 devstack sudo[100038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:00:37 devstack sudo[100037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-fc741c0d-8c51-4cfa-98e4-d159810f8aa3 Sep 04 18:00:37 devstack sudo[100037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:00:37 devstack sudo[100037]: pam_unix(sudo:session): session closed for user root Sep 04 18:00:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6a37f90c-234f-4ecb-950a-794241313f01 tempest-VolumesTransfersV357Test-1028595556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-fc741c0d-8c51-4cfa-98e4-d159810f8aa3" returned: 0 in 0.499s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:00:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6a37f90c-234f-4ecb-950a-794241313f01 tempest-VolumesTransfersV357Test-1028595556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-fc741c0d-8c51-4cfa-98e4-d159810f8aa3 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:00:37 devstack sudo[100055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-fc741c0d-8c51-4cfa-98e4-d159810f8aa3 Sep 04 18:00:37 devstack sudo[100055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:00:37 devstack sudo[100055]: pam_unix(sudo:session): session closed for user root Sep 04 18:00:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6a37f90c-234f-4ecb-950a-794241313f01 tempest-VolumesTransfersV357Test-1028595556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-fc741c0d-8c51-4cfa-98e4-d159810f8aa3" returned: 0 in 0.450s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:00:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6a37f90c-234f-4ecb-950a-794241313f01 tempest-VolumesTransfersV357Test-1028595556 None] Lock "cinder-quobyte-fc741c0d-8c51-4cfa-98e4-d159810f8aa3" released by "delete_volume" :: held 1.029s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:00:38 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-6a37f90c-234f-4ecb-950a-794241313f01 tempest-VolumesTransfersV357Test-1028595556 None] Created reservations ['e5e2f92d-615a-4753-a904-4e11c373ad0b', '9cad22b1-8aa1-4113-a97e-0174ec70d261', '75e9cc7a-7b39-4997-82fd-ac5e88373316', '1d40bdb9-7010-41cd-9469-1b964be449fd'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:00:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6a37f90c-234f-4ecb-950a-794241313f01 tempest-VolumesTransfersV357Test-1028595556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:00:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6a37f90c-234f-4ecb-950a-794241313f01 tempest-VolumesTransfersV357Test-1028595556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:00:38 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-6a37f90c-234f-4ecb-950a-794241313f01 tempest-VolumesTransfersV357Test-1028595556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:00:38 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-6a37f90c-234f-4ecb-950a-794241313f01 tempest-VolumesTransfersV357Test-1028595556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:00:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6a37f90c-234f-4ecb-950a-794241313f01 tempest-VolumesTransfersV357Test-1028595556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:00:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6a37f90c-234f-4ecb-950a-794241313f01 tempest-VolumesTransfersV357Test-1028595556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:00:38 devstack sudo[100058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:00:38 devstack sudo[100058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:00:38 devstack sudo[100058]: pam_unix(sudo:session): session closed for user root Sep 04 18:00:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6a37f90c-234f-4ecb-950a-794241313f01 tempest-VolumesTransfersV357Test-1028595556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.330s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:00:38 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-6a37f90c-234f-4ecb-950a-794241313f01 tempest-VolumesTransfersV357Test-1028595556 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:00:38 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-6a37f90c-234f-4ecb-950a-794241313f01 tempest-VolumesTransfersV357Test-1028595556 None] Deleted volume successfully. Sep 04 18:00:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6a37f90c-234f-4ecb-950a-794241313f01 tempest-VolumesTransfersV357Test-1028595556 None] Lock "cinder-fc741c0d-8c51-4cfa-98e4-d159810f8aa3-delete_volume" released by "delete_volume" :: held 1.841s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:00:41 devstack sudo[100038]: pam_unix(sudo:session): session closed for user root Sep 04 18:00:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-488d6f27-27cf-4652-a96d-27283def6487 tempest-VolumesActionsTest-1660328580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0c12227-25e5-4bff-8312-c8f4c6baf37c /opt/stack/data/cinder/conversion/a0c12227-25e5-4bff-8312-c8f4c6baf37c.temp_image.49476a31-11be-46c9-adc6-381a2741217f8zbakhdl.img" returned: 0 in 4.978s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:00:41 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e6e8b28-6592-43ae-b0c1-32be7486a3f4]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:00:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-488d6f27-27cf-4652-a96d-27283def6487 tempest-VolumesActionsTest-1660328580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0c12227-25e5-4bff-8312-c8f4c6baf37c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:00:42 devstack sudo[100062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0c12227-25e5-4bff-8312-c8f4c6baf37c Sep 04 18:00:42 devstack sudo[100062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:00:42 devstack sudo[100062]: pam_unix(sudo:session): session closed for user root Sep 04 18:00:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-488d6f27-27cf-4652-a96d-27283def6487 tempest-VolumesActionsTest-1660328580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0c12227-25e5-4bff-8312-c8f4c6baf37c" returned: 0 in 0.632s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:00:42 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-488d6f27-27cf-4652-a96d-27283def6487 tempest-VolumesActionsTest-1660328580 None] Image conversion details: src /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0c12227-25e5-4bff-8312-c8f4c6baf37c, size 1024.00 MB, duration 4.98 sec, destination /opt/stack/data/cinder/conversion/a0c12227-25e5-4bff-8312-c8f4c6baf37c.temp_image.49476a31-11be-46c9-adc6-381a2741217f8zbakhdl.img {{(pid=87314) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 18:00:42 devstack cinder-volume[87314]: INFO cinder.image.image_utils [None req-488d6f27-27cf-4652-a96d-27283def6487 tempest-VolumesActionsTest-1660328580 None] Converted 1024.00 MB image at 205.68 MB/s Sep 04 18:00:42 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-488d6f27-27cf-4652-a96d-27283def6487 tempest-VolumesActionsTest-1660328580 None] 49476a31-11be-46c9-adc6-381a2741217f was raw, converting to qcow2 {{(pid=87314) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Sep 04 18:00:42 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6787a9-f506-42fe-acb6-635f4a0a7174]: (4, 'raw') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:00:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-488d6f27-27cf-4652-a96d-27283def6487 tempest-VolumesActionsTest-1660328580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a0c12227-25e5-4bff-8312-c8f4c6baf37c.temp_image.49476a31-11be-46c9-adc6-381a2741217f8zbakhdl.img {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:00:42 devstack sudo[100067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a0c12227-25e5-4bff-8312-c8f4c6baf37c.temp_image.49476a31-11be-46c9-adc6-381a2741217f8zbakhdl.img Sep 04 18:00:42 devstack sudo[100067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:00:43 devstack sudo[100067]: pam_unix(sudo:session): session closed for user root Sep 04 18:00:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-488d6f27-27cf-4652-a96d-27283def6487 tempest-VolumesActionsTest-1660328580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a0c12227-25e5-4bff-8312-c8f4c6baf37c.temp_image.49476a31-11be-46c9-adc6-381a2741217f8zbakhdl.img" returned: 0 in 0.368s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:00:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-488d6f27-27cf-4652-a96d-27283def6487 tempest-VolumesActionsTest-1660328580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a0c12227-25e5-4bff-8312-c8f4c6baf37c.temp_image.49476a31-11be-46c9-adc6-381a2741217f8zbakhdl.img {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:00:43 devstack sudo[100071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a0c12227-25e5-4bff-8312-c8f4c6baf37c.temp_image.49476a31-11be-46c9-adc6-381a2741217f8zbakhdl.img Sep 04 18:00:43 devstack sudo[100071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:00:43 devstack sudo[100071]: pam_unix(sudo:session): session closed for user root Sep 04 18:00:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-488d6f27-27cf-4652-a96d-27283def6487 tempest-VolumesActionsTest-1660328580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a0c12227-25e5-4bff-8312-c8f4c6baf37c.temp_image.49476a31-11be-46c9-adc6-381a2741217f8zbakhdl.img" returned: 1 in 0.474s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:00:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-488d6f27-27cf-4652-a96d-27283def6487 tempest-VolumesActionsTest-1660328580 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a0c12227-25e5-4bff-8312-c8f4c6baf37c.temp_image.49476a31-11be-46c9-adc6-381a2741217f8zbakhdl.img' failed. Not Retrying. {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 18:00:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-488d6f27-27cf-4652-a96d-27283def6487 tempest-VolumesActionsTest-1660328580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a0c12227-25e5-4bff-8312-c8f4c6baf37c.temp_image.49476a31-11be-46c9-adc6-381a2741217f8zbakhdl.img /opt/stack/data/cinder/conversion/vol_upload_wubgwb9r {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:00:43 devstack sudo[100076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a0c12227-25e5-4bff-8312-c8f4c6baf37c.temp_image.49476a31-11be-46c9-adc6-381a2741217f8zbakhdl.img /opt/stack/data/cinder/conversion/vol_upload_wubgwb9r Sep 04 18:00:43 devstack sudo[100076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:00:43 devstack sudo[100076]: pam_unix(sudo:session): session closed for user root Sep 04 18:00:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-488d6f27-27cf-4652-a96d-27283def6487 tempest-VolumesActionsTest-1660328580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a0c12227-25e5-4bff-8312-c8f4c6baf37c.temp_image.49476a31-11be-46c9-adc6-381a2741217f8zbakhdl.img /opt/stack/data/cinder/conversion/vol_upload_wubgwb9r" returned: 0 in 0.288s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:00:43 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-488d6f27-27cf-4652-a96d-27283def6487 tempest-VolumesActionsTest-1660328580 None] Image conversion details: src /opt/stack/data/cinder/conversion/a0c12227-25e5-4bff-8312-c8f4c6baf37c.temp_image.49476a31-11be-46c9-adc6-381a2741217f8zbakhdl.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_wubgwb9r {{(pid=87314) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 18:00:43 devstack cinder-volume[87314]: INFO cinder.image.image_utils [None req-488d6f27-27cf-4652-a96d-27283def6487 tempest-VolumesActionsTest-1660328580 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 04 18:00:43 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47da9d7-fb69-4100-9897-d63a599f1b6a]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:00:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-488d6f27-27cf-4652-a96d-27283def6487 tempest-VolumesActionsTest-1660328580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_wubgwb9r {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:00:43 devstack sudo[100082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_wubgwb9r Sep 04 18:00:43 devstack sudo[100082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:00:44 devstack sudo[100082]: pam_unix(sudo:session): session closed for user root Sep 04 18:00:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-488d6f27-27cf-4652-a96d-27283def6487 tempest-VolumesActionsTest-1660328580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_wubgwb9r" returned: 0 in 0.423s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:00:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-488d6f27-27cf-4652-a96d-27283def6487 tempest-VolumesActionsTest-1660328580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.890s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:00:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-488d6f27-27cf-4652-a96d-27283def6487 tempest-VolumesActionsTest-1660328580 None] Uploaded volume to glance image-id: 49476a31-11be-46c9-adc6-381a2741217f. {{(pid=87314) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 04 18:00:46 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-488d6f27-27cf-4652-a96d-27283def6487 tempest-VolumesActionsTest-1660328580 None] Copy volume to image completed successfully. Sep 04 18:00:47 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-4db373f9-0f34-4ad6-9041-70497b2222d5 tempest-VolumesGetTest-1631238581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:00:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4db373f9-0f34-4ad6-9041-70497b2222d5 tempest-VolumesGetTest-1631238581 None] Flow 'volume_create_manager' (f24c0aa6-2f00-4643-b9d7-efc3694faeab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:00:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4db373f9-0f34-4ad6-9041-70497b2222d5 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (801c74aa-b939-4117-9790-40324db79e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:00:47 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-36b7f181-875c-4728-8aa1-c0ac1a886938 tempest-VolumesActionsTest-1660328580 None] Acquiring lock "cinder-a0c12227-25e5-4bff-8312-c8f4c6baf37c-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:00:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4db373f9-0f34-4ad6-9041-70497b2222d5 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (801c74aa-b939-4117-9790-40324db79e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:00:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1112950599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d744ab4f-8fa4-4f5e-9f92-2999f25263a9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2c96efde19cc4123b29949f3f26b23f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:00:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:00:47Z,use_quota=True,user_id='28d5b941a873423aad147810bdefc056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:00:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4db373f9-0f34-4ad6-9041-70497b2222d5 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e71e5edd-33cb-418a-bcbf-a798c5c0f9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:00:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4db373f9-0f34-4ad6-9041-70497b2222d5 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e71e5edd-33cb-418a-bcbf-a798c5c0f9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:00:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4db373f9-0f34-4ad6-9041-70497b2222d5 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2f39738-56ed-4413-bd3f-e4013d1cc3f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:00:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4db373f9-0f34-4ad6-9041-70497b2222d5 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2f39738-56ed-4413-bd3f-e4013d1cc3f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd744ab4f-8fa4-4f5e-9f92-2999f25263a9', 'volume_name': 'volume-d744ab4f-8fa4-4f5e-9f92-2999f25263a9', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:00:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4db373f9-0f34-4ad6-9041-70497b2222d5 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a32386b-3faa-4ad8-b91b-691470804f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:00:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4db373f9-0f34-4ad6-9041-70497b2222d5 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a32386b-3faa-4ad8-b91b-691470804f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:00:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4db373f9-0f34-4ad6-9041-70497b2222d5 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3426e57d-4252-42fc-844a-c71edcd1682b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:00:47 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-4db373f9-0f34-4ad6-9041-70497b2222d5 tempest-VolumesGetTest-1631238581 None] Volume d744ab4f-8fa4-4f5e-9f92-2999f25263a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d744ab4f-8fa4-4f5e-9f92-2999f25263a9', 'volume_size': 1} Sep 04 18:00:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4db373f9-0f34-4ad6-9041-70497b2222d5 tempest-VolumesGetTest-1631238581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:00:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4db373f9-0f34-4ad6-9041-70497b2222d5 tempest-VolumesGetTest-1631238581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:00:47 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4db373f9-0f34-4ad6-9041-70497b2222d5 tempest-VolumesGetTest-1631238581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:00:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1112950599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d744ab4f-8fa4-4f5e-9f92-2999f25263a9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2c96efde19cc4123b29949f3f26b23f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:00:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:00:47Z,use_quota=True,user_id='28d5b941a873423aad147810bdefc056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:00:47 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-4db373f9-0f34-4ad6-9041-70497b2222d5 tempest-VolumesGetTest-1631238581 None] Creating volume d744ab4f-8fa4-4f5e-9f92-2999f25263a9 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:00:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4db373f9-0f34-4ad6-9041-70497b2222d5 tempest-VolumesGetTest-1631238581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:00:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4db373f9-0f34-4ad6-9041-70497b2222d5 tempest-VolumesGetTest-1631238581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:00:47 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4db373f9-0f34-4ad6-9041-70497b2222d5 tempest-VolumesGetTest-1631238581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:00:47 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4db373f9-0f34-4ad6-9041-70497b2222d5 tempest-VolumesGetTest-1631238581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:00:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4db373f9-0f34-4ad6-9041-70497b2222d5 tempest-VolumesGetTest-1631238581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:00:47 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4db373f9-0f34-4ad6-9041-70497b2222d5 tempest-VolumesGetTest-1631238581 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:00:47 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-4db373f9-0f34-4ad6-9041-70497b2222d5 tempest-VolumesGetTest-1631238581 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:00:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4db373f9-0f34-4ad6-9041-70497b2222d5 tempest-VolumesGetTest-1631238581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d744ab4f-8fa4-4f5e-9f92-2999f25263a9 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:00:47 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-36b7f181-875c-4728-8aa1-c0ac1a886938 tempest-VolumesActionsTest-1660328580 None] Lock "cinder-a0c12227-25e5-4bff-8312-c8f4c6baf37c-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:00:47 devstack sudo[100125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d744ab4f-8fa4-4f5e-9f92-2999f25263a9 1073741824 Sep 04 18:00:47 devstack sudo[100125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:00:47 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-36b7f181-875c-4728-8aa1-c0ac1a886938 tempest-VolumesActionsTest-1660328580 None] Acquiring lock "cinder-quobyte-a0c12227-25e5-4bff-8312-c8f4c6baf37c" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:00:47 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-36b7f181-875c-4728-8aa1-c0ac1a886938 tempest-VolumesActionsTest-1660328580 None] Lock "cinder-quobyte-a0c12227-25e5-4bff-8312-c8f4c6baf37c" acquired by "delete_volume" :: waited 0.015s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:00:47 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e14a83b-4170-40f1-bb46-ccbc88689001]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:00:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-36b7f181-875c-4728-8aa1-c0ac1a886938 tempest-VolumesActionsTest-1660328580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0c12227-25e5-4bff-8312-c8f4c6baf37c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:00:47 devstack sudo[100127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0c12227-25e5-4bff-8312-c8f4c6baf37c Sep 04 18:00:47 devstack sudo[100127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:00:48 devstack sudo[100125]: pam_unix(sudo:session): session closed for user root Sep 04 18:00:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4db373f9-0f34-4ad6-9041-70497b2222d5 tempest-VolumesGetTest-1631238581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d744ab4f-8fa4-4f5e-9f92-2999f25263a9 1073741824" returned: 0 in 0.461s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:00:48 devstack sudo[100127]: pam_unix(sudo:session): session closed for user root Sep 04 18:00:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-36b7f181-875c-4728-8aa1-c0ac1a886938 tempest-VolumesActionsTest-1660328580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0c12227-25e5-4bff-8312-c8f4c6baf37c" returned: 0 in 0.384s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:00:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-36b7f181-875c-4728-8aa1-c0ac1a886938 tempest-VolumesActionsTest-1660328580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0c12227-25e5-4bff-8312-c8f4c6baf37c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:00:48 devstack sudo[100136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0c12227-25e5-4bff-8312-c8f4c6baf37c Sep 04 18:00:48 devstack sudo[100136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:00:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4db373f9-0f34-4ad6-9041-70497b2222d5 tempest-VolumesGetTest-1631238581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d744ab4f-8fa4-4f5e-9f92-2999f25263a9 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:00:48 devstack sudo[100138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d744ab4f-8fa4-4f5e-9f92-2999f25263a9 Sep 04 18:00:48 devstack sudo[100138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:00:48 devstack sudo[100138]: pam_unix(sudo:session): session closed for user root Sep 04 18:00:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4db373f9-0f34-4ad6-9041-70497b2222d5 tempest-VolumesGetTest-1631238581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d744ab4f-8fa4-4f5e-9f92-2999f25263a9" returned: 0 in 0.281s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:00:48 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4db373f9-0f34-4ad6-9041-70497b2222d5 tempest-VolumesGetTest-1631238581 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:00:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4db373f9-0f34-4ad6-9041-70497b2222d5 tempest-VolumesGetTest-1631238581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:00:48 devstack sudo[100136]: pam_unix(sudo:session): session closed for user root Sep 04 18:00:48 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4db373f9-0f34-4ad6-9041-70497b2222d5 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3426e57d-4252-42fc-844a-c71edcd1682b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d744ab4f-8fa4-4f5e-9f92-2999f25263a9', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:00:48 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4db373f9-0f34-4ad6-9041-70497b2222d5 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13f14ec3-50f3-4dfe-8cf4-65ca18c9d954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:00:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-36b7f181-875c-4728-8aa1-c0ac1a886938 tempest-VolumesActionsTest-1660328580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a0c12227-25e5-4bff-8312-c8f4c6baf37c" returned: 0 in 0.347s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:00:48 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-36b7f181-875c-4728-8aa1-c0ac1a886938 tempest-VolumesActionsTest-1660328580 None] Lock "cinder-quobyte-a0c12227-25e5-4bff-8312-c8f4c6baf37c" released by "delete_volume" :: held 0.775s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:00:48 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-4db373f9-0f34-4ad6-9041-70497b2222d5 tempest-VolumesGetTest-1631238581 None] Volume volume-d744ab4f-8fa4-4f5e-9f92-2999f25263a9 (d744ab4f-8fa4-4f5e-9f92-2999f25263a9): created successfully Sep 04 18:00:48 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4db373f9-0f34-4ad6-9041-70497b2222d5 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13f14ec3-50f3-4dfe-8cf4-65ca18c9d954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:00:48 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4db373f9-0f34-4ad6-9041-70497b2222d5 tempest-VolumesGetTest-1631238581 None] Flow 'volume_create_manager' (f24c0aa6-2f00-4643-b9d7-efc3694faeab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:00:48 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-4db373f9-0f34-4ad6-9041-70497b2222d5 tempest-VolumesGetTest-1631238581 None] Created volume successfully. Sep 04 18:00:48 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-36b7f181-875c-4728-8aa1-c0ac1a886938 tempest-VolumesActionsTest-1660328580 None] Created reservations ['70ab846b-2e07-42a9-a43d-17d4590f84a5', '4ceb8b8f-5d41-4773-ad77-0b342f44ddb2', '368f2083-5659-405b-90fc-77f5fc8c3bb9', 'd6d17a81-5208-4faa-9e00-44900aa5e223'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:00:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-36b7f181-875c-4728-8aa1-c0ac1a886938 tempest-VolumesActionsTest-1660328580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:00:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-36b7f181-875c-4728-8aa1-c0ac1a886938 tempest-VolumesActionsTest-1660328580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:00:48 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-36b7f181-875c-4728-8aa1-c0ac1a886938 tempest-VolumesActionsTest-1660328580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:00:48 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-36b7f181-875c-4728-8aa1-c0ac1a886938 tempest-VolumesActionsTest-1660328580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:00:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-36b7f181-875c-4728-8aa1-c0ac1a886938 tempest-VolumesActionsTest-1660328580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:00:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-36b7f181-875c-4728-8aa1-c0ac1a886938 tempest-VolumesActionsTest-1660328580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:00:48 devstack sudo[100142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:00:48 devstack sudo[100142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:00:48 devstack sudo[100142]: pam_unix(sudo:session): session closed for user root Sep 04 18:00:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-36b7f181-875c-4728-8aa1-c0ac1a886938 tempest-VolumesActionsTest-1660328580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.261s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:00:48 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-36b7f181-875c-4728-8aa1-c0ac1a886938 tempest-VolumesActionsTest-1660328580 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:00:48 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-36b7f181-875c-4728-8aa1-c0ac1a886938 tempest-VolumesActionsTest-1660328580 None] Deleted volume successfully. Sep 04 18:00:48 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-36b7f181-875c-4728-8aa1-c0ac1a886938 tempest-VolumesActionsTest-1660328580 None] Lock "cinder-a0c12227-25e5-4bff-8312-c8f4c6baf37c-delete_volume" released by "delete_volume" :: held 1.255s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:00:50 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-06f3e163-ebd8-46ae-9b76-dadd8fdab097 tempest-VolumesGetTest-1631238581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:00:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-06f3e163-ebd8-46ae-9b76-dadd8fdab097 tempest-VolumesGetTest-1631238581 None] Flow 'volume_create_manager' (731e1d44-cf54-4ef6-bafb-a1a430637680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:00:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-06f3e163-ebd8-46ae-9b76-dadd8fdab097 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7511163a-4ebb-4bab-9027-46efa927cf7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:00:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-06f3e163-ebd8-46ae-9b76-dadd8fdab097 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7511163a-4ebb-4bab-9027-46efa927cf7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:00:50Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-828675178',display_name='tempest-VolumesGetTest-Volume-291553976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dffd873-4b4a-4a5f-b714-f9e23bf81226,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c96efde19cc4123b29949f3f26b23f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:00:50Z,use_quota=True,user_id='28d5b941a873423aad147810bdefc056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:00:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-06f3e163-ebd8-46ae-9b76-dadd8fdab097 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3abeb2a-56fb-42ec-9483-837477b4ed36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:00:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-06f3e163-ebd8-46ae-9b76-dadd8fdab097 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3abeb2a-56fb-42ec-9483-837477b4ed36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:00:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-06f3e163-ebd8-46ae-9b76-dadd8fdab097 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff6d8ca2-e529-4d51-b69b-52c6a4b4f17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:00:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-06f3e163-ebd8-46ae-9b76-dadd8fdab097 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff6d8ca2-e529-4d51-b69b-52c6a4b4f17a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0dffd873-4b4a-4a5f-b714-f9e23bf81226', 'volume_name': 'volume-0dffd873-4b4a-4a5f-b714-f9e23bf81226', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:00:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-06f3e163-ebd8-46ae-9b76-dadd8fdab097 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ba1b625-fcbc-4f48-bf7e-63cddb2cbd4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:00:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-06f3e163-ebd8-46ae-9b76-dadd8fdab097 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ba1b625-fcbc-4f48-bf7e-63cddb2cbd4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:00:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-06f3e163-ebd8-46ae-9b76-dadd8fdab097 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f235009b-453b-4ea9-be18-4be052056e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:00:50 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-06f3e163-ebd8-46ae-9b76-dadd8fdab097 tempest-VolumesGetTest-1631238581 None] Volume 0dffd873-4b4a-4a5f-b714-f9e23bf81226: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0dffd873-4b4a-4a5f-b714-f9e23bf81226', 'volume_size': 1} Sep 04 18:00:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-06f3e163-ebd8-46ae-9b76-dadd8fdab097 tempest-VolumesGetTest-1631238581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:00:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-06f3e163-ebd8-46ae-9b76-dadd8fdab097 tempest-VolumesGetTest-1631238581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:00:50 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-06f3e163-ebd8-46ae-9b76-dadd8fdab097 tempest-VolumesGetTest-1631238581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:00:50Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-828675178',display_name='tempest-VolumesGetTest-Volume-291553976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dffd873-4b4a-4a5f-b714-f9e23bf81226,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c96efde19cc4123b29949f3f26b23f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:00:50Z,use_quota=True,user_id='28d5b941a873423aad147810bdefc056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:00:50 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-06f3e163-ebd8-46ae-9b76-dadd8fdab097 tempest-VolumesGetTest-1631238581 None] Creating volume 0dffd873-4b4a-4a5f-b714-f9e23bf81226 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:00:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-06f3e163-ebd8-46ae-9b76-dadd8fdab097 tempest-VolumesGetTest-1631238581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:00:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-06f3e163-ebd8-46ae-9b76-dadd8fdab097 tempest-VolumesGetTest-1631238581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:00:50 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-06f3e163-ebd8-46ae-9b76-dadd8fdab097 tempest-VolumesGetTest-1631238581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:00:50 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-06f3e163-ebd8-46ae-9b76-dadd8fdab097 tempest-VolumesGetTest-1631238581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:00:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-06f3e163-ebd8-46ae-9b76-dadd8fdab097 tempest-VolumesGetTest-1631238581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:00:50 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-06f3e163-ebd8-46ae-9b76-dadd8fdab097 tempest-VolumesGetTest-1631238581 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:00:50 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-06f3e163-ebd8-46ae-9b76-dadd8fdab097 tempest-VolumesGetTest-1631238581 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:00:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-06f3e163-ebd8-46ae-9b76-dadd8fdab097 tempest-VolumesGetTest-1631238581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0dffd873-4b4a-4a5f-b714-f9e23bf81226 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:00:50 devstack sudo[100147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0dffd873-4b4a-4a5f-b714-f9e23bf81226 1073741824 Sep 04 18:00:50 devstack sudo[100147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:00:51 devstack sudo[100147]: pam_unix(sudo:session): session closed for user root Sep 04 18:00:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-06f3e163-ebd8-46ae-9b76-dadd8fdab097 tempest-VolumesGetTest-1631238581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0dffd873-4b4a-4a5f-b714-f9e23bf81226 1073741824" returned: 0 in 0.561s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:00:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-06f3e163-ebd8-46ae-9b76-dadd8fdab097 tempest-VolumesGetTest-1631238581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0dffd873-4b4a-4a5f-b714-f9e23bf81226 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:00:51 devstack sudo[100153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0dffd873-4b4a-4a5f-b714-f9e23bf81226 Sep 04 18:00:51 devstack sudo[100153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:00:51 devstack sudo[100153]: pam_unix(sudo:session): session closed for user root Sep 04 18:00:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-06f3e163-ebd8-46ae-9b76-dadd8fdab097 tempest-VolumesGetTest-1631238581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0dffd873-4b4a-4a5f-b714-f9e23bf81226" returned: 0 in 0.279s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:00:51 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-06f3e163-ebd8-46ae-9b76-dadd8fdab097 tempest-VolumesGetTest-1631238581 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:00:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-06f3e163-ebd8-46ae-9b76-dadd8fdab097 tempest-VolumesGetTest-1631238581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:00:51 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-06f3e163-ebd8-46ae-9b76-dadd8fdab097 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f235009b-453b-4ea9-be18-4be052056e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0dffd873-4b4a-4a5f-b714-f9e23bf81226', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:00:51 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-06f3e163-ebd8-46ae-9b76-dadd8fdab097 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4b4fa05-7cc3-458b-98b9-ceb0d9e1a05b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:00:51 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-06f3e163-ebd8-46ae-9b76-dadd8fdab097 tempest-VolumesGetTest-1631238581 None] Volume volume-0dffd873-4b4a-4a5f-b714-f9e23bf81226 (0dffd873-4b4a-4a5f-b714-f9e23bf81226): created successfully Sep 04 18:00:51 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-06f3e163-ebd8-46ae-9b76-dadd8fdab097 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4b4fa05-7cc3-458b-98b9-ceb0d9e1a05b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:00:51 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-06f3e163-ebd8-46ae-9b76-dadd8fdab097 tempest-VolumesGetTest-1631238581 None] Flow 'volume_create_manager' (731e1d44-cf54-4ef6-bafb-a1a430637680) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:00:51 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-06f3e163-ebd8-46ae-9b76-dadd8fdab097 tempest-VolumesGetTest-1631238581 None] Created volume successfully. Sep 04 18:00:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-593512d2-d2e9-430a-851a-f45a99dd8df6 tempest-VolumesGetTest-1631238581 None] Acquiring lock "cinder-0dffd873-4b4a-4a5f-b714-f9e23bf81226-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:00:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-593512d2-d2e9-430a-851a-f45a99dd8df6 tempest-VolumesGetTest-1631238581 None] Lock "cinder-0dffd873-4b4a-4a5f-b714-f9e23bf81226-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:00:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-593512d2-d2e9-430a-851a-f45a99dd8df6 tempest-VolumesGetTest-1631238581 None] Acquiring lock "cinder-quobyte-0dffd873-4b4a-4a5f-b714-f9e23bf81226" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:00:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-593512d2-d2e9-430a-851a-f45a99dd8df6 tempest-VolumesGetTest-1631238581 None] Lock "cinder-quobyte-0dffd873-4b4a-4a5f-b714-f9e23bf81226" acquired by "delete_volume" :: waited 0.031s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:00:52 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[13101f0b-ea87-4871-b704-2a476fdd22eb]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:00:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-593512d2-d2e9-430a-851a-f45a99dd8df6 tempest-VolumesGetTest-1631238581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0dffd873-4b4a-4a5f-b714-f9e23bf81226 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:00:52 devstack sudo[100156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0dffd873-4b4a-4a5f-b714-f9e23bf81226 Sep 04 18:00:52 devstack sudo[100156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:00:53 devstack sudo[100156]: pam_unix(sudo:session): session closed for user root Sep 04 18:00:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-593512d2-d2e9-430a-851a-f45a99dd8df6 tempest-VolumesGetTest-1631238581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0dffd873-4b4a-4a5f-b714-f9e23bf81226" returned: 0 in 0.459s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:00:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-593512d2-d2e9-430a-851a-f45a99dd8df6 tempest-VolumesGetTest-1631238581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0dffd873-4b4a-4a5f-b714-f9e23bf81226 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:00:53 devstack sudo[100161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0dffd873-4b4a-4a5f-b714-f9e23bf81226 Sep 04 18:00:53 devstack sudo[100161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:00:53 devstack sudo[100161]: pam_unix(sudo:session): session closed for user root Sep 04 18:00:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-593512d2-d2e9-430a-851a-f45a99dd8df6 tempest-VolumesGetTest-1631238581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0dffd873-4b4a-4a5f-b714-f9e23bf81226" returned: 0 in 0.286s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:00:53 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-593512d2-d2e9-430a-851a-f45a99dd8df6 tempest-VolumesGetTest-1631238581 None] Lock "cinder-quobyte-0dffd873-4b4a-4a5f-b714-f9e23bf81226" released by "delete_volume" :: held 0.822s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:00:53 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-593512d2-d2e9-430a-851a-f45a99dd8df6 tempest-VolumesGetTest-1631238581 None] Created reservations ['174d7b33-194b-4bf1-85ad-af2a8994ce16', '71550785-b2bb-4726-94e9-e9ec2dda789e', 'a69a971e-fa0f-4b6d-a986-f314e59d9aa3', 'b5142426-4533-4d63-9d36-4eabcf87d980'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:00:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-593512d2-d2e9-430a-851a-f45a99dd8df6 tempest-VolumesGetTest-1631238581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:00:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-593512d2-d2e9-430a-851a-f45a99dd8df6 tempest-VolumesGetTest-1631238581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:00:53 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-593512d2-d2e9-430a-851a-f45a99dd8df6 tempest-VolumesGetTest-1631238581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:00:53 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-593512d2-d2e9-430a-851a-f45a99dd8df6 tempest-VolumesGetTest-1631238581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:00:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-593512d2-d2e9-430a-851a-f45a99dd8df6 tempest-VolumesGetTest-1631238581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:00:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-593512d2-d2e9-430a-851a-f45a99dd8df6 tempest-VolumesGetTest-1631238581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:00:53 devstack sudo[100166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:00:53 devstack sudo[100166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:00:53 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f54ae46a-5d19-4d15-b6dd-d52cf2493a47 tempest-VolumesGetTest-1631238581 None] Acquiring lock "cinder-d744ab4f-8fa4-4f5e-9f92-2999f25263a9-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:00:54 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f54ae46a-5d19-4d15-b6dd-d52cf2493a47 tempest-VolumesGetTest-1631238581 None] Lock "cinder-d744ab4f-8fa4-4f5e-9f92-2999f25263a9-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:00:54 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f54ae46a-5d19-4d15-b6dd-d52cf2493a47 tempest-VolumesGetTest-1631238581 None] Acquiring lock "cinder-quobyte-d744ab4f-8fa4-4f5e-9f92-2999f25263a9" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:00:54 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f54ae46a-5d19-4d15-b6dd-d52cf2493a47 tempest-VolumesGetTest-1631238581 None] Lock "cinder-quobyte-d744ab4f-8fa4-4f5e-9f92-2999f25263a9" acquired by "delete_volume" :: waited 0.032s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:00:54 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3760193-274d-40e9-b1ab-80112a626fb6]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:00:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f54ae46a-5d19-4d15-b6dd-d52cf2493a47 tempest-VolumesGetTest-1631238581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d744ab4f-8fa4-4f5e-9f92-2999f25263a9 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:00:54 devstack sudo[100166]: pam_unix(sudo:session): session closed for user root Sep 04 18:00:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-593512d2-d2e9-430a-851a-f45a99dd8df6 tempest-VolumesGetTest-1631238581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.349s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:00:54 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-593512d2-d2e9-430a-851a-f45a99dd8df6 tempest-VolumesGetTest-1631238581 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:00:54 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-593512d2-d2e9-430a-851a-f45a99dd8df6 tempest-VolumesGetTest-1631238581 None] Deleted volume successfully. Sep 04 18:00:54 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-593512d2-d2e9-430a-851a-f45a99dd8df6 tempest-VolumesGetTest-1631238581 None] Lock "cinder-0dffd873-4b4a-4a5f-b714-f9e23bf81226-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:00:54 devstack sudo[100169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d744ab4f-8fa4-4f5e-9f92-2999f25263a9 Sep 04 18:00:54 devstack sudo[100169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:00:54 devstack sudo[100169]: pam_unix(sudo:session): session closed for user root Sep 04 18:00:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f54ae46a-5d19-4d15-b6dd-d52cf2493a47 tempest-VolumesGetTest-1631238581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d744ab4f-8fa4-4f5e-9f92-2999f25263a9" returned: 0 in 0.423s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:00:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f54ae46a-5d19-4d15-b6dd-d52cf2493a47 tempest-VolumesGetTest-1631238581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d744ab4f-8fa4-4f5e-9f92-2999f25263a9 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:00:54 devstack sudo[100174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d744ab4f-8fa4-4f5e-9f92-2999f25263a9 Sep 04 18:00:54 devstack sudo[100174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:00:54 devstack sudo[100174]: pam_unix(sudo:session): session closed for user root Sep 04 18:00:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f54ae46a-5d19-4d15-b6dd-d52cf2493a47 tempest-VolumesGetTest-1631238581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d744ab4f-8fa4-4f5e-9f92-2999f25263a9" returned: 0 in 0.272s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:00:54 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f54ae46a-5d19-4d15-b6dd-d52cf2493a47 tempest-VolumesGetTest-1631238581 None] Lock "cinder-quobyte-d744ab4f-8fa4-4f5e-9f92-2999f25263a9" released by "delete_volume" :: held 0.745s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:00:54 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-f54ae46a-5d19-4d15-b6dd-d52cf2493a47 tempest-VolumesGetTest-1631238581 None] Created reservations ['c284b5ed-655d-4d07-b04e-64da7f324587', '3fed65b3-517d-4180-974d-59c487f38f62', '9c9353fd-e1b0-4d93-b23e-db3f37c01ead', 'bc3c7321-d943-4296-972d-3cfeaaeaff5c'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:00:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f54ae46a-5d19-4d15-b6dd-d52cf2493a47 tempest-VolumesGetTest-1631238581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:00:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f54ae46a-5d19-4d15-b6dd-d52cf2493a47 tempest-VolumesGetTest-1631238581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:00:54 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f54ae46a-5d19-4d15-b6dd-d52cf2493a47 tempest-VolumesGetTest-1631238581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:00:54 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f54ae46a-5d19-4d15-b6dd-d52cf2493a47 tempest-VolumesGetTest-1631238581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:00:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f54ae46a-5d19-4d15-b6dd-d52cf2493a47 tempest-VolumesGetTest-1631238581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:00:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f54ae46a-5d19-4d15-b6dd-d52cf2493a47 tempest-VolumesGetTest-1631238581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:00:55 devstack sudo[100177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:00:55 devstack sudo[100177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:00:55 devstack sudo[100177]: pam_unix(sudo:session): session closed for user root Sep 04 18:00:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f54ae46a-5d19-4d15-b6dd-d52cf2493a47 tempest-VolumesGetTest-1631238581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.289s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:00:55 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-f54ae46a-5d19-4d15-b6dd-d52cf2493a47 tempest-VolumesGetTest-1631238581 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:00:55 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-f54ae46a-5d19-4d15-b6dd-d52cf2493a47 tempest-VolumesGetTest-1631238581 None] Deleted volume successfully. Sep 04 18:00:55 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f54ae46a-5d19-4d15-b6dd-d52cf2493a47 tempest-VolumesGetTest-1631238581 None] Lock "cinder-d744ab4f-8fa4-4f5e-9f92-2999f25263a9-delete_volume" released by "delete_volume" :: held 1.286s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:00:55 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-1446a3c8-9d93-4bb4-bf61-c7309285b280 tempest-VolumesGetTest-1631238581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:00:55 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1446a3c8-9d93-4bb4-bf61-c7309285b280 tempest-VolumesGetTest-1631238581 None] Flow 'volume_create_manager' (e6931b27-b8a7-4e73-9b4c-1d582291125d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:00:55 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1446a3c8-9d93-4bb4-bf61-c7309285b280 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34376e87-1fc0-4677-972d-c5a5f2107ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:00:55 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1446a3c8-9d93-4bb4-bf61-c7309285b280 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34376e87-1fc0-4677-972d-c5a5f2107ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:00:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1126006217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c21d9bc7-55b5-4e4f-a24a-d61cca246c13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c96efde19cc4123b29949f3f26b23f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:00:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:00:56Z,use_quota=True,user_id='28d5b941a873423aad147810bdefc056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:00:55 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1446a3c8-9d93-4bb4-bf61-c7309285b280 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2feb17fd-8996-4026-ad21-f5d355ec5466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:00:55 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1446a3c8-9d93-4bb4-bf61-c7309285b280 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2feb17fd-8996-4026-ad21-f5d355ec5466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:00:55 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1446a3c8-9d93-4bb4-bf61-c7309285b280 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fef41a88-f52a-426e-b538-f50917937553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:00:55 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1446a3c8-9d93-4bb4-bf61-c7309285b280 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fef41a88-f52a-426e-b538-f50917937553) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c21d9bc7-55b5-4e4f-a24a-d61cca246c13', 'volume_name': 'volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:00:55 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1446a3c8-9d93-4bb4-bf61-c7309285b280 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99ad47a0-da84-4c39-860a-7a77566d2d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:00:55 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1446a3c8-9d93-4bb4-bf61-c7309285b280 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99ad47a0-da84-4c39-860a-7a77566d2d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:00:55 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1446a3c8-9d93-4bb4-bf61-c7309285b280 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d21eba4-4b3d-4a3b-a714-c320c097aaf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:00:55 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-1446a3c8-9d93-4bb4-bf61-c7309285b280 tempest-VolumesGetTest-1631238581 None] Volume c21d9bc7-55b5-4e4f-a24a-d61cca246c13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13', 'volume_size': 1} Sep 04 18:00:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1446a3c8-9d93-4bb4-bf61-c7309285b280 tempest-VolumesGetTest-1631238581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:00:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1446a3c8-9d93-4bb4-bf61-c7309285b280 tempest-VolumesGetTest-1631238581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:00:55 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-1446a3c8-9d93-4bb4-bf61-c7309285b280 tempest-VolumesGetTest-1631238581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:00:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1126006217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c21d9bc7-55b5-4e4f-a24a-d61cca246c13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c96efde19cc4123b29949f3f26b23f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:00:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:00:56Z,use_quota=True,user_id='28d5b941a873423aad147810bdefc056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:00:55 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-1446a3c8-9d93-4bb4-bf61-c7309285b280 tempest-VolumesGetTest-1631238581 None] Creating volume c21d9bc7-55b5-4e4f-a24a-d61cca246c13 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:00:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1446a3c8-9d93-4bb4-bf61-c7309285b280 tempest-VolumesGetTest-1631238581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:00:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1446a3c8-9d93-4bb4-bf61-c7309285b280 tempest-VolumesGetTest-1631238581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:00:55 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-1446a3c8-9d93-4bb4-bf61-c7309285b280 tempest-VolumesGetTest-1631238581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:00:55 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-1446a3c8-9d93-4bb4-bf61-c7309285b280 tempest-VolumesGetTest-1631238581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:00:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1446a3c8-9d93-4bb4-bf61-c7309285b280 tempest-VolumesGetTest-1631238581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:00:55 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-1446a3c8-9d93-4bb4-bf61-c7309285b280 tempest-VolumesGetTest-1631238581 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:00:55 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-1446a3c8-9d93-4bb4-bf61-c7309285b280 tempest-VolumesGetTest-1631238581 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:00:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1446a3c8-9d93-4bb4-bf61-c7309285b280 tempest-VolumesGetTest-1631238581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:00:55 devstack sudo[100180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13 1073741824 Sep 04 18:00:55 devstack sudo[100180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:00:55 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:00:55 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] Flow 'volume_create_manager' (67184918-7320-4385-b7f4-69c6f7e599ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:00:55 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (681157ac-2058-43dd-91ae-0d3db3be529c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:00:55 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (681157ac-2058-43dd-91ae-0d3db3be529c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:00:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad9f97cb-1830-4013-adb2-07a253f97e1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9b2bb0c34df4461a307a542ab3f4872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:00:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:00:56Z,use_quota=True,user_id='6b583ed80546480fad6f77970117f3a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:00:55 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d1452cc-245b-4564-9eb7-0cc225fb01db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:00:55 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d1452cc-245b-4564-9eb7-0cc225fb01db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:00:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b542c0dd-321e-48e4-8498-5282589863bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:00:56 devstack cinder-volume[87314]: DEBUG cinder.image.glance [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] Creating Keystone auth plugin from conf {{(pid=87314) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 04 18:00:56 devstack sudo[100180]: pam_unix(sudo:session): session closed for user root Sep 04 18:00:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1446a3c8-9d93-4bb4-bf61-c7309285b280 tempest-VolumesGetTest-1631238581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13 1073741824" returned: 0 in 0.475s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:00:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1446a3c8-9d93-4bb4-bf61-c7309285b280 tempest-VolumesGetTest-1631238581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:00:56 devstack sudo[100186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13 Sep 04 18:00:56 devstack sudo[100186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:00:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b542c0dd-321e-48e4-8498-5282589863bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ad9f97cb-1830-4013-adb2-07a253f97e1f', 'volume_name': 'volume-ad9f97cb-1830-4013-adb2-07a253f97e1f', 'volume_size': 1, 'image_id': '8778e3ff-3119-49b8-ae74-9bd519aeb39d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8778e3ff-3119-49b8-ae74-9bd519aeb39d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ccec62ec5b30739e84c05bfe764c88c9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a9b2bb0c34df4461a307a542ab3f4872', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1a80ce00afe94dabcacd4a06cbaedbc14372ecf6f376287c46816577da0f67114b16fded8a286f7298592171985539c66f8b190d59dd5714b376ae9874c2ef84', 'id': '8778e3ff-3119-49b8-ae74-9bd519aeb39d', 'created_at': datetime.datetime(2026, 9, 4, 16, 0, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 16, 0, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8778e3ff-3119-49b8-ae74-9bd519aeb39d/file', 'properties': {}}, 'image_service': }' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:00:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff41cfa1-a656-4a80-a7c3-b83ab8dd955c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:00:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff41cfa1-a656-4a80-a7c3-b83ab8dd955c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:00:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61d72c30-740c-4f57-8867-fc63ad06bf4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:00:56 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] Volume ad9f97cb-1830-4013-adb2-07a253f97e1f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ad9f97cb-1830-4013-adb2-07a253f97e1f', 'volume_size': 1, 'image_id': '8778e3ff-3119-49b8-ae74-9bd519aeb39d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8778e3ff-3119-49b8-ae74-9bd519aeb39d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ccec62ec5b30739e84c05bfe764c88c9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a9b2bb0c34df4461a307a542ab3f4872', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1a80ce00afe94dabcacd4a06cbaedbc14372ecf6f376287c46816577da0f67114b16fded8a286f7298592171985539c66f8b190d59dd5714b376ae9874c2ef84', 'id': '8778e3ff-3119-49b8-ae74-9bd519aeb39d', 'created_at': datetime.datetime(2026, 9, 4, 16, 0, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 16, 0, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8778e3ff-3119-49b8-ae74-9bd519aeb39d/file', 'properties': {}}, 'image_service': } Sep 04 18:00:56 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] Trying to clone ad9f97cb-1830-4013-adb2-07a253f97e1f from image 8778e3ff-3119-49b8-ae74-9bd519aeb39d at location (None, [{'url': 'file:///opt/stack/data/glance/images/8778e3ff-3119-49b8-ae74-9bd519aeb39d', 'metadata': {}}]). {{(pid=87314) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 04 18:00:56 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-20cc8e5a-6824-4e78-843f-75b3b3a36ffa tempest-VolumesCloneTest-1205215503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:00:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-20cc8e5a-6824-4e78-843f-75b3b3a36ffa tempest-VolumesCloneTest-1205215503 None] Flow 'volume_create_manager' (5aa63d70-a48a-4d8a-be46-2f7f0e6f0b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:00:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-20cc8e5a-6824-4e78-843f-75b3b3a36ffa tempest-VolumesCloneTest-1205215503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5349f3ce-c9f0-48b5-add6-f2c69483cf71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:00:56 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8778e3ff-3119-49b8-ae74-9bd519aeb39d_wd5qqc19devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87314) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 04 18:00:56 devstack cinder-volume[87314]: INFO cinder.image.image_utils [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] Image download 0.00 MB at 0.00 MB/s Sep 04 18:00:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-20cc8e5a-6824-4e78-843f-75b3b3a36ffa tempest-VolumesCloneTest-1205215503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5349f3ce-c9f0-48b5-add6-f2c69483cf71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:00:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1198055727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02f74e18-6aa7-4ec6-8fae-d74ce650d60a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='427f22805b504def936737f6bea1dfdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:00:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:00:56Z,use_quota=True,user_id='b1c9d60449d146eda541bdd338ed193f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:00:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-20cc8e5a-6824-4e78-843f-75b3b3a36ffa tempest-VolumesCloneTest-1205215503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f91cd398-f62a-44c1-8fc3-03395a8b4a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:00:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-20cc8e5a-6824-4e78-843f-75b3b3a36ffa tempest-VolumesCloneTest-1205215503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f91cd398-f62a-44c1-8fc3-03395a8b4a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:00:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-20cc8e5a-6824-4e78-843f-75b3b3a36ffa tempest-VolumesCloneTest-1205215503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26a823b1-c1e3-4e60-8500-7a11a85e66e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:00:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-20cc8e5a-6824-4e78-843f-75b3b3a36ffa tempest-VolumesCloneTest-1205215503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26a823b1-c1e3-4e60-8500-7a11a85e66e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02f74e18-6aa7-4ec6-8fae-d74ce650d60a', 'volume_name': 'volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:00:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-20cc8e5a-6824-4e78-843f-75b3b3a36ffa tempest-VolumesCloneTest-1205215503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b3c8473-7e86-494e-86a5-27e2ff0f0469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:00:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-20cc8e5a-6824-4e78-843f-75b3b3a36ffa tempest-VolumesCloneTest-1205215503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b3c8473-7e86-494e-86a5-27e2ff0f0469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:00:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-20cc8e5a-6824-4e78-843f-75b3b3a36ffa tempest-VolumesCloneTest-1205215503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cb8668a-b9ab-466a-a361-292f834883a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:00:56 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-20cc8e5a-6824-4e78-843f-75b3b3a36ffa tempest-VolumesCloneTest-1205215503 None] Volume 02f74e18-6aa7-4ec6-8fae-d74ce650d60a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a', 'volume_size': 1} Sep 04 18:00:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-20cc8e5a-6824-4e78-843f-75b3b3a36ffa tempest-VolumesCloneTest-1205215503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:00:56 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d35bdb-cca5-465d-a804-963947556497]: (4, 'raw') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:00:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8778e3ff-3119-49b8-ae74-9bd519aeb39d_wd5qqc19devstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:00:56 devstack sudo[100186]: pam_unix(sudo:session): session closed for user root Sep 04 18:00:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1446a3c8-9d93-4bb4-bf61-c7309285b280 tempest-VolumesGetTest-1631238581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13" returned: 0 in 0.294s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:00:56 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-1446a3c8-9d93-4bb4-bf61-c7309285b280 tempest-VolumesGetTest-1631238581 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:00:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1446a3c8-9d93-4bb4-bf61-c7309285b280 tempest-VolumesGetTest-1631238581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:00:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-20cc8e5a-6824-4e78-843f-75b3b3a36ffa tempest-VolumesCloneTest-1205215503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.056s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:00:56 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-20cc8e5a-6824-4e78-843f-75b3b3a36ffa tempest-VolumesCloneTest-1205215503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:00:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1198055727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02f74e18-6aa7-4ec6-8fae-d74ce650d60a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='427f22805b504def936737f6bea1dfdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:00:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:00:56Z,use_quota=True,user_id='b1c9d60449d146eda541bdd338ed193f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:00:56 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-20cc8e5a-6824-4e78-843f-75b3b3a36ffa tempest-VolumesCloneTest-1205215503 None] Creating volume 02f74e18-6aa7-4ec6-8fae-d74ce650d60a {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:00:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-20cc8e5a-6824-4e78-843f-75b3b3a36ffa tempest-VolumesCloneTest-1205215503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:00:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-20cc8e5a-6824-4e78-843f-75b3b3a36ffa tempest-VolumesCloneTest-1205215503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:00:56 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-20cc8e5a-6824-4e78-843f-75b3b3a36ffa tempest-VolumesCloneTest-1205215503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:00:56 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-20cc8e5a-6824-4e78-843f-75b3b3a36ffa tempest-VolumesCloneTest-1205215503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:00:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-20cc8e5a-6824-4e78-843f-75b3b3a36ffa tempest-VolumesCloneTest-1205215503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:00:56 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-20cc8e5a-6824-4e78-843f-75b3b3a36ffa tempest-VolumesCloneTest-1205215503 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:00:56 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-20cc8e5a-6824-4e78-843f-75b3b3a36ffa tempest-VolumesCloneTest-1205215503 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:00:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-20cc8e5a-6824-4e78-843f-75b3b3a36ffa tempest-VolumesCloneTest-1205215503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:00:56 devstack sudo[100190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a 1073741824 Sep 04 18:00:56 devstack sudo[100190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:00:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1446a3c8-9d93-4bb4-bf61-c7309285b280 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d21eba4-4b3d-4a3b-a714-c320c097aaf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:00:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1446a3c8-9d93-4bb4-bf61-c7309285b280 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ac626da-2bfd-4c7c-926d-ddb2fc70a94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:00:56 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-1446a3c8-9d93-4bb4-bf61-c7309285b280 tempest-VolumesGetTest-1631238581 None] Volume volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13 (c21d9bc7-55b5-4e4f-a24a-d61cca246c13): created successfully Sep 04 18:00:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1446a3c8-9d93-4bb4-bf61-c7309285b280 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ac626da-2bfd-4c7c-926d-ddb2fc70a94c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:00:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1446a3c8-9d93-4bb4-bf61-c7309285b280 tempest-VolumesGetTest-1631238581 None] Flow 'volume_create_manager' (e6931b27-b8a7-4e73-9b4c-1d582291125d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:00:56 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-1446a3c8-9d93-4bb4-bf61-c7309285b280 tempest-VolumesGetTest-1631238581 None] Created volume successfully. Sep 04 18:00:56 devstack sudo[100189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8778e3ff-3119-49b8-ae74-9bd519aeb39d_wd5qqc19devstack@QuobyteHD Sep 04 18:00:56 devstack sudo[100189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:00:56 devstack sudo[100189]: pam_unix(sudo:session): session closed for user root Sep 04 18:00:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8778e3ff-3119-49b8-ae74-9bd519aeb39d_wd5qqc19devstack@QuobyteHD" returned: 0 in 0.378s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:00:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8778e3ff-3119-49b8-ae74-9bd519aeb39d_wd5qqc19devstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:00:57 devstack sudo[100190]: pam_unix(sudo:session): session closed for user root Sep 04 18:00:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-20cc8e5a-6824-4e78-843f-75b3b3a36ffa tempest-VolumesCloneTest-1205215503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a 1073741824" returned: 0 in 0.419s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:00:57 devstack sudo[100198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8778e3ff-3119-49b8-ae74-9bd519aeb39d_wd5qqc19devstack@QuobyteHD Sep 04 18:00:57 devstack sudo[100198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:00:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-20cc8e5a-6824-4e78-843f-75b3b3a36ffa tempest-VolumesCloneTest-1205215503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:00:57 devstack sudo[100200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a Sep 04 18:00:57 devstack sudo[100200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:00:57 devstack sudo[100198]: pam_unix(sudo:session): session closed for user root Sep 04 18:00:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8778e3ff-3119-49b8-ae74-9bd519aeb39d_wd5qqc19devstack@QuobyteHD" returned: 1 in 0.323s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:00:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8778e3ff-3119-49b8-ae74-9bd519aeb39d_wd5qqc19devstack@QuobyteHD' failed. Not Retrying. {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 18:00:57 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] Temporary image 8778e3ff-3119-49b8-ae74-9bd519aeb39d is fetched for user 6b583ed80546480fad6f77970117f3a2. {{(pid=87314) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 04 18:00:57 devstack sudo[100200]: pam_unix(sudo:session): session closed for user root Sep 04 18:00:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-20cc8e5a-6824-4e78-843f-75b3b3a36ffa tempest-VolumesCloneTest-1205215503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a" returned: 0 in 0.251s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:00:57 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-20cc8e5a-6824-4e78-843f-75b3b3a36ffa tempest-VolumesCloneTest-1205215503 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:00:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-20cc8e5a-6824-4e78-843f-75b3b3a36ffa tempest-VolumesCloneTest-1205215503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.716s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:00:57 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-20cc8e5a-6824-4e78-843f-75b3b3a36ffa tempest-VolumesCloneTest-1205215503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cb8668a-b9ab-466a-a361-292f834883a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:00:57 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-20cc8e5a-6824-4e78-843f-75b3b3a36ffa tempest-VolumesCloneTest-1205215503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d7f7bf3-6e0a-4287-99e7-5acd0cca8640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:00:57 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec227cdb-ff1a-49c5-8113-cb8c8281a646]: (4, 'raw') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:00:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8778e3ff-3119-49b8-ae74-9bd519aeb39d_wd5qqc19devstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:00:57 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-20cc8e5a-6824-4e78-843f-75b3b3a36ffa tempest-VolumesCloneTest-1205215503 None] Volume volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a (02f74e18-6aa7-4ec6-8fae-d74ce650d60a): created successfully Sep 04 18:00:57 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-20cc8e5a-6824-4e78-843f-75b3b3a36ffa tempest-VolumesCloneTest-1205215503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d7f7bf3-6e0a-4287-99e7-5acd0cca8640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:00:57 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-20cc8e5a-6824-4e78-843f-75b3b3a36ffa tempest-VolumesCloneTest-1205215503 None] Flow 'volume_create_manager' (5aa63d70-a48a-4d8a-be46-2f7f0e6f0b47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:00:57 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-20cc8e5a-6824-4e78-843f-75b3b3a36ffa tempest-VolumesCloneTest-1205215503 None] Created volume successfully. Sep 04 18:00:57 devstack sudo[100206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8778e3ff-3119-49b8-ae74-9bd519aeb39d_wd5qqc19devstack@QuobyteHD Sep 04 18:00:57 devstack sudo[100206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:00:57 devstack sudo[100206]: pam_unix(sudo:session): session closed for user root Sep 04 18:00:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8778e3ff-3119-49b8-ae74-9bd519aeb39d_wd5qqc19devstack@QuobyteHD" returned: 0 in 0.327s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:00:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8778e3ff-3119-49b8-ae74-9bd519aeb39d_wd5qqc19devstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:00:57 devstack sudo[100210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8778e3ff-3119-49b8-ae74-9bd519aeb39d_wd5qqc19devstack@QuobyteHD Sep 04 18:00:57 devstack sudo[100210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:00:58 devstack sudo[100210]: pam_unix(sudo:session): session closed for user root Sep 04 18:00:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8778e3ff-3119-49b8-ae74-9bd519aeb39d_wd5qqc19devstack@QuobyteHD" returned: 1 in 0.336s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:00:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8778e3ff-3119-49b8-ae74-9bd519aeb39d_wd5qqc19devstack@QuobyteHD' failed. Not Retrying. {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 18:00:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:00:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:00:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:00:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad9f97cb-1830-4013-adb2-07a253f97e1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9b2bb0c34df4461a307a542ab3f4872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:00:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:00:56Z,use_quota=True,user_id='6b583ed80546480fad6f77970117f3a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:00:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] Creating volume ad9f97cb-1830-4013-adb2-07a253f97e1f {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:00:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:00:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:00:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:00:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:00:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:00:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:00:58 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:00:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ad9f97cb-1830-4013-adb2-07a253f97e1f 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:00:58 devstack sudo[100215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ad9f97cb-1830-4013-adb2-07a253f97e1f 1073741824 Sep 04 18:00:58 devstack sudo[100215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:00:58 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:00:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] Flow 'volume_create_manager' (0a2abe07-806a-41b2-9755-dca63fb2ca00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:00:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee12d030-bb53-491f-ab65-19d5c7db54f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:00:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee12d030-bb53-491f-ab65-19d5c7db54f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:00:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-743913686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=018838dd-c6b0-4bed-aa57-46bb73ffb4e0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2c96efde19cc4123b29949f3f26b23f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:00:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=c21d9bc7-55b5-4e4f-a24a-d61cca246c13,status='creating',terminated_at=None,updated_at=2026-09-04T16:00:58Z,use_quota=True,user_id='28d5b941a873423aad147810bdefc056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:00:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c12cd6fa-19d3-4762-820f-80b232f91f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:00:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c12cd6fa-19d3-4762-820f-80b232f91f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:00:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d628125-a278-4835-a0ec-abb97644a868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:00:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d628125-a278-4835-a0ec-abb97644a868) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '018838dd-c6b0-4bed-aa57-46bb73ffb4e0', 'volume_name': 'volume-018838dd-c6b0-4bed-aa57-46bb73ffb4e0', 'volume_size': 1, 'source_volid': 'c21d9bc7-55b5-4e4f-a24a-d61cca246c13', 'source_volstatus': 'available'}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:00:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d520402-b74f-420c-bf05-69714ccabe36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:00:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d520402-b74f-420c-bf05-69714ccabe36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:00:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a87a575c-4a40-4299-8135-230ad4411c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:00:58 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] Volume 018838dd-c6b0-4bed-aa57-46bb73ffb4e0: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-018838dd-c6b0-4bed-aa57-46bb73ffb4e0', 'volume_size': 1, 'source_volid': 'c21d9bc7-55b5-4e4f-a24a-d61cca246c13', 'source_volstatus': 'available'} Sep 04 18:00:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:00:58 devstack sudo[100215]: pam_unix(sudo:session): session closed for user root Sep 04 18:00:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ad9f97cb-1830-4013-adb2-07a253f97e1f 1073741824" returned: 0 in 0.434s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:00:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ad9f97cb-1830-4013-adb2-07a253f97e1f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:00:58 devstack sudo[100220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ad9f97cb-1830-4013-adb2-07a253f97e1f Sep 04 18:00:58 devstack sudo[100220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:00:58 devstack sudo[100220]: pam_unix(sudo:session): session closed for user root Sep 04 18:00:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ad9f97cb-1830-4013-adb2-07a253f97e1f" returned: 0 in 0.265s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:00:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:00:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:00:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.402s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:00:58 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] Cloning volume c21d9bc7-55b5-4e4f-a24a-d61cca246c13 to volume 018838dd-c6b0-4bed-aa57-46bb73ffb4e0 Sep 04 18:00:58 devstack cinder-volume[87314]: DEBUG cinder.volume.volume_utils [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] Attempting download of 8778e3ff-3119-49b8-ae74-9bd519aeb39d ((None, [{'url': 'file:///opt/stack/data/glance/images/8778e3ff-3119-49b8-ae74-9bd519aeb39d', 'metadata': {}}])) to volume ad9f97cb-1830-4013-adb2-07a253f97e1f. {{(pid=87314) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 04 18:00:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] Creating offline snapshot 56cede85-64cd-4384-a14d-376faa995cbe of volume c21d9bc7-55b5-4e4f-a24a-d61cca246c13 {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 18:00:58 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c2ae76-505b-4263-b1f1-7c6b62bea647]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:00:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:00:58 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec4d1ff4-2ef3-4abd-8dd3-eb89e19c3c20]: (4, 'raw') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:00:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8778e3ff-3119-49b8-ae74-9bd519aeb39d_5a288yky {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:00:59 devstack sudo[100223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13 Sep 04 18:00:59 devstack sudo[100223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:00:59 devstack sudo[100224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8778e3ff-3119-49b8-ae74-9bd519aeb39d_5a288yky Sep 04 18:00:59 devstack sudo[100224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:00:59 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:00:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] Flow 'volume_create_manager' (b16e1993-146e-44b9-9207-10e5caadc16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:00:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34fc79a7-ab07-4be5-92e1-ed57a0e55e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:00:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34fc79a7-ab07-4be5-92e1-ed57a0e55e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:00:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1770017851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da4bfbbb-6d02-4021-b931-af907c8dd01b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='427f22805b504def936737f6bea1dfdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:00:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=02f74e18-6aa7-4ec6-8fae-d74ce650d60a,status='creating',terminated_at=None,updated_at=2026-09-04T16:00:59Z,use_quota=True,user_id='b1c9d60449d146eda541bdd338ed193f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:00:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78e9b703-e251-49f3-bd5f-bc7bb8cd8b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:00:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78e9b703-e251-49f3-bd5f-bc7bb8cd8b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:00:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27397bc0-2cd4-49c5-9f9f-b13bcb6707c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:00:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27397bc0-2cd4-49c5-9f9f-b13bcb6707c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'da4bfbbb-6d02-4021-b931-af907c8dd01b', 'volume_name': 'volume-da4bfbbb-6d02-4021-b931-af907c8dd01b', 'volume_size': 2, 'source_volid': '02f74e18-6aa7-4ec6-8fae-d74ce650d60a', 'source_volstatus': 'available'}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:00:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (206a2e13-6f41-47f5-92ac-253494df4a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:00:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (206a2e13-6f41-47f5-92ac-253494df4a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:00:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (313059a4-adc6-491b-b50a-0c4c96076abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:00:59 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] Volume da4bfbbb-6d02-4021-b931-af907c8dd01b: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-da4bfbbb-6d02-4021-b931-af907c8dd01b', 'volume_size': 2, 'source_volid': '02f74e18-6aa7-4ec6-8fae-d74ce650d60a', 'source_volstatus': 'available'} Sep 04 18:00:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:00:59 devstack sudo[100224]: pam_unix(sudo:session): session closed for user root Sep 04 18:00:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8778e3ff-3119-49b8-ae74-9bd519aeb39d_5a288yky" returned: 0 in 0.373s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:00:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8778e3ff-3119-49b8-ae74-9bd519aeb39d_5a288yky {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:00:59 devstack sudo[100223]: pam_unix(sudo:session): session closed for user root Sep 04 18:00:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13" returned: 0 in 0.410s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:00:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13.56cede85-64cd-4384-a14d-376faa995cbe 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:00:59 devstack sudo[100233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13.56cede85-64cd-4384-a14d-376faa995cbe 1G Sep 04 18:00:59 devstack sudo[100233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:00:59 devstack sudo[100232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8778e3ff-3119-49b8-ae74-9bd519aeb39d_5a288yky Sep 04 18:00:59 devstack sudo[100232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:00:59 devstack sudo[100232]: pam_unix(sudo:session): session closed for user root Sep 04 18:00:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8778e3ff-3119-49b8-ae74-9bd519aeb39d_5a288yky" returned: 1 in 0.362s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:00:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8778e3ff-3119-49b8-ae74-9bd519aeb39d_5a288yky' failed. Not Retrying. {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 18:00:59 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37292ae-1bc5-4d40-9c74-c78a9c3c12f9]: (4, 'raw') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:00:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8778e3ff-3119-49b8-ae74-9bd519aeb39d_wd5qqc19devstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:00:59 devstack sudo[100233]: pam_unix(sudo:session): session closed for user root Sep 04 18:00:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13.56cede85-64cd-4384-a14d-376faa995cbe 1G" returned: 0 in 0.415s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:00:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13 -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13.56cede85-64cd-4384-a14d-376faa995cbe {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:00:59 devstack sudo[100243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13 -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13.56cede85-64cd-4384-a14d-376faa995cbe Sep 04 18:00:59 devstack sudo[100243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:00:59 devstack sudo[100242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8778e3ff-3119-49b8-ae74-9bd519aeb39d_wd5qqc19devstack@QuobyteHD Sep 04 18:00:59 devstack sudo[100242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:00 devstack sudo[100242]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8778e3ff-3119-49b8-ae74-9bd519aeb39d_wd5qqc19devstack@QuobyteHD" returned: 0 in 0.343s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8778e3ff-3119-49b8-ae74-9bd519aeb39d_wd5qqc19devstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:00 devstack sudo[100243]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13 -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13.56cede85-64cd-4384-a14d-376faa995cbe" returned: 0 in 0.327s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:00 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13.56cede85-64cd-4384-a14d-376faa995cbe is being set with open permissions: ugo+rw Sep 04 18:01:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13.56cede85-64cd-4384-a14d-376faa995cbe {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:00 devstack sudo[100252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13.56cede85-64cd-4384-a14d-376faa995cbe Sep 04 18:01:00 devstack sudo[100252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:00 devstack sudo[100251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8778e3ff-3119-49b8-ae74-9bd519aeb39d_wd5qqc19devstack@QuobyteHD Sep 04 18:01:00 devstack sudo[100251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:00 devstack sudo[100252]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13.56cede85-64cd-4384-a14d-376faa995cbe" returned: 0 in 0.290s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:00 devstack sudo[100251]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8778e3ff-3119-49b8-ae74-9bd519aeb39d_wd5qqc19devstack@QuobyteHD" returned: 1 in 0.358s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8778e3ff-3119-49b8-ae74-9bd519aeb39d_wd5qqc19devstack@QuobyteHD' failed. Not Retrying. {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 18:01:00 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] 8778e3ff-3119-49b8-ae74-9bd519aeb39d was raw, converting to qcow2 {{(pid=87314) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 04 18:01:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8778e3ff-3119-49b8-ae74-9bd519aeb39d_wd5qqc19devstack@QuobyteHD /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ad9f97cb-1830-4013-adb2-07a253f97e1f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:00 devstack sudo[100266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8778e3ff-3119-49b8-ae74-9bd519aeb39d_wd5qqc19devstack@QuobyteHD /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ad9f97cb-1830-4013-adb2-07a253f97e1f Sep 04 18:01:00 devstack sudo[100266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:00 devstack sudo[100267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13.info Sep 04 18:01:00 devstack sudo[100267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:00 devstack sudo[100267]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13.info" returned: 0 in 0.297s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:00 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13.info is being set with open permissions: ugo+rw Sep 04 18:01:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:00 devstack sudo[100274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13.info Sep 04 18:01:00 devstack sudo[100274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:00 devstack sudo[100266]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8778e3ff-3119-49b8-ae74-9bd519aeb39d_wd5qqc19devstack@QuobyteHD /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ad9f97cb-1830-4013-adb2-07a253f97e1f" returned: 0 in 0.470s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:00 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8778e3ff-3119-49b8-ae74-9bd519aeb39d_wd5qqc19devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ad9f97cb-1830-4013-adb2-07a253f97e1f {{(pid=87314) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 18:01:00 devstack cinder-volume[87314]: INFO cinder.image.image_utils [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] Converted 0.00 MB image at 0.00 MB/s Sep 04 18:01:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ad9f97cb-1830-4013-adb2-07a253f97e1f 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:00 devstack sudo[100277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ad9f97cb-1830-4013-adb2-07a253f97e1f 1G Sep 04 18:01:00 devstack sudo[100277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:00 devstack sudo[100274]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13.info" returned: 0 in 0.270s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:00 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] Acquiring lock "cinder-quobyte-018838dd-c6b0-4bed-aa57-46bb73ffb4e0" by "_copy_volume_from_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:01:00 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] Lock "cinder-quobyte-018838dd-c6b0-4bed-aa57-46bb73ffb4e0" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:01:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] snapshot: 56cede85-64cd-4384-a14d-376faa995cbe, volume: 018838dd-c6b0-4bed-aa57-46bb73ffb4e0, {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 04 18:01:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:01:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:01:01 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:01:01 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:01:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:01:01 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c99282f-ead8-404e-a601-8601d515d77d]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:01:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13.56cede85-64cd-4384-a14d-376faa995cbe {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:01 devstack sudo[100280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13.56cede85-64cd-4384-a14d-376faa995cbe Sep 04 18:01:01 devstack sudo[100280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:01 devstack sudo[100277]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ad9f97cb-1830-4013-adb2-07a253f97e1f 1G" returned: 0 in 0.379s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:01 devstack cinder-volume[87314]: DEBUG cinder.volume.volume_utils [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] Downloaded image 8778e3ff-3119-49b8-ae74-9bd519aeb39d ((None, [{'url': 'file:///opt/stack/data/glance/images/8778e3ff-3119-49b8-ae74-9bd519aeb39d', 'metadata': {}}])) to volume ad9f97cb-1830-4013-adb2-07a253f97e1f successfully. {{(pid=87314) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 04 18:01:01 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] Temporary image 8778e3ff-3119-49b8-ae74-9bd519aeb39d for user 6b583ed80546480fad6f77970117f3a2 is deleted. {{(pid=87314) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 04 18:01:01 devstack cinder-volume[87314]: DEBUG cinder.volume.volume_utils [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] Marking volume ad9f97cb-1830-4013-adb2-07a253f97e1f as bootable. {{(pid=87314) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 04 18:01:01 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] Copying metadata from image 8778e3ff-3119-49b8-ae74-9bd519aeb39d to ad9f97cb-1830-4013-adb2-07a253f97e1f. {{(pid=87314) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 04 18:01:01 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] Creating volume glance metadata for volume ad9f97cb-1830-4013-adb2-07a253f97e1f backed by image 8778e3ff-3119-49b8-ae74-9bd519aeb39d with: {'image_id': '8778e3ff-3119-49b8-ae74-9bd519aeb39d', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'ccec62ec5b30739e84c05bfe764c88c9', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87314) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 04 18:01:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61d72c30-740c-4f57-8867-fc63ad06bf4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad9f97cb-1830-4013-adb2-07a253f97e1f', 'volume_size': 1, 'image_id': '8778e3ff-3119-49b8-ae74-9bd519aeb39d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8778e3ff-3119-49b8-ae74-9bd519aeb39d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ccec62ec5b30739e84c05bfe764c88c9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a9b2bb0c34df4461a307a542ab3f4872', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1a80ce00afe94dabcacd4a06cbaedbc14372ecf6f376287c46816577da0f67114b16fded8a286f7298592171985539c66f8b190d59dd5714b376ae9874c2ef84', 'id': '8778e3ff-3119-49b8-ae74-9bd519aeb39d', 'created_at': datetime.datetime(2026, 9, 4, 16, 0, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 16, 0, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8778e3ff-3119-49b8-ae74-9bd519aeb39d/file', 'properties': {}}, 'image_service': }' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:01:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52dc3419-5e26-404c-967f-2a733ef5da8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:01:01 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] Volume volume-ad9f97cb-1830-4013-adb2-07a253f97e1f (ad9f97cb-1830-4013-adb2-07a253f97e1f): created successfully Sep 04 18:01:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52dc3419-5e26-404c-967f-2a733ef5da8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:01:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] Flow 'volume_create_manager' (67184918-7320-4385-b7f4-69c6f7e599ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:01:01 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-b35ff8f4-600a-4e1f-a991-01e2bba6e561 tempest-VolumeImageDependencyTests-1338262218 None] Created volume successfully. Sep 04 18:01:01 devstack sudo[100280]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13.56cede85-64cd-4384-a14d-376faa995cbe" returned: 0 in 0.431s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:01 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 18:01:01 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74f7235-d4a4-4055-9983-767b37068cf2]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:01:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:01 devstack sudo[100288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13 Sep 04 18:01:01 devstack sudo[100288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:01 devstack sudo[100288]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13" returned: 0 in 0.369s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:01 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13 {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 04 18:01:01 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] Creating direct copy from snapshot {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 04 18:01:01 devstack cinder-volume[87314]: DEBUG cinder.utils [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] Path /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-018838dd-c6b0-4bed-aa57-46bb73ffb4e0 not found in is_blk_device check {{(pid=87314) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 04 18:01:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-018838dd-c6b0-4bed-aa57-46bb73ffb4e0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:01 devstack sudo[100293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-018838dd-c6b0-4bed-aa57-46bb73ffb4e0 Sep 04 18:01:01 devstack sudo[100293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:02 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8ca60596-055a-4b9a-84cd-b0427cbcefbf tempest-VolumeImageDependencyTests-1338262218 None] Acquiring lock "cinder-ad9f97cb-1830-4013-adb2-07a253f97e1f-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:01:02 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8ca60596-055a-4b9a-84cd-b0427cbcefbf tempest-VolumeImageDependencyTests-1338262218 None] Lock "cinder-ad9f97cb-1830-4013-adb2-07a253f97e1f-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:01:02 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8ca60596-055a-4b9a-84cd-b0427cbcefbf tempest-VolumeImageDependencyTests-1338262218 None] Acquiring lock "cinder-quobyte-ad9f97cb-1830-4013-adb2-07a253f97e1f" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:01:02 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8ca60596-055a-4b9a-84cd-b0427cbcefbf tempest-VolumeImageDependencyTests-1338262218 None] Lock "cinder-quobyte-ad9f97cb-1830-4013-adb2-07a253f97e1f" acquired by "delete_volume" :: waited 0.067s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:01:02 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1c6040-4431-4dce-9622-9ef1a65f828e]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:01:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8ca60596-055a-4b9a-84cd-b0427cbcefbf tempest-VolumeImageDependencyTests-1338262218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ad9f97cb-1830-4013-adb2-07a253f97e1f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:02 devstack sudo[100307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ad9f97cb-1830-4013-adb2-07a253f97e1f Sep 04 18:01:02 devstack sudo[100307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:03 devstack sudo[100307]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8ca60596-055a-4b9a-84cd-b0427cbcefbf tempest-VolumeImageDependencyTests-1338262218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ad9f97cb-1830-4013-adb2-07a253f97e1f" returned: 0 in 0.735s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8ca60596-055a-4b9a-84cd-b0427cbcefbf tempest-VolumeImageDependencyTests-1338262218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ad9f97cb-1830-4013-adb2-07a253f97e1f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:03 devstack sudo[100313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ad9f97cb-1830-4013-adb2-07a253f97e1f Sep 04 18:01:03 devstack sudo[100313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:03 devstack sudo[100313]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8ca60596-055a-4b9a-84cd-b0427cbcefbf tempest-VolumeImageDependencyTests-1338262218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ad9f97cb-1830-4013-adb2-07a253f97e1f" returned: 0 in 0.503s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:04 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8ca60596-055a-4b9a-84cd-b0427cbcefbf tempest-VolumeImageDependencyTests-1338262218 None] Lock "cinder-quobyte-ad9f97cb-1830-4013-adb2-07a253f97e1f" released by "delete_volume" :: held 1.337s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:01:04 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-8ca60596-055a-4b9a-84cd-b0427cbcefbf tempest-VolumeImageDependencyTests-1338262218 None] Created reservations ['8dad6b66-34c7-417d-af72-3f28ef5efe55', 'a36109ec-0734-487b-9332-d1bffa87c6b9', '80de674b-580c-435d-ba0a-8645b2d9b6e9', '9508fcd0-e4c8-47c0-985a-c41a34b36d8c'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:01:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8ca60596-055a-4b9a-84cd-b0427cbcefbf tempest-VolumeImageDependencyTests-1338262218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:01:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8ca60596-055a-4b9a-84cd-b0427cbcefbf tempest-VolumeImageDependencyTests-1338262218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:01:04 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8ca60596-055a-4b9a-84cd-b0427cbcefbf tempest-VolumeImageDependencyTests-1338262218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:01:04 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8ca60596-055a-4b9a-84cd-b0427cbcefbf tempest-VolumeImageDependencyTests-1338262218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:01:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8ca60596-055a-4b9a-84cd-b0427cbcefbf tempest-VolumeImageDependencyTests-1338262218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:01:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8ca60596-055a-4b9a-84cd-b0427cbcefbf tempest-VolumeImageDependencyTests-1338262218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:04 devstack sudo[100317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:01:04 devstack sudo[100317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:04 devstack sudo[100317]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8ca60596-055a-4b9a-84cd-b0427cbcefbf tempest-VolumeImageDependencyTests-1338262218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.477s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:04 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-8ca60596-055a-4b9a-84cd-b0427cbcefbf tempest-VolumeImageDependencyTests-1338262218 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:01:04 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-8ca60596-055a-4b9a-84cd-b0427cbcefbf tempest-VolumeImageDependencyTests-1338262218 None] Deleted volume successfully. Sep 04 18:01:04 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8ca60596-055a-4b9a-84cd-b0427cbcefbf tempest-VolumeImageDependencyTests-1338262218 None] Lock "cinder-ad9f97cb-1830-4013-adb2-07a253f97e1f-delete_volume" released by "delete_volume" :: held 2.311s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:01:06 devstack sudo[100293]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-018838dd-c6b0-4bed-aa57-46bb73ffb4e0" returned: 0 in 4.800s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:06 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] Image conversion details: src /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13, size 1024.00 MB, duration 4.80 sec, destination /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-018838dd-c6b0-4bed-aa57-46bb73ffb4e0 {{(pid=87314) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 18:01:06 devstack cinder-volume[87314]: INFO cinder.image.image_utils [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] Converted 1024.00 MB image at 213.27 MB/s Sep 04 18:01:06 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-018838dd-c6b0-4bed-aa57-46bb73ffb4e0 is being set with open permissions: ugo+rw Sep 04 18:01:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-018838dd-c6b0-4bed-aa57-46bb73ffb4e0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:06 devstack sudo[100320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-018838dd-c6b0-4bed-aa57-46bb73ffb4e0 Sep 04 18:01:06 devstack sudo[100320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:06 devstack sudo[100320]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-018838dd-c6b0-4bed-aa57-46bb73ffb4e0" returned: 0 in 0.252s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:06 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] Lock "cinder-quobyte-018838dd-c6b0-4bed-aa57-46bb73ffb4e0" released by "_copy_volume_from_snapshot" :: held 5.930s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:01:06 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] Acquiring lock "cinder-quobyte-56cede85-64cd-4384-a14d-376faa995cbe" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:01:06 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] Lock "cinder-quobyte-56cede85-64cd-4384-a14d-376faa995cbe" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:01:06 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] Deleting offline snapshot 56cede85-64cd-4384-a14d-376faa995cbe of volume c21d9bc7-55b5-4e4f-a24a-d61cca246c13 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 18:01:06 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] snapshot_file for this snap is: volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13.56cede85-64cd-4384-a14d-376faa995cbe {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 18:01:06 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7e4164-cb6a-4ba7-a09d-c30dd8df4ce4]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:01:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13.56cede85-64cd-4384-a14d-376faa995cbe {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:07 devstack sudo[100323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13.56cede85-64cd-4384-a14d-376faa995cbe Sep 04 18:01:07 devstack sudo[100323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:07 devstack sudo[100323]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13.56cede85-64cd-4384-a14d-376faa995cbe" returned: 0 in 0.366s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:07 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 18:01:07 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[19353064-2f44-46a8-8c33-dfe79829924d]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:01:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:07 devstack sudo[100328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13 Sep 04 18:01:07 devstack sudo[100328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:07 devstack sudo[100328]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13" returned: 0 in 0.540s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13.56cede85-64cd-4384-a14d-376faa995cbe {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:07 devstack sudo[100333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13.56cede85-64cd-4384-a14d-376faa995cbe Sep 04 18:01:07 devstack sudo[100333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:08 devstack sudo[100333]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13.56cede85-64cd-4384-a14d-376faa995cbe" returned: 0 in 0.412s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13.56cede85-64cd-4384-a14d-376faa995cbe {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:08 devstack sudo[100340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13.56cede85-64cd-4384-a14d-376faa995cbe Sep 04 18:01:08 devstack sudo[100340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:08 devstack sudo[100340]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13.56cede85-64cd-4384-a14d-376faa995cbe" returned: 0 in 0.269s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:08 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] Lock "cinder-quobyte-56cede85-64cd-4384-a14d-376faa995cbe" released by "_delete_snapshot" :: held 1.681s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:01:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.861s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:01:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 9.463s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:01:08 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] Cloning volume 02f74e18-6aa7-4ec6-8fae-d74ce650d60a to volume da4bfbbb-6d02-4021-b931-af907c8dd01b Sep 04 18:01:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a87a575c-4a40-4299-8135-230ad4411c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-018838dd-c6b0-4bed-aa57-46bb73ffb4e0', 'volume_size': 1, 'source_volid': 'c21d9bc7-55b5-4e4f-a24a-d61cca246c13', 'source_volstatus': 'available'}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:01:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a37aef3c-12b8-4237-9196-ec607ba0a19c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:01:08 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] Volume volume-018838dd-c6b0-4bed-aa57-46bb73ffb4e0 (018838dd-c6b0-4bed-aa57-46bb73ffb4e0): created successfully Sep 04 18:01:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a37aef3c-12b8-4237-9196-ec607ba0a19c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:01:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] Flow 'volume_create_manager' (0a2abe07-806a-41b2-9755-dca63fb2ca00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:01:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] Creating offline snapshot 16bba32e-d9c5-4c61-a379-f42cc4361fab of volume 02f74e18-6aa7-4ec6-8fae-d74ce650d60a {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 18:01:08 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0f5fcc-1ef2-4e1c-887f-4513eb9bb428]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:01:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:08 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-796e4b2a-4c82-4cab-88fe-b1718f1b38f3 tempest-VolumesGetTest-1631238581 None] Created volume successfully. Sep 04 18:01:08 devstack sudo[100343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a Sep 04 18:01:08 devstack sudo[100343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:09 devstack sudo[100343]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a" returned: 0 in 0.369s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a.16bba32e-d9c5-4c61-a379-f42cc4361fab 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:09 devstack sudo[100348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a.16bba32e-d9c5-4c61-a379-f42cc4361fab 1G Sep 04 18:01:09 devstack sudo[100348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:09 devstack sudo[100348]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a.16bba32e-d9c5-4c61-a379-f42cc4361fab 1G" returned: 0 in 0.454s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a.16bba32e-d9c5-4c61-a379-f42cc4361fab {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:09 devstack sudo[100353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a.16bba32e-d9c5-4c61-a379-f42cc4361fab Sep 04 18:01:09 devstack sudo[100353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:09 devstack sudo[100353]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a.16bba32e-d9c5-4c61-a379-f42cc4361fab" returned: 0 in 0.350s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:09 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a.16bba32e-d9c5-4c61-a379-f42cc4361fab is being set with open permissions: ugo+rw Sep 04 18:01:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a.16bba32e-d9c5-4c61-a379-f42cc4361fab {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:09 devstack sudo[100358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a.16bba32e-d9c5-4c61-a379-f42cc4361fab Sep 04 18:01:09 devstack sudo[100358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:10 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dcd405d-0292-454a-a5f2-639f5555a4e4 tempest-VolumesGetTest-1631238581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:01:10 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1dcd405d-0292-454a-a5f2-639f5555a4e4 tempest-VolumesGetTest-1631238581 None] Flow 'volume_create_manager' (c3cb1898-99f4-4f2e-b275-2b6aadd0fd90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:01:10 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1dcd405d-0292-454a-a5f2-639f5555a4e4 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de323848-4fdd-4423-bbe9-347a5a356d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:01:10 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1dcd405d-0292-454a-a5f2-639f5555a4e4 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de323848-4fdd-4423-bbe9-347a5a356d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:01:10Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-892453512',display_name='tempest-VolumesGetTest-Volume-284196358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=247bd71f-2c44-4484-9ed4-3fc54ca9c90f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c96efde19cc4123b29949f3f26b23f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:01:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:01:10Z,use_quota=True,user_id='28d5b941a873423aad147810bdefc056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:01:10 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1dcd405d-0292-454a-a5f2-639f5555a4e4 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe1c9140-6719-4f62-99ad-4ce6db9953d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:01:10 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1dcd405d-0292-454a-a5f2-639f5555a4e4 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe1c9140-6719-4f62-99ad-4ce6db9953d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:01:10 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1dcd405d-0292-454a-a5f2-639f5555a4e4 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0401b63a-6ad8-48b6-bed3-4c29a871b73e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:01:10 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1dcd405d-0292-454a-a5f2-639f5555a4e4 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0401b63a-6ad8-48b6-bed3-4c29a871b73e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '247bd71f-2c44-4484-9ed4-3fc54ca9c90f', 'volume_name': 'volume-247bd71f-2c44-4484-9ed4-3fc54ca9c90f', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:01:10 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1dcd405d-0292-454a-a5f2-639f5555a4e4 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fa6824a-a249-4cbf-ab04-5618f18ea133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:01:10 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1dcd405d-0292-454a-a5f2-639f5555a4e4 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fa6824a-a249-4cbf-ab04-5618f18ea133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:01:10 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1dcd405d-0292-454a-a5f2-639f5555a4e4 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3a48038-90e1-410c-a2b1-8eb10bfe7f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:01:10 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-1dcd405d-0292-454a-a5f2-639f5555a4e4 tempest-VolumesGetTest-1631238581 None] Volume 247bd71f-2c44-4484-9ed4-3fc54ca9c90f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-247bd71f-2c44-4484-9ed4-3fc54ca9c90f', 'volume_size': 1} Sep 04 18:01:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1dcd405d-0292-454a-a5f2-639f5555a4e4 tempest-VolumesGetTest-1631238581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:01:10 devstack sudo[100358]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a.16bba32e-d9c5-4c61-a379-f42cc4361fab" returned: 0 in 0.278s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:10 devstack sudo[100361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a.info Sep 04 18:01:10 devstack sudo[100361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:10 devstack sudo[100361]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a.info" returned: 0 in 0.263s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:10 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a.info is being set with open permissions: ugo+rw Sep 04 18:01:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:10 devstack sudo[100364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a.info Sep 04 18:01:10 devstack sudo[100364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:10 devstack sudo[100364]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a.info" returned: 0 in 0.250s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:10 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] Acquiring lock "cinder-quobyte-da4bfbbb-6d02-4021-b931-af907c8dd01b" by "_copy_volume_from_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:01:10 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] Lock "cinder-quobyte-da4bfbbb-6d02-4021-b931-af907c8dd01b" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:01:10 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] snapshot: 16bba32e-d9c5-4c61-a379-f42cc4361fab, volume: da4bfbbb-6d02-4021-b931-af907c8dd01b, {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 04 18:01:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:01:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:01:10 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:01:10 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:01:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:01:10 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[2232ebbb-f653-4ac7-8915-567964872806]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:01:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a.16bba32e-d9c5-4c61-a379-f42cc4361fab {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:10 devstack sudo[100367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a.16bba32e-d9c5-4c61-a379-f42cc4361fab Sep 04 18:01:10 devstack sudo[100367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:11 devstack sudo[100367]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a.16bba32e-d9c5-4c61-a379-f42cc4361fab" returned: 0 in 0.379s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 18:01:11 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2c9636-6a0b-4735-ba1e-d994fe802703]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:01:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:11 devstack sudo[100372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a Sep 04 18:01:11 devstack sudo[100372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:11 devstack sudo[100372]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a" returned: 0 in 0.359s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 04 18:01:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] Creating direct copy from snapshot {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 04 18:01:11 devstack cinder-volume[87314]: DEBUG cinder.utils [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] Path /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-da4bfbbb-6d02-4021-b931-af907c8dd01b not found in is_blk_device check {{(pid=87314) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 04 18:01:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-da4bfbbb-6d02-4021-b931-af907c8dd01b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:11 devstack sudo[100377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-da4bfbbb-6d02-4021-b931-af907c8dd01b Sep 04 18:01:11 devstack sudo[100377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:15 devstack sudo[100377]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-da4bfbbb-6d02-4021-b931-af907c8dd01b" returned: 0 in 3.996s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:15 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] Image conversion details: src /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a, size 1024.00 MB, duration 4.00 sec, destination /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-da4bfbbb-6d02-4021-b931-af907c8dd01b {{(pid=87314) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 18:01:15 devstack cinder-volume[87314]: INFO cinder.image.image_utils [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] Converted 1024.00 MB image at 256.16 MB/s Sep 04 18:01:15 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-da4bfbbb-6d02-4021-b931-af907c8dd01b is being set with open permissions: ugo+rw Sep 04 18:01:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-da4bfbbb-6d02-4021-b931-af907c8dd01b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:15 devstack sudo[100391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-da4bfbbb-6d02-4021-b931-af907c8dd01b Sep 04 18:01:15 devstack sudo[100391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:15 devstack sudo[100391]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-da4bfbbb-6d02-4021-b931-af907c8dd01b" returned: 0 in 0.228s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:15 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] Lock "cinder-quobyte-da4bfbbb-6d02-4021-b931-af907c8dd01b" released by "_copy_volume_from_snapshot" :: held 5.034s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:01:15 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] Acquiring lock "cinder-quobyte-16bba32e-d9c5-4c61-a379-f42cc4361fab" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:01:15 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] Lock "cinder-quobyte-16bba32e-d9c5-4c61-a379-f42cc4361fab" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:01:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] Deleting offline snapshot 16bba32e-d9c5-4c61-a379-f42cc4361fab of volume 02f74e18-6aa7-4ec6-8fae-d74ce650d60a {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 18:01:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] snapshot_file for this snap is: volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a.16bba32e-d9c5-4c61-a379-f42cc4361fab {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 18:01:15 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b21a926-580f-4f23-b27f-9b6901704075]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:01:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a.16bba32e-d9c5-4c61-a379-f42cc4361fab {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:15 devstack sudo[100394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a.16bba32e-d9c5-4c61-a379-f42cc4361fab Sep 04 18:01:15 devstack sudo[100394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:16 devstack sudo[100394]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a.16bba32e-d9c5-4c61-a379-f42cc4361fab" returned: 0 in 0.335s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:16 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 18:01:16 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f2cc1d-a03f-4096-a552-f248fff5ef67]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:01:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:16 devstack sudo[100399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a Sep 04 18:01:16 devstack sudo[100399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:16 devstack sudo[100399]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a" returned: 0 in 0.499s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a.16bba32e-d9c5-4c61-a379-f42cc4361fab {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:16 devstack sudo[100404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a.16bba32e-d9c5-4c61-a379-f42cc4361fab Sep 04 18:01:16 devstack sudo[100404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:17 devstack sudo[100404]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a.16bba32e-d9c5-4c61-a379-f42cc4361fab" returned: 0 in 0.313s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a.16bba32e-d9c5-4c61-a379-f42cc4361fab {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:17 devstack sudo[100409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a.16bba32e-d9c5-4c61-a379-f42cc4361fab Sep 04 18:01:17 devstack sudo[100409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:17 devstack sudo[100409]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a.16bba32e-d9c5-4c61-a379-f42cc4361fab" returned: 0 in 0.230s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:17 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] Lock "cinder-quobyte-16bba32e-d9c5-4c61-a379-f42cc4361fab" released by "_delete_snapshot" :: held 1.452s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:01:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.666s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:01:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1dcd405d-0292-454a-a5f2-639f5555a4e4 tempest-VolumesGetTest-1631238581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.147s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:01:17 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-1dcd405d-0292-454a-a5f2-639f5555a4e4 tempest-VolumesGetTest-1631238581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:01:10Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-892453512',display_name='tempest-VolumesGetTest-Volume-284196358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=247bd71f-2c44-4484-9ed4-3fc54ca9c90f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c96efde19cc4123b29949f3f26b23f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:01:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:01:10Z,use_quota=True,user_id='28d5b941a873423aad147810bdefc056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:01:17 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-1dcd405d-0292-454a-a5f2-639f5555a4e4 tempest-VolumesGetTest-1631238581 None] Creating volume 247bd71f-2c44-4484-9ed4-3fc54ca9c90f {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:01:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1dcd405d-0292-454a-a5f2-639f5555a4e4 tempest-VolumesGetTest-1631238581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:01:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1dcd405d-0292-454a-a5f2-639f5555a4e4 tempest-VolumesGetTest-1631238581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:01:17 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-1dcd405d-0292-454a-a5f2-639f5555a4e4 tempest-VolumesGetTest-1631238581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:01:17 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-1dcd405d-0292-454a-a5f2-639f5555a4e4 tempest-VolumesGetTest-1631238581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:01:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1dcd405d-0292-454a-a5f2-639f5555a4e4 tempest-VolumesGetTest-1631238581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:01:17 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-1dcd405d-0292-454a-a5f2-639f5555a4e4 tempest-VolumesGetTest-1631238581 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:01:17 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-1dcd405d-0292-454a-a5f2-639f5555a4e4 tempest-VolumesGetTest-1631238581 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:01:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1dcd405d-0292-454a-a5f2-639f5555a4e4 tempest-VolumesGetTest-1631238581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-247bd71f-2c44-4484-9ed4-3fc54ca9c90f 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:17 devstack sudo[100412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-247bd71f-2c44-4484-9ed4-3fc54ca9c90f 1073741824 Sep 04 18:01:17 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (313059a4-adc6-491b-b50a-0c4c96076abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da4bfbbb-6d02-4021-b931-af907c8dd01b', 'volume_size': 2, 'source_volid': '02f74e18-6aa7-4ec6-8fae-d74ce650d60a', 'source_volstatus': 'available'}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:01:17 devstack sudo[100412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:17 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab0c6a2c-7b71-4ecf-a2f6-01f29a8b5371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:01:17 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] Volume volume-da4bfbbb-6d02-4021-b931-af907c8dd01b (da4bfbbb-6d02-4021-b931-af907c8dd01b): created successfully Sep 04 18:01:17 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab0c6a2c-7b71-4ecf-a2f6-01f29a8b5371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:01:17 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] Flow 'volume_create_manager' (b16e1993-146e-44b9-9207-10e5caadc16e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:01:17 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-506946ec-de58-4027-9dcb-3fef133bc574 tempest-VolumesCloneTest-1205215503 None] Created volume successfully. Sep 04 18:01:17 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-aa12c41a-8bcf-4cee-9555-376e97b439c0 tempest-VolumesCloneTest-1205215503 None] Acquiring lock "cinder-da4bfbbb-6d02-4021-b931-af907c8dd01b-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:01:17 devstack sudo[100412]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1dcd405d-0292-454a-a5f2-639f5555a4e4 tempest-VolumesGetTest-1631238581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-247bd71f-2c44-4484-9ed4-3fc54ca9c90f 1073741824" returned: 0 in 0.505s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:17 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-aa12c41a-8bcf-4cee-9555-376e97b439c0 tempest-VolumesCloneTest-1205215503 None] Lock "cinder-da4bfbbb-6d02-4021-b931-af907c8dd01b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:01:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1dcd405d-0292-454a-a5f2-639f5555a4e4 tempest-VolumesGetTest-1631238581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-247bd71f-2c44-4484-9ed4-3fc54ca9c90f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:17 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-aa12c41a-8bcf-4cee-9555-376e97b439c0 tempest-VolumesCloneTest-1205215503 None] Acquiring lock "cinder-quobyte-da4bfbbb-6d02-4021-b931-af907c8dd01b" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:01:17 devstack sudo[100418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-247bd71f-2c44-4484-9ed4-3fc54ca9c90f Sep 04 18:01:17 devstack sudo[100418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:17 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-aa12c41a-8bcf-4cee-9555-376e97b439c0 tempest-VolumesCloneTest-1205215503 None] Lock "cinder-quobyte-da4bfbbb-6d02-4021-b931-af907c8dd01b" acquired by "delete_volume" :: waited 0.017s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:01:17 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[c704a452-71ad-45d2-945f-b8a6aa5aae5e]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:01:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-aa12c41a-8bcf-4cee-9555-376e97b439c0 tempest-VolumesCloneTest-1205215503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-da4bfbbb-6d02-4021-b931-af907c8dd01b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:18 devstack sudo[100420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-da4bfbbb-6d02-4021-b931-af907c8dd01b Sep 04 18:01:18 devstack sudo[100420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:18 devstack sudo[100418]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1dcd405d-0292-454a-a5f2-639f5555a4e4 tempest-VolumesGetTest-1631238581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-247bd71f-2c44-4484-9ed4-3fc54ca9c90f" returned: 0 in 0.268s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:18 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-1dcd405d-0292-454a-a5f2-639f5555a4e4 tempest-VolumesGetTest-1631238581 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:01:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1dcd405d-0292-454a-a5f2-639f5555a4e4 tempest-VolumesGetTest-1631238581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:01:18 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1dcd405d-0292-454a-a5f2-639f5555a4e4 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3a48038-90e1-410c-a2b1-8eb10bfe7f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-247bd71f-2c44-4484-9ed4-3fc54ca9c90f', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:01:18 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1dcd405d-0292-454a-a5f2-639f5555a4e4 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b4ffb4e-3cd6-4a6d-9fde-bea51a8a1b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:01:18 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-1dcd405d-0292-454a-a5f2-639f5555a4e4 tempest-VolumesGetTest-1631238581 None] Volume volume-247bd71f-2c44-4484-9ed4-3fc54ca9c90f (247bd71f-2c44-4484-9ed4-3fc54ca9c90f): created successfully Sep 04 18:01:18 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1dcd405d-0292-454a-a5f2-639f5555a4e4 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b4ffb4e-3cd6-4a6d-9fde-bea51a8a1b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:01:18 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1dcd405d-0292-454a-a5f2-639f5555a4e4 tempest-VolumesGetTest-1631238581 None] Flow 'volume_create_manager' (c3cb1898-99f4-4f2e-b275-2b6aadd0fd90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:01:18 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-1dcd405d-0292-454a-a5f2-639f5555a4e4 tempest-VolumesGetTest-1631238581 None] Created volume successfully. Sep 04 18:01:18 devstack sudo[100420]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-aa12c41a-8bcf-4cee-9555-376e97b439c0 tempest-VolumesCloneTest-1205215503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-da4bfbbb-6d02-4021-b931-af907c8dd01b" returned: 0 in 0.367s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-aa12c41a-8bcf-4cee-9555-376e97b439c0 tempest-VolumesCloneTest-1205215503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-da4bfbbb-6d02-4021-b931-af907c8dd01b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:18 devstack sudo[100426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-da4bfbbb-6d02-4021-b931-af907c8dd01b Sep 04 18:01:18 devstack sudo[100426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:18 devstack sudo[100426]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-aa12c41a-8bcf-4cee-9555-376e97b439c0 tempest-VolumesCloneTest-1205215503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-da4bfbbb-6d02-4021-b931-af907c8dd01b" returned: 0 in 0.243s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:18 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-aa12c41a-8bcf-4cee-9555-376e97b439c0 tempest-VolumesCloneTest-1205215503 None] Lock "cinder-quobyte-da4bfbbb-6d02-4021-b931-af907c8dd01b" released by "delete_volume" :: held 0.648s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:01:18 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-aa12c41a-8bcf-4cee-9555-376e97b439c0 tempest-VolumesCloneTest-1205215503 None] Created reservations ['465d4d2f-d32c-4599-a397-57029ad53d26', 'f2a66b59-55a8-4947-bb25-5b22d3791c37', '9722d361-4edd-45ce-86d7-9df0cc6b8c80', 'd5187f73-7c72-4493-bd30-8280defc69a5'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:01:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-aa12c41a-8bcf-4cee-9555-376e97b439c0 tempest-VolumesCloneTest-1205215503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:01:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-aa12c41a-8bcf-4cee-9555-376e97b439c0 tempest-VolumesCloneTest-1205215503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:01:18 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-aa12c41a-8bcf-4cee-9555-376e97b439c0 tempest-VolumesCloneTest-1205215503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:01:18 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-aa12c41a-8bcf-4cee-9555-376e97b439c0 tempest-VolumesCloneTest-1205215503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:01:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-aa12c41a-8bcf-4cee-9555-376e97b439c0 tempest-VolumesCloneTest-1205215503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:01:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-aa12c41a-8bcf-4cee-9555-376e97b439c0 tempest-VolumesCloneTest-1205215503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:18 devstack sudo[100429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:01:18 devstack sudo[100429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:18 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4654e14f-6e4e-419d-a2dc-94ee46fcce73 tempest-VolumesGetTest-1631238581 None] Acquiring lock "cinder-247bd71f-2c44-4484-9ed4-3fc54ca9c90f-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:01:18 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4654e14f-6e4e-419d-a2dc-94ee46fcce73 tempest-VolumesGetTest-1631238581 None] Lock "cinder-247bd71f-2c44-4484-9ed4-3fc54ca9c90f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:01:18 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4654e14f-6e4e-419d-a2dc-94ee46fcce73 tempest-VolumesGetTest-1631238581 None] Acquiring lock "cinder-quobyte-247bd71f-2c44-4484-9ed4-3fc54ca9c90f" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:01:18 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4654e14f-6e4e-419d-a2dc-94ee46fcce73 tempest-VolumesGetTest-1631238581 None] Lock "cinder-quobyte-247bd71f-2c44-4484-9ed4-3fc54ca9c90f" acquired by "delete_volume" :: waited 0.015s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:01:18 devstack sudo[100429]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-aa12c41a-8bcf-4cee-9555-376e97b439c0 tempest-VolumesCloneTest-1205215503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.278s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:18 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-aa12c41a-8bcf-4cee-9555-376e97b439c0 tempest-VolumesCloneTest-1205215503 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:01:18 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[960e6f5b-8ae1-4fee-8dcf-f64797b900b8]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:01:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4654e14f-6e4e-419d-a2dc-94ee46fcce73 tempest-VolumesGetTest-1631238581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-247bd71f-2c44-4484-9ed4-3fc54ca9c90f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:19 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-aa12c41a-8bcf-4cee-9555-376e97b439c0 tempest-VolumesCloneTest-1205215503 None] Deleted volume successfully. Sep 04 18:01:19 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-aa12c41a-8bcf-4cee-9555-376e97b439c0 tempest-VolumesCloneTest-1205215503 None] Lock "cinder-da4bfbbb-6d02-4021-b931-af907c8dd01b-delete_volume" released by "delete_volume" :: held 1.163s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:01:19 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fe81dbfd-f780-466e-8122-9a6f608f42b4 tempest-VolumesCloneTest-1205215503 None] Acquiring lock "cinder-02f74e18-6aa7-4ec6-8fae-d74ce650d60a-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:01:19 devstack sudo[100432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-247bd71f-2c44-4484-9ed4-3fc54ca9c90f Sep 04 18:01:19 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fe81dbfd-f780-466e-8122-9a6f608f42b4 tempest-VolumesCloneTest-1205215503 None] Lock "cinder-02f74e18-6aa7-4ec6-8fae-d74ce650d60a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:01:19 devstack sudo[100432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:19 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fe81dbfd-f780-466e-8122-9a6f608f42b4 tempest-VolumesCloneTest-1205215503 None] Acquiring lock "cinder-quobyte-02f74e18-6aa7-4ec6-8fae-d74ce650d60a" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:01:19 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fe81dbfd-f780-466e-8122-9a6f608f42b4 tempest-VolumesCloneTest-1205215503 None] Lock "cinder-quobyte-02f74e18-6aa7-4ec6-8fae-d74ce650d60a" acquired by "delete_volume" :: waited 0.019s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:01:19 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e505ad-c479-435e-8284-ab6397478da5]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:01:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fe81dbfd-f780-466e-8122-9a6f608f42b4 tempest-VolumesCloneTest-1205215503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:19 devstack sudo[100434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a Sep 04 18:01:19 devstack sudo[100434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:19 devstack sudo[100432]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4654e14f-6e4e-419d-a2dc-94ee46fcce73 tempest-VolumesGetTest-1631238581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-247bd71f-2c44-4484-9ed4-3fc54ca9c90f" returned: 0 in 0.382s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4654e14f-6e4e-419d-a2dc-94ee46fcce73 tempest-VolumesGetTest-1631238581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-247bd71f-2c44-4484-9ed4-3fc54ca9c90f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:19 devstack sudo[100439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-247bd71f-2c44-4484-9ed4-3fc54ca9c90f Sep 04 18:01:19 devstack sudo[100439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:19 devstack sudo[100434]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fe81dbfd-f780-466e-8122-9a6f608f42b4 tempest-VolumesCloneTest-1205215503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a" returned: 0 in 0.347s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fe81dbfd-f780-466e-8122-9a6f608f42b4 tempest-VolumesCloneTest-1205215503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:19 devstack sudo[100444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a Sep 04 18:01:19 devstack sudo[100444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:19 devstack sudo[100439]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4654e14f-6e4e-419d-a2dc-94ee46fcce73 tempest-VolumesGetTest-1631238581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-247bd71f-2c44-4484-9ed4-3fc54ca9c90f" returned: 0 in 0.246s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:19 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4654e14f-6e4e-419d-a2dc-94ee46fcce73 tempest-VolumesGetTest-1631238581 None] Lock "cinder-quobyte-247bd71f-2c44-4484-9ed4-3fc54ca9c90f" released by "delete_volume" :: held 0.689s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:01:19 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-4654e14f-6e4e-419d-a2dc-94ee46fcce73 tempest-VolumesGetTest-1631238581 None] Created reservations ['4ae4098b-fb06-4684-8a7e-fe1fe6619808', '030afaed-f88a-4812-81c1-49c7a2be4466', 'ca301b9a-ffd9-4927-b8db-74e7b5bacf69', '9eb3b342-e56a-42f1-82f9-85f9d7cc716a'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:01:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4654e14f-6e4e-419d-a2dc-94ee46fcce73 tempest-VolumesGetTest-1631238581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:01:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4654e14f-6e4e-419d-a2dc-94ee46fcce73 tempest-VolumesGetTest-1631238581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:01:19 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4654e14f-6e4e-419d-a2dc-94ee46fcce73 tempest-VolumesGetTest-1631238581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:01:19 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4654e14f-6e4e-419d-a2dc-94ee46fcce73 tempest-VolumesGetTest-1631238581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:01:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4654e14f-6e4e-419d-a2dc-94ee46fcce73 tempest-VolumesGetTest-1631238581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:01:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4654e14f-6e4e-419d-a2dc-94ee46fcce73 tempest-VolumesGetTest-1631238581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:19 devstack sudo[100447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:01:19 devstack sudo[100447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:19 devstack sudo[100444]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fe81dbfd-f780-466e-8122-9a6f608f42b4 tempest-VolumesCloneTest-1205215503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-02f74e18-6aa7-4ec6-8fae-d74ce650d60a" returned: 0 in 0.255s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:19 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fe81dbfd-f780-466e-8122-9a6f608f42b4 tempest-VolumesCloneTest-1205215503 None] Lock "cinder-quobyte-02f74e18-6aa7-4ec6-8fae-d74ce650d60a" released by "delete_volume" :: held 0.658s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:01:19 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-fe81dbfd-f780-466e-8122-9a6f608f42b4 tempest-VolumesCloneTest-1205215503 None] Created reservations ['526f8864-3993-4660-995b-967ac5e399bf', 'b01017a2-5b59-4cf0-8a88-2dc7fa6c581f', 'c7411011-3769-4c34-a574-f2f3dda38f6e', '6035f786-0472-4e1f-8cda-70725583db61'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:01:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fe81dbfd-f780-466e-8122-9a6f608f42b4 tempest-VolumesCloneTest-1205215503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:01:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fe81dbfd-f780-466e-8122-9a6f608f42b4 tempest-VolumesCloneTest-1205215503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:01:19 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-fe81dbfd-f780-466e-8122-9a6f608f42b4 tempest-VolumesCloneTest-1205215503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:01:19 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-fe81dbfd-f780-466e-8122-9a6f608f42b4 tempest-VolumesCloneTest-1205215503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:01:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fe81dbfd-f780-466e-8122-9a6f608f42b4 tempest-VolumesCloneTest-1205215503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:01:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fe81dbfd-f780-466e-8122-9a6f608f42b4 tempest-VolumesCloneTest-1205215503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:19 devstack sudo[100450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:01:19 devstack sudo[100450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:20 devstack sudo[100447]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4654e14f-6e4e-419d-a2dc-94ee46fcce73 tempest-VolumesGetTest-1631238581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.254s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:20 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-4654e14f-6e4e-419d-a2dc-94ee46fcce73 tempest-VolumesGetTest-1631238581 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:01:20 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-4654e14f-6e4e-419d-a2dc-94ee46fcce73 tempest-VolumesGetTest-1631238581 None] Deleted volume successfully. Sep 04 18:01:20 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4654e14f-6e4e-419d-a2dc-94ee46fcce73 tempest-VolumesGetTest-1631238581 None] Lock "cinder-247bd71f-2c44-4484-9ed4-3fc54ca9c90f-delete_volume" released by "delete_volume" :: held 1.154s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:01:20 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9db5bc95-d5cc-4c73-804d-1ff542543fb6 tempest-VolumesGetTest-1631238581 None] Acquiring lock "cinder-018838dd-c6b0-4bed-aa57-46bb73ffb4e0-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:01:20 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9db5bc95-d5cc-4c73-804d-1ff542543fb6 tempest-VolumesGetTest-1631238581 None] Lock "cinder-018838dd-c6b0-4bed-aa57-46bb73ffb4e0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:01:20 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9db5bc95-d5cc-4c73-804d-1ff542543fb6 tempest-VolumesGetTest-1631238581 None] Acquiring lock "cinder-quobyte-018838dd-c6b0-4bed-aa57-46bb73ffb4e0" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:01:20 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9db5bc95-d5cc-4c73-804d-1ff542543fb6 tempest-VolumesGetTest-1631238581 None] Lock "cinder-quobyte-018838dd-c6b0-4bed-aa57-46bb73ffb4e0" acquired by "delete_volume" :: waited 0.019s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:01:20 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a7b4517-0d96-499f-a608-5c6274dc680b]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:01:20 devstack sudo[100450]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9db5bc95-d5cc-4c73-804d-1ff542543fb6 tempest-VolumesGetTest-1631238581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-018838dd-c6b0-4bed-aa57-46bb73ffb4e0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fe81dbfd-f780-466e-8122-9a6f608f42b4 tempest-VolumesCloneTest-1205215503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.288s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:20 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-fe81dbfd-f780-466e-8122-9a6f608f42b4 tempest-VolumesCloneTest-1205215503 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:01:20 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-fe81dbfd-f780-466e-8122-9a6f608f42b4 tempest-VolumesCloneTest-1205215503 None] Deleted volume successfully. Sep 04 18:01:20 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fe81dbfd-f780-466e-8122-9a6f608f42b4 tempest-VolumesCloneTest-1205215503 None] Lock "cinder-02f74e18-6aa7-4ec6-8fae-d74ce650d60a-delete_volume" released by "delete_volume" :: held 1.149s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:01:20 devstack sudo[100454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-018838dd-c6b0-4bed-aa57-46bb73ffb4e0 Sep 04 18:01:20 devstack sudo[100454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:20 devstack sudo[100454]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9db5bc95-d5cc-4c73-804d-1ff542543fb6 tempest-VolumesGetTest-1631238581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-018838dd-c6b0-4bed-aa57-46bb73ffb4e0" returned: 0 in 0.391s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9db5bc95-d5cc-4c73-804d-1ff542543fb6 tempest-VolumesGetTest-1631238581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-018838dd-c6b0-4bed-aa57-46bb73ffb4e0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:20 devstack sudo[100459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-018838dd-c6b0-4bed-aa57-46bb73ffb4e0 Sep 04 18:01:20 devstack sudo[100459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:20 devstack sudo[100459]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9db5bc95-d5cc-4c73-804d-1ff542543fb6 tempest-VolumesGetTest-1631238581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-018838dd-c6b0-4bed-aa57-46bb73ffb4e0" returned: 0 in 0.247s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:20 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9db5bc95-d5cc-4c73-804d-1ff542543fb6 tempest-VolumesGetTest-1631238581 None] Lock "cinder-quobyte-018838dd-c6b0-4bed-aa57-46bb73ffb4e0" released by "delete_volume" :: held 0.683s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:01:20 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-9db5bc95-d5cc-4c73-804d-1ff542543fb6 tempest-VolumesGetTest-1631238581 None] Created reservations ['ebf4b345-f09e-46a2-8715-e729461f3862', '44ba4c04-f5e0-42bf-bb7d-a316964fc16f', '563580f2-8790-4a5a-9f10-72e28afa96b0', '55dac0b9-505f-41ee-8f01-b2eb78d820ec'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:01:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9db5bc95-d5cc-4c73-804d-1ff542543fb6 tempest-VolumesGetTest-1631238581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:01:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9db5bc95-d5cc-4c73-804d-1ff542543fb6 tempest-VolumesGetTest-1631238581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:01:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9db5bc95-d5cc-4c73-804d-1ff542543fb6 tempest-VolumesGetTest-1631238581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:01:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9db5bc95-d5cc-4c73-804d-1ff542543fb6 tempest-VolumesGetTest-1631238581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:01:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9db5bc95-d5cc-4c73-804d-1ff542543fb6 tempest-VolumesGetTest-1631238581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:01:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9db5bc95-d5cc-4c73-804d-1ff542543fb6 tempest-VolumesGetTest-1631238581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:21 devstack sudo[100462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:01:21 devstack sudo[100462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:21 devstack sudo[100462]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9db5bc95-d5cc-4c73-804d-1ff542543fb6 tempest-VolumesGetTest-1631238581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.254s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:21 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-9db5bc95-d5cc-4c73-804d-1ff542543fb6 tempest-VolumesGetTest-1631238581 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:01:21 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-9db5bc95-d5cc-4c73-804d-1ff542543fb6 tempest-VolumesGetTest-1631238581 None] Deleted volume successfully. Sep 04 18:01:21 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9db5bc95-d5cc-4c73-804d-1ff542543fb6 tempest-VolumesGetTest-1631238581 None] Lock "cinder-018838dd-c6b0-4bed-aa57-46bb73ffb4e0-delete_volume" released by "delete_volume" :: held 1.169s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:01:21 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 18:01:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:01:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:01:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:01:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:01:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:01:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:21 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8e972206-2dfc-4705-ac6e-dac111483765 tempest-VolumesGetTest-1631238581 None] Acquiring lock "cinder-c21d9bc7-55b5-4e4f-a24a-d61cca246c13-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:01:21 devstack sudo[100465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:01:21 devstack sudo[100465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:21 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8e972206-2dfc-4705-ac6e-dac111483765 tempest-VolumesGetTest-1631238581 None] Lock "cinder-c21d9bc7-55b5-4e4f-a24a-d61cca246c13-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:01:21 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8e972206-2dfc-4705-ac6e-dac111483765 tempest-VolumesGetTest-1631238581 None] Acquiring lock "cinder-quobyte-c21d9bc7-55b5-4e4f-a24a-d61cca246c13" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:01:21 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8e972206-2dfc-4705-ac6e-dac111483765 tempest-VolumesGetTest-1631238581 None] Lock "cinder-quobyte-c21d9bc7-55b5-4e4f-a24a-d61cca246c13" acquired by "delete_volume" :: waited 0.022s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:01:21 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c60a0eb-3ac6-43a0-9657-80d2e409a102]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:01:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8e972206-2dfc-4705-ac6e-dac111483765 tempest-VolumesGetTest-1631238581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:21 devstack sudo[100467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13 Sep 04 18:01:21 devstack sudo[100467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:21 devstack sudo[100465]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.282s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:21 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:01:21 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running periodic task VolumeManager._thread_info {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 18:01:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] thread count: 28 {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 18:01:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] thread info: [<_MainThread(MainThread, started 139900377723008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 18:01:21 devstack sudo[100467]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8e972206-2dfc-4705-ac6e-dac111483765 tempest-VolumesGetTest-1631238581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13" returned: 0 in 0.367s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8e972206-2dfc-4705-ac6e-dac111483765 tempest-VolumesGetTest-1631238581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:21 devstack sudo[100473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13 Sep 04 18:01:21 devstack sudo[100473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:22 devstack sudo[100473]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8e972206-2dfc-4705-ac6e-dac111483765 tempest-VolumesGetTest-1631238581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c21d9bc7-55b5-4e4f-a24a-d61cca246c13" returned: 0 in 0.239s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:22 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8e972206-2dfc-4705-ac6e-dac111483765 tempest-VolumesGetTest-1631238581 None] Lock "cinder-quobyte-c21d9bc7-55b5-4e4f-a24a-d61cca246c13" released by "delete_volume" :: held 0.677s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:01:22 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-8e972206-2dfc-4705-ac6e-dac111483765 tempest-VolumesGetTest-1631238581 None] Created reservations ['d7442ed2-1f05-47e3-b3e1-64cbe4a6b0b5', 'df02184a-35ea-4ecf-bff1-90f78c57e056', '658b2907-2c64-4a8e-9afa-fc68c7fcc673', '93087101-c205-4c4d-b3d1-24524b1f30e8'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:01:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8e972206-2dfc-4705-ac6e-dac111483765 tempest-VolumesGetTest-1631238581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:01:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8e972206-2dfc-4705-ac6e-dac111483765 tempest-VolumesGetTest-1631238581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:01:22 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8e972206-2dfc-4705-ac6e-dac111483765 tempest-VolumesGetTest-1631238581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:01:22 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8e972206-2dfc-4705-ac6e-dac111483765 tempest-VolumesGetTest-1631238581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:01:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8e972206-2dfc-4705-ac6e-dac111483765 tempest-VolumesGetTest-1631238581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:01:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8e972206-2dfc-4705-ac6e-dac111483765 tempest-VolumesGetTest-1631238581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:22 devstack sudo[100476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:01:22 devstack sudo[100476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:22 devstack sudo[100476]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8e972206-2dfc-4705-ac6e-dac111483765 tempest-VolumesGetTest-1631238581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.256s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:22 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-8e972206-2dfc-4705-ac6e-dac111483765 tempest-VolumesGetTest-1631238581 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:01:22 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-8e972206-2dfc-4705-ac6e-dac111483765 tempest-VolumesGetTest-1631238581 None] Deleted volume successfully. Sep 04 18:01:22 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8e972206-2dfc-4705-ac6e-dac111483765 tempest-VolumesGetTest-1631238581 None] Lock "cinder-c21d9bc7-55b5-4e4f-a24a-d61cca246c13-delete_volume" released by "delete_volume" :: held 1.158s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:01:23 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-553c1a77-aaf5-47ac-af2c-6036c8be7b38 tempest-VolumesListTestJSON-577326379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:01:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-553c1a77-aaf5-47ac-af2c-6036c8be7b38 tempest-VolumesListTestJSON-577326379 None] Flow 'volume_create_manager' (e0fcf390-54c9-445b-9768-a01922e560dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:01:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-553c1a77-aaf5-47ac-af2c-6036c8be7b38 tempest-VolumesListTestJSON-577326379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08ff9d7f-b29c-4971-aa99-e06782e8c22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:01:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-553c1a77-aaf5-47ac-af2c-6036c8be7b38 tempest-VolumesListTestJSON-577326379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08ff9d7f-b29c-4971-aa99-e06782e8c22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:01:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-611787894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70a72309-ed8b-4ef6-8097-b343b2a42a0d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a1ac0eae26004ad090e3e5d9689d0962',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:01:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:01:23Z,use_quota=True,user_id='ff371464458d4369bdcb89e5cae8ada2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:01:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-553c1a77-aaf5-47ac-af2c-6036c8be7b38 tempest-VolumesListTestJSON-577326379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1192da0-b1c7-405d-99fd-fc210b925ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:01:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-553c1a77-aaf5-47ac-af2c-6036c8be7b38 tempest-VolumesListTestJSON-577326379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1192da0-b1c7-405d-99fd-fc210b925ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:01:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-553c1a77-aaf5-47ac-af2c-6036c8be7b38 tempest-VolumesListTestJSON-577326379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (382a5711-0084-4ea8-9762-c267f95a05da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:01:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-553c1a77-aaf5-47ac-af2c-6036c8be7b38 tempest-VolumesListTestJSON-577326379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (382a5711-0084-4ea8-9762-c267f95a05da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70a72309-ed8b-4ef6-8097-b343b2a42a0d', 'volume_name': 'volume-70a72309-ed8b-4ef6-8097-b343b2a42a0d', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:01:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-553c1a77-aaf5-47ac-af2c-6036c8be7b38 tempest-VolumesListTestJSON-577326379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d57fac6-3d77-48c9-ac28-ccf3f06095ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:01:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-553c1a77-aaf5-47ac-af2c-6036c8be7b38 tempest-VolumesListTestJSON-577326379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d57fac6-3d77-48c9-ac28-ccf3f06095ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:01:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-553c1a77-aaf5-47ac-af2c-6036c8be7b38 tempest-VolumesListTestJSON-577326379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e99ed4d4-b17f-46a3-8fbf-614909379189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:01:23 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-553c1a77-aaf5-47ac-af2c-6036c8be7b38 tempest-VolumesListTestJSON-577326379 None] Volume 70a72309-ed8b-4ef6-8097-b343b2a42a0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70a72309-ed8b-4ef6-8097-b343b2a42a0d', 'volume_size': 1} Sep 04 18:01:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-553c1a77-aaf5-47ac-af2c-6036c8be7b38 tempest-VolumesListTestJSON-577326379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:01:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-553c1a77-aaf5-47ac-af2c-6036c8be7b38 tempest-VolumesListTestJSON-577326379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:01:23 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-553c1a77-aaf5-47ac-af2c-6036c8be7b38 tempest-VolumesListTestJSON-577326379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:01:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-611787894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70a72309-ed8b-4ef6-8097-b343b2a42a0d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a1ac0eae26004ad090e3e5d9689d0962',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:01:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:01:23Z,use_quota=True,user_id='ff371464458d4369bdcb89e5cae8ada2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:01:23 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-553c1a77-aaf5-47ac-af2c-6036c8be7b38 tempest-VolumesListTestJSON-577326379 None] Creating volume 70a72309-ed8b-4ef6-8097-b343b2a42a0d {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:01:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-553c1a77-aaf5-47ac-af2c-6036c8be7b38 tempest-VolumesListTestJSON-577326379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:01:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-553c1a77-aaf5-47ac-af2c-6036c8be7b38 tempest-VolumesListTestJSON-577326379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:01:23 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-553c1a77-aaf5-47ac-af2c-6036c8be7b38 tempest-VolumesListTestJSON-577326379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:01:23 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-553c1a77-aaf5-47ac-af2c-6036c8be7b38 tempest-VolumesListTestJSON-577326379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:01:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-553c1a77-aaf5-47ac-af2c-6036c8be7b38 tempest-VolumesListTestJSON-577326379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:01:23 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-553c1a77-aaf5-47ac-af2c-6036c8be7b38 tempest-VolumesListTestJSON-577326379 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:01:23 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-553c1a77-aaf5-47ac-af2c-6036c8be7b38 tempest-VolumesListTestJSON-577326379 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:01:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-553c1a77-aaf5-47ac-af2c-6036c8be7b38 tempest-VolumesListTestJSON-577326379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-70a72309-ed8b-4ef6-8097-b343b2a42a0d 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:23 devstack sudo[100479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-70a72309-ed8b-4ef6-8097-b343b2a42a0d 1073741824 Sep 04 18:01:23 devstack sudo[100479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:23 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-27647db3-48d9-45c5-89fe-f75f3fe06d79 tempest-VolumesGetTest-1631238581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:01:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-27647db3-48d9-45c5-89fe-f75f3fe06d79 tempest-VolumesGetTest-1631238581 None] Flow 'volume_create_manager' (7114cde9-a247-4fe6-be80-552448b2511a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:01:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-27647db3-48d9-45c5-89fe-f75f3fe06d79 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52b83ea7-1955-4668-9048-191bec2b2d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:01:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-27647db3-48d9-45c5-89fe-f75f3fe06d79 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52b83ea7-1955-4668-9048-191bec2b2d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:01:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1545101070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9671e996-bf8c-4e94-bf3b-1407b18c6ff1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2c96efde19cc4123b29949f3f26b23f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:01:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:01:23Z,use_quota=True,user_id='28d5b941a873423aad147810bdefc056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:01:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-27647db3-48d9-45c5-89fe-f75f3fe06d79 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48bdba28-9966-4fcd-852d-9415d72dc388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:01:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-27647db3-48d9-45c5-89fe-f75f3fe06d79 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48bdba28-9966-4fcd-852d-9415d72dc388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:01:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-27647db3-48d9-45c5-89fe-f75f3fe06d79 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2261f42f-6261-47f6-8235-58d78b346e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:01:23 devstack cinder-volume[87314]: DEBUG cinder.image.glance [None req-27647db3-48d9-45c5-89fe-f75f3fe06d79 tempest-VolumesGetTest-1631238581 None] Creating Keystone auth plugin from conf {{(pid=87314) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 04 18:01:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-27647db3-48d9-45c5-89fe-f75f3fe06d79 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2261f42f-6261-47f6-8235-58d78b346e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9671e996-bf8c-4e94-bf3b-1407b18c6ff1', 'volume_name': 'volume-9671e996-bf8c-4e94-bf3b-1407b18c6ff1', 'volume_size': 1, 'image_id': 'eeb1e1b9-f612-4acd-9439-6285840a52d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eeb1e1b9-f612-4acd-9439-6285840a52d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'be7dacacfc0f482c9fff51cfcb1c78e5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eeb1e1b9-f612-4acd-9439-6285840a52d1', 'created_at': datetime.datetime(2026, 9, 4, 15, 43, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 15, 43, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eeb1e1b9-f612-4acd-9439-6285840a52d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:01:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-27647db3-48d9-45c5-89fe-f75f3fe06d79 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfd12dfb-72d6-416b-b875-ff7399118517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:01:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-27647db3-48d9-45c5-89fe-f75f3fe06d79 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfd12dfb-72d6-416b-b875-ff7399118517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:01:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-27647db3-48d9-45c5-89fe-f75f3fe06d79 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faa7d3d2-b4d0-4b0f-b491-a351a93900d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:01:23 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-27647db3-48d9-45c5-89fe-f75f3fe06d79 tempest-VolumesGetTest-1631238581 None] Volume 9671e996-bf8c-4e94-bf3b-1407b18c6ff1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9671e996-bf8c-4e94-bf3b-1407b18c6ff1', 'volume_size': 1, 'image_id': 'eeb1e1b9-f612-4acd-9439-6285840a52d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eeb1e1b9-f612-4acd-9439-6285840a52d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'be7dacacfc0f482c9fff51cfcb1c78e5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eeb1e1b9-f612-4acd-9439-6285840a52d1', 'created_at': datetime.datetime(2026, 9, 4, 15, 43, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 15, 43, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eeb1e1b9-f612-4acd-9439-6285840a52d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 04 18:01:23 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-27647db3-48d9-45c5-89fe-f75f3fe06d79 tempest-VolumesGetTest-1631238581 None] Trying to clone 9671e996-bf8c-4e94-bf3b-1407b18c6ff1 from image eeb1e1b9-f612-4acd-9439-6285840a52d1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/eeb1e1b9-f612-4acd-9439-6285840a52d1', 'metadata': {}}]). {{(pid=87314) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 04 18:01:23 devstack sudo[100479]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-553c1a77-aaf5-47ac-af2c-6036c8be7b38 tempest-VolumesListTestJSON-577326379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-70a72309-ed8b-4ef6-8097-b343b2a42a0d 1073741824" returned: 0 in 0.443s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-553c1a77-aaf5-47ac-af2c-6036c8be7b38 tempest-VolumesListTestJSON-577326379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-70a72309-ed8b-4ef6-8097-b343b2a42a0d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:23 devstack sudo[100486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-70a72309-ed8b-4ef6-8097-b343b2a42a0d Sep 04 18:01:23 devstack sudo[100486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:24 devstack sudo[100486]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-553c1a77-aaf5-47ac-af2c-6036c8be7b38 tempest-VolumesListTestJSON-577326379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-70a72309-ed8b-4ef6-8097-b343b2a42a0d" returned: 0 in 0.252s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:24 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-553c1a77-aaf5-47ac-af2c-6036c8be7b38 tempest-VolumesListTestJSON-577326379 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:01:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-553c1a77-aaf5-47ac-af2c-6036c8be7b38 tempest-VolumesListTestJSON-577326379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:01:24 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-27647db3-48d9-45c5-89fe-f75f3fe06d79 tempest-VolumesGetTest-1631238581 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1_xvq18_vqdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87314) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 04 18:01:24 devstack cinder-volume[87314]: INFO cinder.image.image_utils [None req-27647db3-48d9-45c5-89fe-f75f3fe06d79 tempest-VolumesGetTest-1631238581 None] Image download 20.69 MB at 20.69 MB/s Sep 04 18:01:24 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-553c1a77-aaf5-47ac-af2c-6036c8be7b38 tempest-VolumesListTestJSON-577326379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e99ed4d4-b17f-46a3-8fbf-614909379189) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70a72309-ed8b-4ef6-8097-b343b2a42a0d', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:01:24 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-553c1a77-aaf5-47ac-af2c-6036c8be7b38 tempest-VolumesListTestJSON-577326379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fd2edba-4d36-4387-bf05-005345bfeb78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:01:24 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[567f2348-380a-44a7-a4dc-7d5008aeeca7]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:01:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-27647db3-48d9-45c5-89fe-f75f3fe06d79 tempest-VolumesGetTest-1631238581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1_xvq18_vqdevstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:24 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-553c1a77-aaf5-47ac-af2c-6036c8be7b38 tempest-VolumesListTestJSON-577326379 None] Volume volume-70a72309-ed8b-4ef6-8097-b343b2a42a0d (70a72309-ed8b-4ef6-8097-b343b2a42a0d): created successfully Sep 04 18:01:24 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-553c1a77-aaf5-47ac-af2c-6036c8be7b38 tempest-VolumesListTestJSON-577326379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fd2edba-4d36-4387-bf05-005345bfeb78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:01:24 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-553c1a77-aaf5-47ac-af2c-6036c8be7b38 tempest-VolumesListTestJSON-577326379 None] Flow 'volume_create_manager' (e0fcf390-54c9-445b-9768-a01922e560dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:01:24 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-553c1a77-aaf5-47ac-af2c-6036c8be7b38 tempest-VolumesListTestJSON-577326379 None] Created volume successfully. Sep 04 18:01:24 devstack sudo[100491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1_xvq18_vqdevstack@QuobyteHD Sep 04 18:01:24 devstack sudo[100491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:24 devstack sudo[100491]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-27647db3-48d9-45c5-89fe-f75f3fe06d79 tempest-VolumesGetTest-1631238581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1_xvq18_vqdevstack@QuobyteHD" returned: 0 in 0.330s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:24 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-27647db3-48d9-45c5-89fe-f75f3fe06d79 tempest-VolumesGetTest-1631238581 None] Temporary image eeb1e1b9-f612-4acd-9439-6285840a52d1 is fetched for user 28d5b941a873423aad147810bdefc056. {{(pid=87314) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 04 18:01:24 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab329fb-d628-4cd0-8e0c-8f1733952f1e]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:01:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-27647db3-48d9-45c5-89fe-f75f3fe06d79 tempest-VolumesGetTest-1631238581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1_xvq18_vqdevstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:24 devstack sudo[100496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1_xvq18_vqdevstack@QuobyteHD Sep 04 18:01:24 devstack sudo[100496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:24 devstack sudo[100496]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-27647db3-48d9-45c5-89fe-f75f3fe06d79 tempest-VolumesGetTest-1631238581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1_xvq18_vqdevstack@QuobyteHD" returned: 0 in 0.331s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-27647db3-48d9-45c5-89fe-f75f3fe06d79 tempest-VolumesGetTest-1631238581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:01:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-27647db3-48d9-45c5-89fe-f75f3fe06d79 tempest-VolumesGetTest-1631238581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:01:24 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-27647db3-48d9-45c5-89fe-f75f3fe06d79 tempest-VolumesGetTest-1631238581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:01:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1545101070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9671e996-bf8c-4e94-bf3b-1407b18c6ff1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2c96efde19cc4123b29949f3f26b23f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:01:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:01:23Z,use_quota=True,user_id='28d5b941a873423aad147810bdefc056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:01:24 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-27647db3-48d9-45c5-89fe-f75f3fe06d79 tempest-VolumesGetTest-1631238581 None] Creating volume 9671e996-bf8c-4e94-bf3b-1407b18c6ff1 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:01:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-27647db3-48d9-45c5-89fe-f75f3fe06d79 tempest-VolumesGetTest-1631238581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:01:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-27647db3-48d9-45c5-89fe-f75f3fe06d79 tempest-VolumesGetTest-1631238581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:01:24 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-27647db3-48d9-45c5-89fe-f75f3fe06d79 tempest-VolumesGetTest-1631238581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:01:24 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-27647db3-48d9-45c5-89fe-f75f3fe06d79 tempest-VolumesGetTest-1631238581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:01:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-27647db3-48d9-45c5-89fe-f75f3fe06d79 tempest-VolumesGetTest-1631238581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:01:24 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-27647db3-48d9-45c5-89fe-f75f3fe06d79 tempest-VolumesGetTest-1631238581 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:01:24 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-27647db3-48d9-45c5-89fe-f75f3fe06d79 tempest-VolumesGetTest-1631238581 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:01:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-27647db3-48d9-45c5-89fe-f75f3fe06d79 tempest-VolumesGetTest-1631238581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9671e996-bf8c-4e94-bf3b-1407b18c6ff1 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:24 devstack sudo[100501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9671e996-bf8c-4e94-bf3b-1407b18c6ff1 1073741824 Sep 04 18:01:24 devstack sudo[100501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:25 devstack sudo[100501]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-27647db3-48d9-45c5-89fe-f75f3fe06d79 tempest-VolumesGetTest-1631238581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9671e996-bf8c-4e94-bf3b-1407b18c6ff1 1073741824" returned: 0 in 0.417s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:25 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=91,cinder:UPDATE=120,cinder:INSERT=31,cinder:DELETE=11 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 18:01:25 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=92,cinder:INSERT=37,cinder:UPDATE=128,cinder:DELETE=10 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 18:01:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-27647db3-48d9-45c5-89fe-f75f3fe06d79 tempest-VolumesGetTest-1631238581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9671e996-bf8c-4e94-bf3b-1407b18c6ff1 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:25 devstack sudo[100507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9671e996-bf8c-4e94-bf3b-1407b18c6ff1 Sep 04 18:01:25 devstack sudo[100507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:25 devstack sudo[100507]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-27647db3-48d9-45c5-89fe-f75f3fe06d79 tempest-VolumesGetTest-1631238581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9671e996-bf8c-4e94-bf3b-1407b18c6ff1" returned: 0 in 0.262s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:25 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-27647db3-48d9-45c5-89fe-f75f3fe06d79 tempest-VolumesGetTest-1631238581 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:01:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-27647db3-48d9-45c5-89fe-f75f3fe06d79 tempest-VolumesGetTest-1631238581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:01:25 devstack cinder-volume[87314]: DEBUG cinder.volume.volume_utils [None req-27647db3-48d9-45c5-89fe-f75f3fe06d79 tempest-VolumesGetTest-1631238581 None] Attempting download of eeb1e1b9-f612-4acd-9439-6285840a52d1 ((None, [{'url': 'file:///opt/stack/data/glance/images/eeb1e1b9-f612-4acd-9439-6285840a52d1', 'metadata': {}}])) to volume 9671e996-bf8c-4e94-bf3b-1407b18c6ff1. {{(pid=87314) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 04 18:01:25 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[3332cb2e-db31-49e2-a1ca-0dcb890da7c2]: (4, 'raw') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:01:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-27647db3-48d9-45c5-89fe-f75f3fe06d79 tempest-VolumesGetTest-1631238581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eeb1e1b9-f612-4acd-9439-6285840a52d1_gctvtm49 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:25 devstack sudo[100510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eeb1e1b9-f612-4acd-9439-6285840a52d1_gctvtm49 Sep 04 18:01:25 devstack sudo[100510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:25 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-fded07d0-f939-46ab-a0fb-b01300dcb921 tempest-VolumesListTestJSON-577326379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:01:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fded07d0-f939-46ab-a0fb-b01300dcb921 tempest-VolumesListTestJSON-577326379 None] Flow 'volume_create_manager' (3e607267-b75c-4b37-bfd7-e2b83f7d3d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:01:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fded07d0-f939-46ab-a0fb-b01300dcb921 tempest-VolumesListTestJSON-577326379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca646820-f586-4784-88e0-bc0d3e4cf774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:01:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fded07d0-f939-46ab-a0fb-b01300dcb921 tempest-VolumesListTestJSON-577326379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca646820-f586-4784-88e0-bc0d3e4cf774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:01:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1914543546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5bed400-7ecc-4f49-846b-8292c70421e2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a1ac0eae26004ad090e3e5d9689d0962',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:01:26Z,use_quota=True,user_id='ff371464458d4369bdcb89e5cae8ada2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:01:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fded07d0-f939-46ab-a0fb-b01300dcb921 tempest-VolumesListTestJSON-577326379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (040b0203-1c0c-4313-b627-3e56ab2520a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:01:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fded07d0-f939-46ab-a0fb-b01300dcb921 tempest-VolumesListTestJSON-577326379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (040b0203-1c0c-4313-b627-3e56ab2520a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:01:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fded07d0-f939-46ab-a0fb-b01300dcb921 tempest-VolumesListTestJSON-577326379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9aee1108-ed39-43fe-a6a4-63cd6454b7cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:01:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fded07d0-f939-46ab-a0fb-b01300dcb921 tempest-VolumesListTestJSON-577326379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9aee1108-ed39-43fe-a6a4-63cd6454b7cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5bed400-7ecc-4f49-846b-8292c70421e2', 'volume_name': 'volume-e5bed400-7ecc-4f49-846b-8292c70421e2', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:01:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fded07d0-f939-46ab-a0fb-b01300dcb921 tempest-VolumesListTestJSON-577326379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67a88027-6fa5-4a8c-a6e1-1072eef97fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:01:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fded07d0-f939-46ab-a0fb-b01300dcb921 tempest-VolumesListTestJSON-577326379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67a88027-6fa5-4a8c-a6e1-1072eef97fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:01:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fded07d0-f939-46ab-a0fb-b01300dcb921 tempest-VolumesListTestJSON-577326379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed70bdc1-050c-4f6e-86fd-bb7455f57dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:01:25 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-fded07d0-f939-46ab-a0fb-b01300dcb921 tempest-VolumesListTestJSON-577326379 None] Volume e5bed400-7ecc-4f49-846b-8292c70421e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5bed400-7ecc-4f49-846b-8292c70421e2', 'volume_size': 1} Sep 04 18:01:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fded07d0-f939-46ab-a0fb-b01300dcb921 tempest-VolumesListTestJSON-577326379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:01:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fded07d0-f939-46ab-a0fb-b01300dcb921 tempest-VolumesListTestJSON-577326379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:01:25 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-fded07d0-f939-46ab-a0fb-b01300dcb921 tempest-VolumesListTestJSON-577326379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:01:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1914543546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5bed400-7ecc-4f49-846b-8292c70421e2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a1ac0eae26004ad090e3e5d9689d0962',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:01:26Z,use_quota=True,user_id='ff371464458d4369bdcb89e5cae8ada2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:01:25 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-fded07d0-f939-46ab-a0fb-b01300dcb921 tempest-VolumesListTestJSON-577326379 None] Creating volume e5bed400-7ecc-4f49-846b-8292c70421e2 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:01:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fded07d0-f939-46ab-a0fb-b01300dcb921 tempest-VolumesListTestJSON-577326379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:01:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fded07d0-f939-46ab-a0fb-b01300dcb921 tempest-VolumesListTestJSON-577326379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:01:25 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-fded07d0-f939-46ab-a0fb-b01300dcb921 tempest-VolumesListTestJSON-577326379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:01:25 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-fded07d0-f939-46ab-a0fb-b01300dcb921 tempest-VolumesListTestJSON-577326379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:01:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fded07d0-f939-46ab-a0fb-b01300dcb921 tempest-VolumesListTestJSON-577326379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:01:25 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-fded07d0-f939-46ab-a0fb-b01300dcb921 tempest-VolumesListTestJSON-577326379 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:01:25 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-fded07d0-f939-46ab-a0fb-b01300dcb921 tempest-VolumesListTestJSON-577326379 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:01:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fded07d0-f939-46ab-a0fb-b01300dcb921 tempest-VolumesListTestJSON-577326379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-e5bed400-7ecc-4f49-846b-8292c70421e2 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:25 devstack sudo[100512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-e5bed400-7ecc-4f49-846b-8292c70421e2 1073741824 Sep 04 18:01:25 devstack sudo[100512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:26 devstack sudo[100510]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-27647db3-48d9-45c5-89fe-f75f3fe06d79 tempest-VolumesGetTest-1631238581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eeb1e1b9-f612-4acd-9439-6285840a52d1_gctvtm49" returned: 0 in 0.355s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-27647db3-48d9-45c5-89fe-f75f3fe06d79 tempest-VolumesGetTest-1631238581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eeb1e1b9-f612-4acd-9439-6285840a52d1_gctvtm49 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:26 devstack sudo[100516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eeb1e1b9-f612-4acd-9439-6285840a52d1_gctvtm49 Sep 04 18:01:26 devstack sudo[100516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:26 devstack sudo[100516]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-27647db3-48d9-45c5-89fe-f75f3fe06d79 tempest-VolumesGetTest-1631238581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eeb1e1b9-f612-4acd-9439-6285840a52d1_gctvtm49" returned: 1 in 0.327s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-27647db3-48d9-45c5-89fe-f75f3fe06d79 tempest-VolumesGetTest-1631238581 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eeb1e1b9-f612-4acd-9439-6285840a52d1_gctvtm49' failed. Not Retrying. {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 18:01:26 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[06be01dd-b3ed-4c8a-9413-b53097afaed5]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:01:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-27647db3-48d9-45c5-89fe-f75f3fe06d79 tempest-VolumesGetTest-1631238581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1_xvq18_vqdevstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:26 devstack sudo[100512]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fded07d0-f939-46ab-a0fb-b01300dcb921 tempest-VolumesListTestJSON-577326379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-e5bed400-7ecc-4f49-846b-8292c70421e2 1073741824" returned: 0 in 0.434s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fded07d0-f939-46ab-a0fb-b01300dcb921 tempest-VolumesListTestJSON-577326379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-e5bed400-7ecc-4f49-846b-8292c70421e2 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:26 devstack sudo[100525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-e5bed400-7ecc-4f49-846b-8292c70421e2 Sep 04 18:01:26 devstack sudo[100525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:26 devstack sudo[100524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1_xvq18_vqdevstack@QuobyteHD Sep 04 18:01:26 devstack sudo[100524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:26 devstack sudo[100525]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fded07d0-f939-46ab-a0fb-b01300dcb921 tempest-VolumesListTestJSON-577326379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-e5bed400-7ecc-4f49-846b-8292c70421e2" returned: 0 in 0.252s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:26 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-fded07d0-f939-46ab-a0fb-b01300dcb921 tempest-VolumesListTestJSON-577326379 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:01:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fded07d0-f939-46ab-a0fb-b01300dcb921 tempest-VolumesListTestJSON-577326379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:01:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fded07d0-f939-46ab-a0fb-b01300dcb921 tempest-VolumesListTestJSON-577326379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed70bdc1-050c-4f6e-86fd-bb7455f57dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5bed400-7ecc-4f49-846b-8292c70421e2', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:01:26 devstack sudo[100524]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fded07d0-f939-46ab-a0fb-b01300dcb921 tempest-VolumesListTestJSON-577326379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5a88ce6-dd76-4ea4-a19f-3b7279717438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:01:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-27647db3-48d9-45c5-89fe-f75f3fe06d79 tempest-VolumesGetTest-1631238581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1_xvq18_vqdevstack@QuobyteHD" returned: 0 in 0.334s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:26 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-27647db3-48d9-45c5-89fe-f75f3fe06d79 tempest-VolumesGetTest-1631238581 None] eeb1e1b9-f612-4acd-9439-6285840a52d1 was qcow2, converting to qcow2 {{(pid=87314) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 04 18:01:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-27647db3-48d9-45c5-89fe-f75f3fe06d79 tempest-VolumesGetTest-1631238581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1_xvq18_vqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9671e996-bf8c-4e94-bf3b-1407b18c6ff1 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:26 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-fded07d0-f939-46ab-a0fb-b01300dcb921 tempest-VolumesListTestJSON-577326379 None] Volume volume-e5bed400-7ecc-4f49-846b-8292c70421e2 (e5bed400-7ecc-4f49-846b-8292c70421e2): created successfully Sep 04 18:01:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fded07d0-f939-46ab-a0fb-b01300dcb921 tempest-VolumesListTestJSON-577326379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5a88ce6-dd76-4ea4-a19f-3b7279717438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:01:26 devstack sudo[100533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1_xvq18_vqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9671e996-bf8c-4e94-bf3b-1407b18c6ff1 Sep 04 18:01:26 devstack sudo[100533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fded07d0-f939-46ab-a0fb-b01300dcb921 tempest-VolumesListTestJSON-577326379 None] Flow 'volume_create_manager' (3e607267-b75c-4b37-bfd7-e2b83f7d3d6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:01:26 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-fded07d0-f939-46ab-a0fb-b01300dcb921 tempest-VolumesListTestJSON-577326379 None] Created volume successfully. Sep 04 18:01:27 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b88d13e-24f4-4d6a-bd0c-552f25958005 tempest-VolumesListTestJSON-577326379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:01:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5b88d13e-24f4-4d6a-bd0c-552f25958005 tempest-VolumesListTestJSON-577326379 None] Flow 'volume_create_manager' (a11a048d-135e-459f-a750-05c89990d3f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:01:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5b88d13e-24f4-4d6a-bd0c-552f25958005 tempest-VolumesListTestJSON-577326379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (079c79cb-2323-4c05-83e9-4cbe8f1da161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:01:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5b88d13e-24f4-4d6a-bd0c-552f25958005 tempest-VolumesListTestJSON-577326379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (079c79cb-2323-4c05-83e9-4cbe8f1da161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1868860975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7a493b4-d4e7-4541-9533-51d011066e5d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a1ac0eae26004ad090e3e5d9689d0962',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:01:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:01:27Z,use_quota=True,user_id='ff371464458d4369bdcb89e5cae8ada2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:01:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5b88d13e-24f4-4d6a-bd0c-552f25958005 tempest-VolumesListTestJSON-577326379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bc52c05-3996-454a-888e-533e826d05d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:01:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5b88d13e-24f4-4d6a-bd0c-552f25958005 tempest-VolumesListTestJSON-577326379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bc52c05-3996-454a-888e-533e826d05d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:01:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5b88d13e-24f4-4d6a-bd0c-552f25958005 tempest-VolumesListTestJSON-577326379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1669a0f-43af-4404-b0f3-2518b0617072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:01:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5b88d13e-24f4-4d6a-bd0c-552f25958005 tempest-VolumesListTestJSON-577326379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1669a0f-43af-4404-b0f3-2518b0617072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7a493b4-d4e7-4541-9533-51d011066e5d', 'volume_name': 'volume-b7a493b4-d4e7-4541-9533-51d011066e5d', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:01:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5b88d13e-24f4-4d6a-bd0c-552f25958005 tempest-VolumesListTestJSON-577326379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8742cc4c-966c-433c-951c-d713cdaa3348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:01:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5b88d13e-24f4-4d6a-bd0c-552f25958005 tempest-VolumesListTestJSON-577326379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8742cc4c-966c-433c-951c-d713cdaa3348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:01:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5b88d13e-24f4-4d6a-bd0c-552f25958005 tempest-VolumesListTestJSON-577326379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efefe005-99e8-4c79-92ff-22ef893a7b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:01:27 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-5b88d13e-24f4-4d6a-bd0c-552f25958005 tempest-VolumesListTestJSON-577326379 None] Volume b7a493b4-d4e7-4541-9533-51d011066e5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7a493b4-d4e7-4541-9533-51d011066e5d', 'volume_size': 1} Sep 04 18:01:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5b88d13e-24f4-4d6a-bd0c-552f25958005 tempest-VolumesListTestJSON-577326379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:01:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5b88d13e-24f4-4d6a-bd0c-552f25958005 tempest-VolumesListTestJSON-577326379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:01:27 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5b88d13e-24f4-4d6a-bd0c-552f25958005 tempest-VolumesListTestJSON-577326379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1868860975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7a493b4-d4e7-4541-9533-51d011066e5d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a1ac0eae26004ad090e3e5d9689d0962',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:01:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:01:27Z,use_quota=True,user_id='ff371464458d4369bdcb89e5cae8ada2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:01:27 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-5b88d13e-24f4-4d6a-bd0c-552f25958005 tempest-VolumesListTestJSON-577326379 None] Creating volume b7a493b4-d4e7-4541-9533-51d011066e5d {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:01:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5b88d13e-24f4-4d6a-bd0c-552f25958005 tempest-VolumesListTestJSON-577326379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:01:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5b88d13e-24f4-4d6a-bd0c-552f25958005 tempest-VolumesListTestJSON-577326379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:01:27 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5b88d13e-24f4-4d6a-bd0c-552f25958005 tempest-VolumesListTestJSON-577326379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:01:27 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5b88d13e-24f4-4d6a-bd0c-552f25958005 tempest-VolumesListTestJSON-577326379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:01:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5b88d13e-24f4-4d6a-bd0c-552f25958005 tempest-VolumesListTestJSON-577326379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:01:27 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5b88d13e-24f4-4d6a-bd0c-552f25958005 tempest-VolumesListTestJSON-577326379 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:01:27 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-5b88d13e-24f4-4d6a-bd0c-552f25958005 tempest-VolumesListTestJSON-577326379 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:01:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5b88d13e-24f4-4d6a-bd0c-552f25958005 tempest-VolumesListTestJSON-577326379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b7a493b4-d4e7-4541-9533-51d011066e5d 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:27 devstack sudo[100542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b7a493b4-d4e7-4541-9533-51d011066e5d 1073741824 Sep 04 18:01:27 devstack sudo[100542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:27 devstack sudo[100542]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5b88d13e-24f4-4d6a-bd0c-552f25958005 tempest-VolumesListTestJSON-577326379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b7a493b4-d4e7-4541-9533-51d011066e5d 1073741824" returned: 0 in 0.487s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5b88d13e-24f4-4d6a-bd0c-552f25958005 tempest-VolumesListTestJSON-577326379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b7a493b4-d4e7-4541-9533-51d011066e5d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:28 devstack sudo[100548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b7a493b4-d4e7-4541-9533-51d011066e5d Sep 04 18:01:28 devstack sudo[100548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:28 devstack sudo[100548]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5b88d13e-24f4-4d6a-bd0c-552f25958005 tempest-VolumesListTestJSON-577326379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b7a493b4-d4e7-4541-9533-51d011066e5d" returned: 0 in 0.240s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:28 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5b88d13e-24f4-4d6a-bd0c-552f25958005 tempest-VolumesListTestJSON-577326379 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:01:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5b88d13e-24f4-4d6a-bd0c-552f25958005 tempest-VolumesListTestJSON-577326379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:01:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5b88d13e-24f4-4d6a-bd0c-552f25958005 tempest-VolumesListTestJSON-577326379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efefe005-99e8-4c79-92ff-22ef893a7b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7a493b4-d4e7-4541-9533-51d011066e5d', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:01:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5b88d13e-24f4-4d6a-bd0c-552f25958005 tempest-VolumesListTestJSON-577326379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de9d5b0c-02d1-49e8-9f11-6f9f1d5aa921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:01:28 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-5b88d13e-24f4-4d6a-bd0c-552f25958005 tempest-VolumesListTestJSON-577326379 None] Volume volume-b7a493b4-d4e7-4541-9533-51d011066e5d (b7a493b4-d4e7-4541-9533-51d011066e5d): created successfully Sep 04 18:01:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5b88d13e-24f4-4d6a-bd0c-552f25958005 tempest-VolumesListTestJSON-577326379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de9d5b0c-02d1-49e8-9f11-6f9f1d5aa921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:01:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5b88d13e-24f4-4d6a-bd0c-552f25958005 tempest-VolumesListTestJSON-577326379 None] Flow 'volume_create_manager' (a11a048d-135e-459f-a750-05c89990d3f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:01:28 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-5b88d13e-24f4-4d6a-bd0c-552f25958005 tempest-VolumesListTestJSON-577326379 None] Created volume successfully. Sep 04 18:01:28 devstack sudo[100533]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-27647db3-48d9-45c5-89fe-f75f3fe06d79 tempest-VolumesGetTest-1631238581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1_xvq18_vqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9671e996-bf8c-4e94-bf3b-1407b18c6ff1" returned: 0 in 1.728s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:28 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-27647db3-48d9-45c5-89fe-f75f3fe06d79 tempest-VolumesGetTest-1631238581 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1_xvq18_vqdevstack@QuobyteHD, size 112.00 MB, duration 1.73 sec, destination /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9671e996-bf8c-4e94-bf3b-1407b18c6ff1 {{(pid=87314) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 18:01:28 devstack cinder-volume[87314]: INFO cinder.image.image_utils [None req-27647db3-48d9-45c5-89fe-f75f3fe06d79 tempest-VolumesGetTest-1631238581 None] Converted 112.00 MB image at 64.76 MB/s Sep 04 18:01:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-27647db3-48d9-45c5-89fe-f75f3fe06d79 tempest-VolumesGetTest-1631238581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9671e996-bf8c-4e94-bf3b-1407b18c6ff1 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:28 devstack sudo[100551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9671e996-bf8c-4e94-bf3b-1407b18c6ff1 1G Sep 04 18:01:28 devstack sudo[100551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:28 devstack sudo[100551]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-27647db3-48d9-45c5-89fe-f75f3fe06d79 tempest-VolumesGetTest-1631238581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9671e996-bf8c-4e94-bf3b-1407b18c6ff1 1G" returned: 0 in 0.329s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:28 devstack cinder-volume[87314]: DEBUG cinder.volume.volume_utils [None req-27647db3-48d9-45c5-89fe-f75f3fe06d79 tempest-VolumesGetTest-1631238581 None] Downloaded image eeb1e1b9-f612-4acd-9439-6285840a52d1 ((None, [{'url': 'file:///opt/stack/data/glance/images/eeb1e1b9-f612-4acd-9439-6285840a52d1', 'metadata': {}}])) to volume 9671e996-bf8c-4e94-bf3b-1407b18c6ff1 successfully. {{(pid=87314) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 04 18:01:28 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-27647db3-48d9-45c5-89fe-f75f3fe06d79 tempest-VolumesGetTest-1631238581 None] Temporary image eeb1e1b9-f612-4acd-9439-6285840a52d1 for user 28d5b941a873423aad147810bdefc056 is deleted. {{(pid=87314) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 04 18:01:28 devstack cinder-volume[87314]: DEBUG cinder.volume.volume_utils [None req-27647db3-48d9-45c5-89fe-f75f3fe06d79 tempest-VolumesGetTest-1631238581 None] Marking volume 9671e996-bf8c-4e94-bf3b-1407b18c6ff1 as bootable. {{(pid=87314) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 04 18:01:28 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-27647db3-48d9-45c5-89fe-f75f3fe06d79 tempest-VolumesGetTest-1631238581 None] Copying metadata from image eeb1e1b9-f612-4acd-9439-6285840a52d1 to 9671e996-bf8c-4e94-bf3b-1407b18c6ff1. {{(pid=87314) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 04 18:01:28 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-27647db3-48d9-45c5-89fe-f75f3fe06d79 tempest-VolumesGetTest-1631238581 None] Creating volume glance metadata for volume 9671e996-bf8c-4e94-bf3b-1407b18c6ff1 backed by image eeb1e1b9-f612-4acd-9439-6285840a52d1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'eeb1e1b9-f612-4acd-9439-6285840a52d1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87314) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 04 18:01:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-27647db3-48d9-45c5-89fe-f75f3fe06d79 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faa7d3d2-b4d0-4b0f-b491-a351a93900d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9671e996-bf8c-4e94-bf3b-1407b18c6ff1', 'volume_size': 1, 'image_id': 'eeb1e1b9-f612-4acd-9439-6285840a52d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eeb1e1b9-f612-4acd-9439-6285840a52d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'be7dacacfc0f482c9fff51cfcb1c78e5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eeb1e1b9-f612-4acd-9439-6285840a52d1', 'created_at': datetime.datetime(2026, 9, 4, 15, 43, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 15, 43, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eeb1e1b9-f612-4acd-9439-6285840a52d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:01:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-27647db3-48d9-45c5-89fe-f75f3fe06d79 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c96b3f2-49a2-47e0-86c0-c5643688f08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:01:28 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-27647db3-48d9-45c5-89fe-f75f3fe06d79 tempest-VolumesGetTest-1631238581 None] Volume volume-9671e996-bf8c-4e94-bf3b-1407b18c6ff1 (9671e996-bf8c-4e94-bf3b-1407b18c6ff1): created successfully Sep 04 18:01:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-27647db3-48d9-45c5-89fe-f75f3fe06d79 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c96b3f2-49a2-47e0-86c0-c5643688f08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:01:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-27647db3-48d9-45c5-89fe-f75f3fe06d79 tempest-VolumesGetTest-1631238581 None] Flow 'volume_create_manager' (7114cde9-a247-4fe6-be80-552448b2511a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:01:28 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-27647db3-48d9-45c5-89fe-f75f3fe06d79 tempest-VolumesGetTest-1631238581 None] Created volume successfully. Sep 04 18:01:30 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-64273421-a717-4bff-b0d5-8a895d42b8c4 tempest-VolumesListTestJSON-577326379 None] Acquiring lock "cinder-b7a493b4-d4e7-4541-9533-51d011066e5d-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:01:30 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-64273421-a717-4bff-b0d5-8a895d42b8c4 tempest-VolumesListTestJSON-577326379 None] Lock "cinder-b7a493b4-d4e7-4541-9533-51d011066e5d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:01:30 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa5e14de-c2fb-4564-b548-708ee83bca00 tempest-VolumesGetTest-1631238581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:01:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fa5e14de-c2fb-4564-b548-708ee83bca00 tempest-VolumesGetTest-1631238581 None] Flow 'volume_create_manager' (3900280f-d3b6-40d0-8077-355be336edff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:01:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fa5e14de-c2fb-4564-b548-708ee83bca00 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1367d2c2-6592-4816-afcb-a44507bb1971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:01:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fa5e14de-c2fb-4564-b548-708ee83bca00 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1367d2c2-6592-4816-afcb-a44507bb1971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:01:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-304225342',display_name='tempest-VolumesGetTest-Volume-1120330246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=153ee39d-2132-4f9a-a5d1-2c38a071af93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c96efde19cc4123b29949f3f26b23f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:01:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:01:30Z,use_quota=True,user_id='28d5b941a873423aad147810bdefc056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:01:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fa5e14de-c2fb-4564-b548-708ee83bca00 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a4840f9-6d30-47f3-8478-14fd329cd197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:01:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fa5e14de-c2fb-4564-b548-708ee83bca00 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a4840f9-6d30-47f3-8478-14fd329cd197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:01:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fa5e14de-c2fb-4564-b548-708ee83bca00 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd6be7b6-a93f-4cea-be85-a323d5aedc5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:01:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fa5e14de-c2fb-4564-b548-708ee83bca00 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd6be7b6-a93f-4cea-be85-a323d5aedc5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '153ee39d-2132-4f9a-a5d1-2c38a071af93', 'volume_name': 'volume-153ee39d-2132-4f9a-a5d1-2c38a071af93', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:01:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fa5e14de-c2fb-4564-b548-708ee83bca00 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2dd1677-72fe-48e8-b8b2-95f37f239295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:01:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fa5e14de-c2fb-4564-b548-708ee83bca00 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2dd1677-72fe-48e8-b8b2-95f37f239295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:01:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fa5e14de-c2fb-4564-b548-708ee83bca00 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac731a85-20aa-4829-9e24-b120cdb24e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:01:30 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-fa5e14de-c2fb-4564-b548-708ee83bca00 tempest-VolumesGetTest-1631238581 None] Volume 153ee39d-2132-4f9a-a5d1-2c38a071af93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-153ee39d-2132-4f9a-a5d1-2c38a071af93', 'volume_size': 1} Sep 04 18:01:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fa5e14de-c2fb-4564-b548-708ee83bca00 tempest-VolumesGetTest-1631238581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:01:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fa5e14de-c2fb-4564-b548-708ee83bca00 tempest-VolumesGetTest-1631238581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:01:30 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-fa5e14de-c2fb-4564-b548-708ee83bca00 tempest-VolumesGetTest-1631238581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:01:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-304225342',display_name='tempest-VolumesGetTest-Volume-1120330246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=153ee39d-2132-4f9a-a5d1-2c38a071af93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c96efde19cc4123b29949f3f26b23f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:01:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:01:30Z,use_quota=True,user_id='28d5b941a873423aad147810bdefc056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:01:30 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-fa5e14de-c2fb-4564-b548-708ee83bca00 tempest-VolumesGetTest-1631238581 None] Creating volume 153ee39d-2132-4f9a-a5d1-2c38a071af93 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:01:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fa5e14de-c2fb-4564-b548-708ee83bca00 tempest-VolumesGetTest-1631238581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:01:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fa5e14de-c2fb-4564-b548-708ee83bca00 tempest-VolumesGetTest-1631238581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:01:30 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-fa5e14de-c2fb-4564-b548-708ee83bca00 tempest-VolumesGetTest-1631238581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:01:30 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-fa5e14de-c2fb-4564-b548-708ee83bca00 tempest-VolumesGetTest-1631238581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:01:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fa5e14de-c2fb-4564-b548-708ee83bca00 tempest-VolumesGetTest-1631238581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:01:30 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-fa5e14de-c2fb-4564-b548-708ee83bca00 tempest-VolumesGetTest-1631238581 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:01:30 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-fa5e14de-c2fb-4564-b548-708ee83bca00 tempest-VolumesGetTest-1631238581 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:01:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fa5e14de-c2fb-4564-b548-708ee83bca00 tempest-VolumesGetTest-1631238581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-153ee39d-2132-4f9a-a5d1-2c38a071af93 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:30 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-64273421-a717-4bff-b0d5-8a895d42b8c4 tempest-VolumesListTestJSON-577326379 None] Acquiring lock "cinder-quobyte-b7a493b4-d4e7-4541-9533-51d011066e5d" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:01:30 devstack sudo[100557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-153ee39d-2132-4f9a-a5d1-2c38a071af93 1073741824 Sep 04 18:01:30 devstack sudo[100557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:30 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-64273421-a717-4bff-b0d5-8a895d42b8c4 tempest-VolumesListTestJSON-577326379 None] Lock "cinder-quobyte-b7a493b4-d4e7-4541-9533-51d011066e5d" acquired by "delete_volume" :: waited 0.016s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:01:30 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[2303c684-0a5a-4d62-84d8-ce9c80bfd283]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:01:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-64273421-a717-4bff-b0d5-8a895d42b8c4 tempest-VolumesListTestJSON-577326379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b7a493b4-d4e7-4541-9533-51d011066e5d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:30 devstack sudo[100559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b7a493b4-d4e7-4541-9533-51d011066e5d Sep 04 18:01:30 devstack sudo[100559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:30 devstack sudo[100557]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fa5e14de-c2fb-4564-b548-708ee83bca00 tempest-VolumesGetTest-1631238581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-153ee39d-2132-4f9a-a5d1-2c38a071af93 1073741824" returned: 0 in 0.445s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:31 devstack sudo[100559]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-64273421-a717-4bff-b0d5-8a895d42b8c4 tempest-VolumesListTestJSON-577326379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b7a493b4-d4e7-4541-9533-51d011066e5d" returned: 0 in 0.394s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-64273421-a717-4bff-b0d5-8a895d42b8c4 tempest-VolumesListTestJSON-577326379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b7a493b4-d4e7-4541-9533-51d011066e5d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:31 devstack sudo[100567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b7a493b4-d4e7-4541-9533-51d011066e5d Sep 04 18:01:31 devstack sudo[100567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fa5e14de-c2fb-4564-b548-708ee83bca00 tempest-VolumesGetTest-1631238581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-153ee39d-2132-4f9a-a5d1-2c38a071af93 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:31 devstack sudo[100569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-153ee39d-2132-4f9a-a5d1-2c38a071af93 Sep 04 18:01:31 devstack sudo[100569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:31 devstack sudo[100567]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-64273421-a717-4bff-b0d5-8a895d42b8c4 tempest-VolumesListTestJSON-577326379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b7a493b4-d4e7-4541-9533-51d011066e5d" returned: 0 in 0.252s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:31 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-64273421-a717-4bff-b0d5-8a895d42b8c4 tempest-VolumesListTestJSON-577326379 None] Lock "cinder-quobyte-b7a493b4-d4e7-4541-9533-51d011066e5d" released by "delete_volume" :: held 0.693s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:01:31 devstack sudo[100569]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fa5e14de-c2fb-4564-b548-708ee83bca00 tempest-VolumesGetTest-1631238581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-153ee39d-2132-4f9a-a5d1-2c38a071af93" returned: 0 in 0.247s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:31 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-fa5e14de-c2fb-4564-b548-708ee83bca00 tempest-VolumesGetTest-1631238581 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:01:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fa5e14de-c2fb-4564-b548-708ee83bca00 tempest-VolumesGetTest-1631238581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:01:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fa5e14de-c2fb-4564-b548-708ee83bca00 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac731a85-20aa-4829-9e24-b120cdb24e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-153ee39d-2132-4f9a-a5d1-2c38a071af93', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:01:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fa5e14de-c2fb-4564-b548-708ee83bca00 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78e2c7b2-a986-4895-992e-6faaa547edf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:01:31 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-fa5e14de-c2fb-4564-b548-708ee83bca00 tempest-VolumesGetTest-1631238581 None] Volume volume-153ee39d-2132-4f9a-a5d1-2c38a071af93 (153ee39d-2132-4f9a-a5d1-2c38a071af93): created successfully Sep 04 18:01:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fa5e14de-c2fb-4564-b548-708ee83bca00 tempest-VolumesGetTest-1631238581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78e2c7b2-a986-4895-992e-6faaa547edf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:01:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fa5e14de-c2fb-4564-b548-708ee83bca00 tempest-VolumesGetTest-1631238581 None] Flow 'volume_create_manager' (3900280f-d3b6-40d0-8077-355be336edff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:01:31 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-fa5e14de-c2fb-4564-b548-708ee83bca00 tempest-VolumesGetTest-1631238581 None] Created volume successfully. Sep 04 18:01:31 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-64273421-a717-4bff-b0d5-8a895d42b8c4 tempest-VolumesListTestJSON-577326379 None] Created reservations ['1d3b0de5-516b-4a4d-95fc-1e9ea76ad315', '6aab9fae-6a9d-4b42-bb72-eac4b12e3d3c', '37f26ab0-08fb-4c32-9d02-0ba956e7443d', '72002e41-8012-4828-a7f6-e554597deb99'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:01:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-64273421-a717-4bff-b0d5-8a895d42b8c4 tempest-VolumesListTestJSON-577326379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:01:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-64273421-a717-4bff-b0d5-8a895d42b8c4 tempest-VolumesListTestJSON-577326379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:01:31 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-64273421-a717-4bff-b0d5-8a895d42b8c4 tempest-VolumesListTestJSON-577326379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:01:31 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-64273421-a717-4bff-b0d5-8a895d42b8c4 tempest-VolumesListTestJSON-577326379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:01:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-64273421-a717-4bff-b0d5-8a895d42b8c4 tempest-VolumesListTestJSON-577326379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:01:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-64273421-a717-4bff-b0d5-8a895d42b8c4 tempest-VolumesListTestJSON-577326379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:31 devstack sudo[100573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:01:31 devstack sudo[100573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:31 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-471dd9f6-4c54-4da8-adce-8d86ff7222f7 tempest-VolumesGetTest-1631238581 None] Acquiring lock "cinder-153ee39d-2132-4f9a-a5d1-2c38a071af93-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:01:31 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-471dd9f6-4c54-4da8-adce-8d86ff7222f7 tempest-VolumesGetTest-1631238581 None] Lock "cinder-153ee39d-2132-4f9a-a5d1-2c38a071af93-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:01:31 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e8196d92-d068-4186-b100-5fa7b79f6fa1 tempest-VolumesListTestJSON-577326379 None] Acquiring lock "cinder-e5bed400-7ecc-4f49-846b-8292c70421e2-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:01:31 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e8196d92-d068-4186-b100-5fa7b79f6fa1 tempest-VolumesListTestJSON-577326379 None] Lock "cinder-e5bed400-7ecc-4f49-846b-8292c70421e2-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:01:31 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-471dd9f6-4c54-4da8-adce-8d86ff7222f7 tempest-VolumesGetTest-1631238581 None] Acquiring lock "cinder-quobyte-153ee39d-2132-4f9a-a5d1-2c38a071af93" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:01:31 devstack sudo[100573]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-64273421-a717-4bff-b0d5-8a895d42b8c4 tempest-VolumesListTestJSON-577326379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.305s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:31 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-64273421-a717-4bff-b0d5-8a895d42b8c4 tempest-VolumesListTestJSON-577326379 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:01:31 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-64273421-a717-4bff-b0d5-8a895d42b8c4 tempest-VolumesListTestJSON-577326379 None] Deleted volume successfully. Sep 04 18:01:31 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e8196d92-d068-4186-b100-5fa7b79f6fa1 tempest-VolumesListTestJSON-577326379 None] Acquiring lock "cinder-quobyte-e5bed400-7ecc-4f49-846b-8292c70421e2" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:01:31 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-471dd9f6-4c54-4da8-adce-8d86ff7222f7 tempest-VolumesGetTest-1631238581 None] Lock "cinder-quobyte-153ee39d-2132-4f9a-a5d1-2c38a071af93" acquired by "delete_volume" :: waited 0.034s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:01:31 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e8196d92-d068-4186-b100-5fa7b79f6fa1 tempest-VolumesListTestJSON-577326379 None] Lock "cinder-quobyte-e5bed400-7ecc-4f49-846b-8292c70421e2" acquired by "delete_volume" :: waited 0.030s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:01:31 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[a400de99-0f55-4807-ba56-09eeb48cb2ab]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:01:31 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-64273421-a717-4bff-b0d5-8a895d42b8c4 tempest-VolumesListTestJSON-577326379 None] Lock "cinder-b7a493b4-d4e7-4541-9533-51d011066e5d-delete_volume" released by "delete_volume" :: held 1.359s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:01:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-471dd9f6-4c54-4da8-adce-8d86ff7222f7 tempest-VolumesGetTest-1631238581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-153ee39d-2132-4f9a-a5d1-2c38a071af93 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:31 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[786ddcbb-3e16-4e89-961f-7d36260bc33d]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:01:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e8196d92-d068-4186-b100-5fa7b79f6fa1 tempest-VolumesListTestJSON-577326379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-e5bed400-7ecc-4f49-846b-8292c70421e2 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:31 devstack sudo[100576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-153ee39d-2132-4f9a-a5d1-2c38a071af93 Sep 04 18:01:31 devstack sudo[100576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:31 devstack sudo[100577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-e5bed400-7ecc-4f49-846b-8292c70421e2 Sep 04 18:01:31 devstack sudo[100577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:32 devstack sudo[100576]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-471dd9f6-4c54-4da8-adce-8d86ff7222f7 tempest-VolumesGetTest-1631238581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-153ee39d-2132-4f9a-a5d1-2c38a071af93" returned: 0 in 0.362s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-471dd9f6-4c54-4da8-adce-8d86ff7222f7 tempest-VolumesGetTest-1631238581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-153ee39d-2132-4f9a-a5d1-2c38a071af93 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:32 devstack sudo[100577]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e8196d92-d068-4186-b100-5fa7b79f6fa1 tempest-VolumesListTestJSON-577326379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-e5bed400-7ecc-4f49-846b-8292c70421e2" returned: 0 in 0.374s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e8196d92-d068-4186-b100-5fa7b79f6fa1 tempest-VolumesListTestJSON-577326379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-e5bed400-7ecc-4f49-846b-8292c70421e2 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:32 devstack sudo[100586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-153ee39d-2132-4f9a-a5d1-2c38a071af93 Sep 04 18:01:32 devstack sudo[100586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:32 devstack sudo[100587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-e5bed400-7ecc-4f49-846b-8292c70421e2 Sep 04 18:01:32 devstack sudo[100587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:32 devstack sudo[100586]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-471dd9f6-4c54-4da8-adce-8d86ff7222f7 tempest-VolumesGetTest-1631238581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-153ee39d-2132-4f9a-a5d1-2c38a071af93" returned: 0 in 0.253s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:32 devstack sudo[100587]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e8196d92-d068-4186-b100-5fa7b79f6fa1 tempest-VolumesListTestJSON-577326379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-e5bed400-7ecc-4f49-846b-8292c70421e2" returned: 0 in 0.242s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:32 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-471dd9f6-4c54-4da8-adce-8d86ff7222f7 tempest-VolumesGetTest-1631238581 None] Lock "cinder-quobyte-153ee39d-2132-4f9a-a5d1-2c38a071af93" released by "delete_volume" :: held 0.679s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:01:32 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e8196d92-d068-4186-b100-5fa7b79f6fa1 tempest-VolumesListTestJSON-577326379 None] Lock "cinder-quobyte-e5bed400-7ecc-4f49-846b-8292c70421e2" released by "delete_volume" :: held 0.659s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:01:32 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-471dd9f6-4c54-4da8-adce-8d86ff7222f7 tempest-VolumesGetTest-1631238581 None] Created reservations ['a1a1d563-b529-4da6-a0ce-2cc40682df6c', '0153c8e9-ffe2-4171-818c-8c5dcb4f0de5', '3c301acd-cf8f-4be7-b680-3c6137f8c374', 'bad83060-946c-4793-9a59-bff1da60572a'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:01:32 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-e8196d92-d068-4186-b100-5fa7b79f6fa1 tempest-VolumesListTestJSON-577326379 None] Created reservations ['3b1aac7e-370c-4123-a70e-5ef40089ffd8', '260697f8-6df6-4927-8e70-fd251b6e9322', '4e4c7960-6940-4be6-b3cc-e7c2f5bc0b4a', '302508fb-7739-464c-ba6e-4dadea425d11'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:01:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-471dd9f6-4c54-4da8-adce-8d86ff7222f7 tempest-VolumesGetTest-1631238581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:01:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-471dd9f6-4c54-4da8-adce-8d86ff7222f7 tempest-VolumesGetTest-1631238581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:01:32 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-471dd9f6-4c54-4da8-adce-8d86ff7222f7 tempest-VolumesGetTest-1631238581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:01:32 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-471dd9f6-4c54-4da8-adce-8d86ff7222f7 tempest-VolumesGetTest-1631238581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:01:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-471dd9f6-4c54-4da8-adce-8d86ff7222f7 tempest-VolumesGetTest-1631238581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:01:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-471dd9f6-4c54-4da8-adce-8d86ff7222f7 tempest-VolumesGetTest-1631238581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:32 devstack sudo[100592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:01:32 devstack sudo[100592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e8196d92-d068-4186-b100-5fa7b79f6fa1 tempest-VolumesListTestJSON-577326379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:01:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e8196d92-d068-4186-b100-5fa7b79f6fa1 tempest-VolumesListTestJSON-577326379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:01:32 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e8196d92-d068-4186-b100-5fa7b79f6fa1 tempest-VolumesListTestJSON-577326379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:01:32 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e8196d92-d068-4186-b100-5fa7b79f6fa1 tempest-VolumesListTestJSON-577326379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:01:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e8196d92-d068-4186-b100-5fa7b79f6fa1 tempest-VolumesListTestJSON-577326379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:01:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e8196d92-d068-4186-b100-5fa7b79f6fa1 tempest-VolumesListTestJSON-577326379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:32 devstack sudo[100594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:01:32 devstack sudo[100594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:32 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d8e89ff8-555b-45d5-a387-132e386bfb1d tempest-VolumesListTestJSON-577326379 None] Acquiring lock "cinder-70a72309-ed8b-4ef6-8097-b343b2a42a0d-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:01:32 devstack sudo[100592]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:32 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-35d33737-fd7d-4117-850a-6afc855cc5e7 tempest-VolumesGetTest-1631238581 None] Acquiring lock "cinder-9671e996-bf8c-4e94-bf3b-1407b18c6ff1-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:01:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-471dd9f6-4c54-4da8-adce-8d86ff7222f7 tempest-VolumesGetTest-1631238581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.354s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:32 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-471dd9f6-4c54-4da8-adce-8d86ff7222f7 tempest-VolumesGetTest-1631238581 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:01:32 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-471dd9f6-4c54-4da8-adce-8d86ff7222f7 tempest-VolumesGetTest-1631238581 None] Deleted volume successfully. Sep 04 18:01:32 devstack sudo[100594]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:32 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-35d33737-fd7d-4117-850a-6afc855cc5e7 tempest-VolumesGetTest-1631238581 None] Lock "cinder-9671e996-bf8c-4e94-bf3b-1407b18c6ff1-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:01:33 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d8e89ff8-555b-45d5-a387-132e386bfb1d tempest-VolumesListTestJSON-577326379 None] Lock "cinder-70a72309-ed8b-4ef6-8097-b343b2a42a0d-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:01:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e8196d92-d068-4186-b100-5fa7b79f6fa1 tempest-VolumesListTestJSON-577326379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.401s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:33 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-e8196d92-d068-4186-b100-5fa7b79f6fa1 tempest-VolumesListTestJSON-577326379 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:01:33 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-e8196d92-d068-4186-b100-5fa7b79f6fa1 tempest-VolumesListTestJSON-577326379 None] Deleted volume successfully. Sep 04 18:01:33 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-471dd9f6-4c54-4da8-adce-8d86ff7222f7 tempest-VolumesGetTest-1631238581 None] Lock "cinder-153ee39d-2132-4f9a-a5d1-2c38a071af93-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:01:33 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-35d33737-fd7d-4117-850a-6afc855cc5e7 tempest-VolumesGetTest-1631238581 None] Acquiring lock "cinder-quobyte-9671e996-bf8c-4e94-bf3b-1407b18c6ff1" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:01:33 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-35d33737-fd7d-4117-850a-6afc855cc5e7 tempest-VolumesGetTest-1631238581 None] Lock "cinder-quobyte-9671e996-bf8c-4e94-bf3b-1407b18c6ff1" acquired by "delete_volume" :: waited 0.020s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:01:33 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e8196d92-d068-4186-b100-5fa7b79f6fa1 tempest-VolumesListTestJSON-577326379 None] Lock "cinder-e5bed400-7ecc-4f49-846b-8292c70421e2-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:01:33 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d8e89ff8-555b-45d5-a387-132e386bfb1d tempest-VolumesListTestJSON-577326379 None] Acquiring lock "cinder-quobyte-70a72309-ed8b-4ef6-8097-b343b2a42a0d" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:01:33 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e60972-d28d-40f6-8833-ca8318ff7700]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:01:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-35d33737-fd7d-4117-850a-6afc855cc5e7 tempest-VolumesGetTest-1631238581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9671e996-bf8c-4e94-bf3b-1407b18c6ff1 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:33 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d8e89ff8-555b-45d5-a387-132e386bfb1d tempest-VolumesListTestJSON-577326379 None] Lock "cinder-quobyte-70a72309-ed8b-4ef6-8097-b343b2a42a0d" acquired by "delete_volume" :: waited 0.019s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:01:33 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c65400-5780-400f-827d-95aa28cf6cc5]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:01:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d8e89ff8-555b-45d5-a387-132e386bfb1d tempest-VolumesListTestJSON-577326379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-70a72309-ed8b-4ef6-8097-b343b2a42a0d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:33 devstack sudo[100599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9671e996-bf8c-4e94-bf3b-1407b18c6ff1 Sep 04 18:01:33 devstack sudo[100599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:33 devstack sudo[100600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-70a72309-ed8b-4ef6-8097-b343b2a42a0d Sep 04 18:01:33 devstack sudo[100600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:33 devstack sudo[100599]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-35d33737-fd7d-4117-850a-6afc855cc5e7 tempest-VolumesGetTest-1631238581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9671e996-bf8c-4e94-bf3b-1407b18c6ff1" returned: 0 in 0.357s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-35d33737-fd7d-4117-850a-6afc855cc5e7 tempest-VolumesGetTest-1631238581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9671e996-bf8c-4e94-bf3b-1407b18c6ff1 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:33 devstack sudo[100600]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d8e89ff8-555b-45d5-a387-132e386bfb1d tempest-VolumesListTestJSON-577326379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-70a72309-ed8b-4ef6-8097-b343b2a42a0d" returned: 0 in 0.344s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d8e89ff8-555b-45d5-a387-132e386bfb1d tempest-VolumesListTestJSON-577326379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-70a72309-ed8b-4ef6-8097-b343b2a42a0d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:33 devstack sudo[100610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9671e996-bf8c-4e94-bf3b-1407b18c6ff1 Sep 04 18:01:33 devstack sudo[100610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:33 devstack sudo[100612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-70a72309-ed8b-4ef6-8097-b343b2a42a0d Sep 04 18:01:33 devstack sudo[100612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:33 devstack sudo[100610]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-35d33737-fd7d-4117-850a-6afc855cc5e7 tempest-VolumesGetTest-1631238581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9671e996-bf8c-4e94-bf3b-1407b18c6ff1" returned: 0 in 0.245s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:33 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-35d33737-fd7d-4117-850a-6afc855cc5e7 tempest-VolumesGetTest-1631238581 None] Lock "cinder-quobyte-9671e996-bf8c-4e94-bf3b-1407b18c6ff1" released by "delete_volume" :: held 0.645s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:01:33 devstack sudo[100612]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d8e89ff8-555b-45d5-a387-132e386bfb1d tempest-VolumesListTestJSON-577326379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-70a72309-ed8b-4ef6-8097-b343b2a42a0d" returned: 0 in 0.258s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:33 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d8e89ff8-555b-45d5-a387-132e386bfb1d tempest-VolumesListTestJSON-577326379 None] Lock "cinder-quobyte-70a72309-ed8b-4ef6-8097-b343b2a42a0d" released by "delete_volume" :: held 0.642s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:01:33 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-35d33737-fd7d-4117-850a-6afc855cc5e7 tempest-VolumesGetTest-1631238581 None] Created reservations ['c8519528-6fad-4bad-bf72-dcb2ee54c27c', 'c7b78002-a09b-4401-b242-ea21184ee3d0', '4ddca8c2-bd95-4b5c-9bd4-8f76efc2b132', 'fb55e966-5777-4903-987f-d1107aa35859'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:01:33 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-d8e89ff8-555b-45d5-a387-132e386bfb1d tempest-VolumesListTestJSON-577326379 None] Created reservations ['a20270ce-3083-4388-b138-e0bd8cbc2f2c', 'cdff48c5-f629-44e6-b37a-096ef547fdce', '4ce163db-6577-4061-ad6f-f766d7c5461b', 'd07bb73b-ea33-46b0-96a7-55c549bfb97d'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:01:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-35d33737-fd7d-4117-850a-6afc855cc5e7 tempest-VolumesGetTest-1631238581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:01:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-35d33737-fd7d-4117-850a-6afc855cc5e7 tempest-VolumesGetTest-1631238581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:01:33 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-35d33737-fd7d-4117-850a-6afc855cc5e7 tempest-VolumesGetTest-1631238581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:01:33 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-35d33737-fd7d-4117-850a-6afc855cc5e7 tempest-VolumesGetTest-1631238581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:01:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-35d33737-fd7d-4117-850a-6afc855cc5e7 tempest-VolumesGetTest-1631238581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:01:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-35d33737-fd7d-4117-850a-6afc855cc5e7 tempest-VolumesGetTest-1631238581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:34 devstack sudo[100616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:01:34 devstack sudo[100616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d8e89ff8-555b-45d5-a387-132e386bfb1d tempest-VolumesListTestJSON-577326379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:01:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d8e89ff8-555b-45d5-a387-132e386bfb1d tempest-VolumesListTestJSON-577326379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:01:34 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d8e89ff8-555b-45d5-a387-132e386bfb1d tempest-VolumesListTestJSON-577326379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:01:34 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d8e89ff8-555b-45d5-a387-132e386bfb1d tempest-VolumesListTestJSON-577326379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:01:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d8e89ff8-555b-45d5-a387-132e386bfb1d tempest-VolumesListTestJSON-577326379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:01:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d8e89ff8-555b-45d5-a387-132e386bfb1d tempest-VolumesListTestJSON-577326379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:34 devstack sudo[100618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:01:34 devstack sudo[100618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:34 devstack sudo[100616]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-35d33737-fd7d-4117-850a-6afc855cc5e7 tempest-VolumesGetTest-1631238581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.296s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:34 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-35d33737-fd7d-4117-850a-6afc855cc5e7 tempest-VolumesGetTest-1631238581 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:01:34 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-35d33737-fd7d-4117-850a-6afc855cc5e7 tempest-VolumesGetTest-1631238581 None] Deleted volume successfully. Sep 04 18:01:34 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-35d33737-fd7d-4117-850a-6afc855cc5e7 tempest-VolumesGetTest-1631238581 None] Lock "cinder-9671e996-bf8c-4e94-bf3b-1407b18c6ff1-delete_volume" released by "delete_volume" :: held 1.324s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:01:34 devstack sudo[100618]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d8e89ff8-555b-45d5-a387-132e386bfb1d tempest-VolumesListTestJSON-577326379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.306s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:34 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-d8e89ff8-555b-45d5-a387-132e386bfb1d tempest-VolumesListTestJSON-577326379 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:01:34 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-d8e89ff8-555b-45d5-a387-132e386bfb1d tempest-VolumesListTestJSON-577326379 None] Deleted volume successfully. Sep 04 18:01:34 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d8e89ff8-555b-45d5-a387-132e386bfb1d tempest-VolumesListTestJSON-577326379 None] Lock "cinder-70a72309-ed8b-4ef6-8097-b343b2a42a0d-delete_volume" released by "delete_volume" :: held 1.361s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:01:37 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-49071ea1-64ed-46ba-b834-36f9610fa796 tempest-VolumesNegativeTest-187336238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:01:37 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-49071ea1-64ed-46ba-b834-36f9610fa796 tempest-VolumesNegativeTest-187336238 None] Flow 'volume_create_manager' (a22d8499-19ae-4119-a94f-1d7b0ca83beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:01:37 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-49071ea1-64ed-46ba-b834-36f9610fa796 tempest-VolumesNegativeTest-187336238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66be9dc9-5cb9-47fc-894c-949197182476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:01:37 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-49071ea1-64ed-46ba-b834-36f9610fa796 tempest-VolumesNegativeTest-187336238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66be9dc9-5cb9-47fc-894c-949197182476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:01:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-226852459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdc774fa-0bb5-4a88-a316-3820de65ac22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7920bc3c318b4d2883532295ba5edaa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:01:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:01:37Z,use_quota=True,user_id='1a9b08926c22412f97e5a73022219e65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:01:37 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-49071ea1-64ed-46ba-b834-36f9610fa796 tempest-VolumesNegativeTest-187336238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74703c89-9edc-4227-beba-17171e72cd9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:01:37 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-49071ea1-64ed-46ba-b834-36f9610fa796 tempest-VolumesNegativeTest-187336238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74703c89-9edc-4227-beba-17171e72cd9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:01:37 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-49071ea1-64ed-46ba-b834-36f9610fa796 tempest-VolumesNegativeTest-187336238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fabc913f-f7c7-4df0-9f5c-edba0d870529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:01:37 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-49071ea1-64ed-46ba-b834-36f9610fa796 tempest-VolumesNegativeTest-187336238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fabc913f-f7c7-4df0-9f5c-edba0d870529) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdc774fa-0bb5-4a88-a316-3820de65ac22', 'volume_name': 'volume-cdc774fa-0bb5-4a88-a316-3820de65ac22', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:01:37 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-49071ea1-64ed-46ba-b834-36f9610fa796 tempest-VolumesNegativeTest-187336238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41bdbc00-b250-4c48-9ad3-b30a7625b2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:01:37 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-49071ea1-64ed-46ba-b834-36f9610fa796 tempest-VolumesNegativeTest-187336238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41bdbc00-b250-4c48-9ad3-b30a7625b2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:01:37 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-49071ea1-64ed-46ba-b834-36f9610fa796 tempest-VolumesNegativeTest-187336238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b7e23c1-488d-46e3-8750-d0a9d50668eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:01:37 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-49071ea1-64ed-46ba-b834-36f9610fa796 tempest-VolumesNegativeTest-187336238 None] Volume cdc774fa-0bb5-4a88-a316-3820de65ac22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdc774fa-0bb5-4a88-a316-3820de65ac22', 'volume_size': 1} Sep 04 18:01:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-49071ea1-64ed-46ba-b834-36f9610fa796 tempest-VolumesNegativeTest-187336238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:01:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-49071ea1-64ed-46ba-b834-36f9610fa796 tempest-VolumesNegativeTest-187336238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:01:37 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-49071ea1-64ed-46ba-b834-36f9610fa796 tempest-VolumesNegativeTest-187336238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:01:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-226852459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdc774fa-0bb5-4a88-a316-3820de65ac22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7920bc3c318b4d2883532295ba5edaa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:01:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:01:37Z,use_quota=True,user_id='1a9b08926c22412f97e5a73022219e65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:01:37 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-49071ea1-64ed-46ba-b834-36f9610fa796 tempest-VolumesNegativeTest-187336238 None] Creating volume cdc774fa-0bb5-4a88-a316-3820de65ac22 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:01:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-49071ea1-64ed-46ba-b834-36f9610fa796 tempest-VolumesNegativeTest-187336238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:01:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-49071ea1-64ed-46ba-b834-36f9610fa796 tempest-VolumesNegativeTest-187336238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:01:37 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-49071ea1-64ed-46ba-b834-36f9610fa796 tempest-VolumesNegativeTest-187336238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:01:37 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-49071ea1-64ed-46ba-b834-36f9610fa796 tempest-VolumesNegativeTest-187336238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:01:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-49071ea1-64ed-46ba-b834-36f9610fa796 tempest-VolumesNegativeTest-187336238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:01:37 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-49071ea1-64ed-46ba-b834-36f9610fa796 tempest-VolumesNegativeTest-187336238 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:01:37 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-49071ea1-64ed-46ba-b834-36f9610fa796 tempest-VolumesNegativeTest-187336238 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:01:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-49071ea1-64ed-46ba-b834-36f9610fa796 tempest-VolumesNegativeTest-187336238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cdc774fa-0bb5-4a88-a316-3820de65ac22 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:37 devstack sudo[100623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cdc774fa-0bb5-4a88-a316-3820de65ac22 1073741824 Sep 04 18:01:37 devstack sudo[100623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:37 devstack sudo[100623]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-49071ea1-64ed-46ba-b834-36f9610fa796 tempest-VolumesNegativeTest-187336238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cdc774fa-0bb5-4a88-a316-3820de65ac22 1073741824" returned: 0 in 0.529s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-49071ea1-64ed-46ba-b834-36f9610fa796 tempest-VolumesNegativeTest-187336238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cdc774fa-0bb5-4a88-a316-3820de65ac22 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:37 devstack sudo[100629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cdc774fa-0bb5-4a88-a316-3820de65ac22 Sep 04 18:01:37 devstack sudo[100629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:38 devstack sudo[100629]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-49071ea1-64ed-46ba-b834-36f9610fa796 tempest-VolumesNegativeTest-187336238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cdc774fa-0bb5-4a88-a316-3820de65ac22" returned: 0 in 0.271s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:38 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-49071ea1-64ed-46ba-b834-36f9610fa796 tempest-VolumesNegativeTest-187336238 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:01:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-49071ea1-64ed-46ba-b834-36f9610fa796 tempest-VolumesNegativeTest-187336238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:01:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-49071ea1-64ed-46ba-b834-36f9610fa796 tempest-VolumesNegativeTest-187336238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b7e23c1-488d-46e3-8750-d0a9d50668eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdc774fa-0bb5-4a88-a316-3820de65ac22', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:01:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-49071ea1-64ed-46ba-b834-36f9610fa796 tempest-VolumesNegativeTest-187336238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba8a9eb5-eadb-4716-ae5d-5b7a2be4504d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:01:38 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-49071ea1-64ed-46ba-b834-36f9610fa796 tempest-VolumesNegativeTest-187336238 None] Volume volume-cdc774fa-0bb5-4a88-a316-3820de65ac22 (cdc774fa-0bb5-4a88-a316-3820de65ac22): created successfully Sep 04 18:01:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-49071ea1-64ed-46ba-b834-36f9610fa796 tempest-VolumesNegativeTest-187336238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba8a9eb5-eadb-4716-ae5d-5b7a2be4504d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:01:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-49071ea1-64ed-46ba-b834-36f9610fa796 tempest-VolumesNegativeTest-187336238 None] Flow 'volume_create_manager' (a22d8499-19ae-4119-a94f-1d7b0ca83beb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:01:38 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-49071ea1-64ed-46ba-b834-36f9610fa796 tempest-VolumesNegativeTest-187336238 None] Created volume successfully. Sep 04 18:01:46 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc479ded-94ca-4d6d-bd5c-18bdc441e798 tempest-VolumesSnapshotTestJSON-1349136939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:01:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bc479ded-94ca-4d6d-bd5c-18bdc441e798 tempest-VolumesSnapshotTestJSON-1349136939 None] Flow 'volume_create_manager' (bea97a8e-c8cd-405e-b2a1-a3731f81f829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:01:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bc479ded-94ca-4d6d-bd5c-18bdc441e798 tempest-VolumesSnapshotTestJSON-1349136939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (878a78bd-4792-4e90-baf3-bf3a2cc252fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:01:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bc479ded-94ca-4d6d-bd5c-18bdc441e798 tempest-VolumesSnapshotTestJSON-1349136939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (878a78bd-4792-4e90-baf3-bf3a2cc252fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1289384545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cc00d04-b6f7-49bf-9771-41f83e9515d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3454598b66b044eaba782c7968c61bd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:01:46Z,use_quota=True,user_id='3333db5074064e1bafe4fc1cfc243cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:01:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bc479ded-94ca-4d6d-bd5c-18bdc441e798 tempest-VolumesSnapshotTestJSON-1349136939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4611047-518b-4204-8358-71d1982e187a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:01:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bc479ded-94ca-4d6d-bd5c-18bdc441e798 tempest-VolumesSnapshotTestJSON-1349136939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4611047-518b-4204-8358-71d1982e187a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:01:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bc479ded-94ca-4d6d-bd5c-18bdc441e798 tempest-VolumesSnapshotTestJSON-1349136939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a19f286-2107-4d69-9e3f-2d8d8e24f35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:01:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bc479ded-94ca-4d6d-bd5c-18bdc441e798 tempest-VolumesSnapshotTestJSON-1349136939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a19f286-2107-4d69-9e3f-2d8d8e24f35a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cc00d04-b6f7-49bf-9771-41f83e9515d6', 'volume_name': 'volume-3cc00d04-b6f7-49bf-9771-41f83e9515d6', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:01:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bc479ded-94ca-4d6d-bd5c-18bdc441e798 tempest-VolumesSnapshotTestJSON-1349136939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c2f7f96-702e-41d7-ac19-efb54818accc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:01:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bc479ded-94ca-4d6d-bd5c-18bdc441e798 tempest-VolumesSnapshotTestJSON-1349136939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c2f7f96-702e-41d7-ac19-efb54818accc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:01:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bc479ded-94ca-4d6d-bd5c-18bdc441e798 tempest-VolumesSnapshotTestJSON-1349136939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (364ffe8b-0ed2-43b1-b8c9-d096b0700a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:01:46 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-bc479ded-94ca-4d6d-bd5c-18bdc441e798 tempest-VolumesSnapshotTestJSON-1349136939 None] Volume 3cc00d04-b6f7-49bf-9771-41f83e9515d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cc00d04-b6f7-49bf-9771-41f83e9515d6', 'volume_size': 1} Sep 04 18:01:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bc479ded-94ca-4d6d-bd5c-18bdc441e798 tempest-VolumesSnapshotTestJSON-1349136939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:01:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bc479ded-94ca-4d6d-bd5c-18bdc441e798 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:01:46 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-bc479ded-94ca-4d6d-bd5c-18bdc441e798 tempest-VolumesSnapshotTestJSON-1349136939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1289384545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cc00d04-b6f7-49bf-9771-41f83e9515d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3454598b66b044eaba782c7968c61bd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:01:46Z,use_quota=True,user_id='3333db5074064e1bafe4fc1cfc243cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:01:46 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-bc479ded-94ca-4d6d-bd5c-18bdc441e798 tempest-VolumesSnapshotTestJSON-1349136939 None] Creating volume 3cc00d04-b6f7-49bf-9771-41f83e9515d6 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:01:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bc479ded-94ca-4d6d-bd5c-18bdc441e798 tempest-VolumesSnapshotTestJSON-1349136939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:01:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bc479ded-94ca-4d6d-bd5c-18bdc441e798 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:01:46 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-bc479ded-94ca-4d6d-bd5c-18bdc441e798 tempest-VolumesSnapshotTestJSON-1349136939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:01:46 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-bc479ded-94ca-4d6d-bd5c-18bdc441e798 tempest-VolumesSnapshotTestJSON-1349136939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:01:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bc479ded-94ca-4d6d-bd5c-18bdc441e798 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:01:46 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-bc479ded-94ca-4d6d-bd5c-18bdc441e798 tempest-VolumesSnapshotTestJSON-1349136939 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:01:46 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-bc479ded-94ca-4d6d-bd5c-18bdc441e798 tempest-VolumesSnapshotTestJSON-1349136939 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:01:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bc479ded-94ca-4d6d-bd5c-18bdc441e798 tempest-VolumesSnapshotTestJSON-1349136939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3cc00d04-b6f7-49bf-9771-41f83e9515d6 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:46 devstack sudo[100690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3cc00d04-b6f7-49bf-9771-41f83e9515d6 1073741824 Sep 04 18:01:46 devstack sudo[100690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:47 devstack sudo[100690]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bc479ded-94ca-4d6d-bd5c-18bdc441e798 tempest-VolumesSnapshotTestJSON-1349136939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3cc00d04-b6f7-49bf-9771-41f83e9515d6 1073741824" returned: 0 in 0.694s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bc479ded-94ca-4d6d-bd5c-18bdc441e798 tempest-VolumesSnapshotTestJSON-1349136939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3cc00d04-b6f7-49bf-9771-41f83e9515d6 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:47 devstack sudo[100737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3cc00d04-b6f7-49bf-9771-41f83e9515d6 Sep 04 18:01:47 devstack sudo[100737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:47 devstack sudo[100737]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bc479ded-94ca-4d6d-bd5c-18bdc441e798 tempest-VolumesSnapshotTestJSON-1349136939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3cc00d04-b6f7-49bf-9771-41f83e9515d6" returned: 0 in 0.434s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:47 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-bc479ded-94ca-4d6d-bd5c-18bdc441e798 tempest-VolumesSnapshotTestJSON-1349136939 None] <== create_volume: return (1201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:01:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bc479ded-94ca-4d6d-bd5c-18bdc441e798 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.204s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:01:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bc479ded-94ca-4d6d-bd5c-18bdc441e798 tempest-VolumesSnapshotTestJSON-1349136939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (364ffe8b-0ed2-43b1-b8c9-d096b0700a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cc00d04-b6f7-49bf-9771-41f83e9515d6', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:01:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bc479ded-94ca-4d6d-bd5c-18bdc441e798 tempest-VolumesSnapshotTestJSON-1349136939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (456e4ff2-9f5e-49a9-a24f-61b94f1724bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:01:47 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-bc479ded-94ca-4d6d-bd5c-18bdc441e798 tempest-VolumesSnapshotTestJSON-1349136939 None] Volume volume-3cc00d04-b6f7-49bf-9771-41f83e9515d6 (3cc00d04-b6f7-49bf-9771-41f83e9515d6): created successfully Sep 04 18:01:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bc479ded-94ca-4d6d-bd5c-18bdc441e798 tempest-VolumesSnapshotTestJSON-1349136939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (456e4ff2-9f5e-49a9-a24f-61b94f1724bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:01:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bc479ded-94ca-4d6d-bd5c-18bdc441e798 tempest-VolumesSnapshotTestJSON-1349136939 None] Flow 'volume_create_manager' (bea97a8e-c8cd-405e-b2a1-a3731f81f829) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:01:47 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-bc479ded-94ca-4d6d-bd5c-18bdc441e798 tempest-VolumesSnapshotTestJSON-1349136939 None] Created volume successfully. Sep 04 18:01:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-af8dc7e4-04fb-4594-a94f-28aaf35f7961 tempest-VolumesSnapshotTestJSON-1349136939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:01:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-af8dc7e4-04fb-4594-a94f-28aaf35f7961 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:01:48 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-af8dc7e4-04fb-4594-a94f-28aaf35f7961 tempest-VolumesSnapshotTestJSON-1349136939 None] Creating offline snapshot e2441ccc-acb7-4432-9653-5e9fd8446cf0 of volume 3cc00d04-b6f7-49bf-9771-41f83e9515d6 {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 18:01:48 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[c777906d-1842-4aed-a2da-14d61c450061]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:01:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-af8dc7e4-04fb-4594-a94f-28aaf35f7961 tempest-VolumesSnapshotTestJSON-1349136939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3cc00d04-b6f7-49bf-9771-41f83e9515d6 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:49 devstack sudo[100770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3cc00d04-b6f7-49bf-9771-41f83e9515d6 Sep 04 18:01:49 devstack sudo[100770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:49 devstack sudo[100770]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-af8dc7e4-04fb-4594-a94f-28aaf35f7961 tempest-VolumesSnapshotTestJSON-1349136939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3cc00d04-b6f7-49bf-9771-41f83e9515d6" returned: 0 in 0.382s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-af8dc7e4-04fb-4594-a94f-28aaf35f7961 tempest-VolumesSnapshotTestJSON-1349136939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3cc00d04-b6f7-49bf-9771-41f83e9515d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3cc00d04-b6f7-49bf-9771-41f83e9515d6.e2441ccc-acb7-4432-9653-5e9fd8446cf0 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:49 devstack sudo[100775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3cc00d04-b6f7-49bf-9771-41f83e9515d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3cc00d04-b6f7-49bf-9771-41f83e9515d6.e2441ccc-acb7-4432-9653-5e9fd8446cf0 1G Sep 04 18:01:49 devstack sudo[100775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:49 devstack sudo[100775]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-af8dc7e4-04fb-4594-a94f-28aaf35f7961 tempest-VolumesSnapshotTestJSON-1349136939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3cc00d04-b6f7-49bf-9771-41f83e9515d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3cc00d04-b6f7-49bf-9771-41f83e9515d6.e2441ccc-acb7-4432-9653-5e9fd8446cf0 1G" returned: 0 in 0.434s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-af8dc7e4-04fb-4594-a94f-28aaf35f7961 tempest-VolumesSnapshotTestJSON-1349136939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cc00d04-b6f7-49bf-9771-41f83e9515d6 -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3cc00d04-b6f7-49bf-9771-41f83e9515d6.e2441ccc-acb7-4432-9653-5e9fd8446cf0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:49 devstack sudo[100781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cc00d04-b6f7-49bf-9771-41f83e9515d6 -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3cc00d04-b6f7-49bf-9771-41f83e9515d6.e2441ccc-acb7-4432-9653-5e9fd8446cf0 Sep 04 18:01:49 devstack sudo[100781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:50 devstack sudo[100781]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-af8dc7e4-04fb-4594-a94f-28aaf35f7961 tempest-VolumesSnapshotTestJSON-1349136939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cc00d04-b6f7-49bf-9771-41f83e9515d6 -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3cc00d04-b6f7-49bf-9771-41f83e9515d6.e2441ccc-acb7-4432-9653-5e9fd8446cf0" returned: 0 in 0.341s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:50 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-af8dc7e4-04fb-4594-a94f-28aaf35f7961 tempest-VolumesSnapshotTestJSON-1349136939 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3cc00d04-b6f7-49bf-9771-41f83e9515d6.e2441ccc-acb7-4432-9653-5e9fd8446cf0 is being set with open permissions: ugo+rw Sep 04 18:01:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-af8dc7e4-04fb-4594-a94f-28aaf35f7961 tempest-VolumesSnapshotTestJSON-1349136939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3cc00d04-b6f7-49bf-9771-41f83e9515d6.e2441ccc-acb7-4432-9653-5e9fd8446cf0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:50 devstack sudo[100787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3cc00d04-b6f7-49bf-9771-41f83e9515d6.e2441ccc-acb7-4432-9653-5e9fd8446cf0 Sep 04 18:01:50 devstack sudo[100787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:50 devstack sudo[100787]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-af8dc7e4-04fb-4594-a94f-28aaf35f7961 tempest-VolumesSnapshotTestJSON-1349136939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3cc00d04-b6f7-49bf-9771-41f83e9515d6.e2441ccc-acb7-4432-9653-5e9fd8446cf0" returned: 0 in 0.303s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-af8dc7e4-04fb-4594-a94f-28aaf35f7961 tempest-VolumesSnapshotTestJSON-1349136939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3cc00d04-b6f7-49bf-9771-41f83e9515d6.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:50 devstack sudo[100791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3cc00d04-b6f7-49bf-9771-41f83e9515d6.info Sep 04 18:01:50 devstack sudo[100791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:50 devstack sudo[100791]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-af8dc7e4-04fb-4594-a94f-28aaf35f7961 tempest-VolumesSnapshotTestJSON-1349136939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3cc00d04-b6f7-49bf-9771-41f83e9515d6.info" returned: 0 in 0.355s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:50 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-af8dc7e4-04fb-4594-a94f-28aaf35f7961 tempest-VolumesSnapshotTestJSON-1349136939 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3cc00d04-b6f7-49bf-9771-41f83e9515d6.info is being set with open permissions: ugo+rw Sep 04 18:01:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-af8dc7e4-04fb-4594-a94f-28aaf35f7961 tempest-VolumesSnapshotTestJSON-1349136939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3cc00d04-b6f7-49bf-9771-41f83e9515d6.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:50 devstack sudo[100815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3cc00d04-b6f7-49bf-9771-41f83e9515d6.info Sep 04 18:01:50 devstack sudo[100815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:51 devstack sudo[100815]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-af8dc7e4-04fb-4594-a94f-28aaf35f7961 tempest-VolumesSnapshotTestJSON-1349136939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3cc00d04-b6f7-49bf-9771-41f83e9515d6.info" returned: 0 in 0.261s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-af8dc7e4-04fb-4594-a94f-28aaf35f7961 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.163s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:01:51 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-af8dc7e4-04fb-4594-a94f-28aaf35f7961 tempest-VolumesSnapshotTestJSON-1349136939 None] Create snapshot completed successfully Sep 04 18:01:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-506bba8f-3c3e-4656-a3c6-137f375fbeeb tempest-VolumesSnapshotTestJSON-1349136939 None] Acquiring lock "cinder-e2441ccc-acb7-4432-9653-5e9fd8446cf0-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:01:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-506bba8f-3c3e-4656-a3c6-137f375fbeeb tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "cinder-e2441ccc-acb7-4432-9653-5e9fd8446cf0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:01:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-506bba8f-3c3e-4656-a3c6-137f375fbeeb tempest-VolumesSnapshotTestJSON-1349136939 None] Acquiring lock "cinder-quobyte-3cc00d04-b6f7-49bf-9771-41f83e9515d6" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:01:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-506bba8f-3c3e-4656-a3c6-137f375fbeeb tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "cinder-quobyte-3cc00d04-b6f7-49bf-9771-41f83e9515d6" acquired by "delete_snapshot" :: waited 0.012s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:01:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-506bba8f-3c3e-4656-a3c6-137f375fbeeb tempest-VolumesSnapshotTestJSON-1349136939 None] Acquiring lock "cinder-quobyte-e2441ccc-acb7-4432-9653-5e9fd8446cf0" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:01:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-506bba8f-3c3e-4656-a3c6-137f375fbeeb tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "cinder-quobyte-e2441ccc-acb7-4432-9653-5e9fd8446cf0" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:01:52 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-506bba8f-3c3e-4656-a3c6-137f375fbeeb tempest-VolumesSnapshotTestJSON-1349136939 None] Deleting offline snapshot e2441ccc-acb7-4432-9653-5e9fd8446cf0 of volume 3cc00d04-b6f7-49bf-9771-41f83e9515d6 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 18:01:52 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-506bba8f-3c3e-4656-a3c6-137f375fbeeb tempest-VolumesSnapshotTestJSON-1349136939 None] snapshot_file for this snap is: volume-3cc00d04-b6f7-49bf-9771-41f83e9515d6.e2441ccc-acb7-4432-9653-5e9fd8446cf0 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 18:01:52 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c712ae-d160-4cf3-949e-f3487c1103ac]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:01:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-506bba8f-3c3e-4656-a3c6-137f375fbeeb tempest-VolumesSnapshotTestJSON-1349136939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3cc00d04-b6f7-49bf-9771-41f83e9515d6.e2441ccc-acb7-4432-9653-5e9fd8446cf0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:52 devstack sudo[100820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3cc00d04-b6f7-49bf-9771-41f83e9515d6.e2441ccc-acb7-4432-9653-5e9fd8446cf0 Sep 04 18:01:52 devstack sudo[100820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:52 devstack sudo[100820]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-506bba8f-3c3e-4656-a3c6-137f375fbeeb tempest-VolumesSnapshotTestJSON-1349136939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3cc00d04-b6f7-49bf-9771-41f83e9515d6.e2441ccc-acb7-4432-9653-5e9fd8446cf0" returned: 0 in 0.340s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:52 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-506bba8f-3c3e-4656-a3c6-137f375fbeeb tempest-VolumesSnapshotTestJSON-1349136939 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3cc00d04-b6f7-49bf-9771-41f83e9515d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 18:01:52 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1ccd05-907a-4733-8b04-66814323e32d]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:01:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-506bba8f-3c3e-4656-a3c6-137f375fbeeb tempest-VolumesSnapshotTestJSON-1349136939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3cc00d04-b6f7-49bf-9771-41f83e9515d6 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:52 devstack sudo[100826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3cc00d04-b6f7-49bf-9771-41f83e9515d6 Sep 04 18:01:52 devstack sudo[100826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:52 devstack sudo[100826]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-506bba8f-3c3e-4656-a3c6-137f375fbeeb tempest-VolumesSnapshotTestJSON-1349136939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3cc00d04-b6f7-49bf-9771-41f83e9515d6" returned: 0 in 0.383s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-506bba8f-3c3e-4656-a3c6-137f375fbeeb tempest-VolumesSnapshotTestJSON-1349136939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3cc00d04-b6f7-49bf-9771-41f83e9515d6.e2441ccc-acb7-4432-9653-5e9fd8446cf0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:52 devstack sudo[100831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3cc00d04-b6f7-49bf-9771-41f83e9515d6.e2441ccc-acb7-4432-9653-5e9fd8446cf0 Sep 04 18:01:52 devstack sudo[100831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:53 devstack sudo[100831]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-506bba8f-3c3e-4656-a3c6-137f375fbeeb tempest-VolumesSnapshotTestJSON-1349136939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3cc00d04-b6f7-49bf-9771-41f83e9515d6.e2441ccc-acb7-4432-9653-5e9fd8446cf0" returned: 0 in 0.337s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-506bba8f-3c3e-4656-a3c6-137f375fbeeb tempest-VolumesSnapshotTestJSON-1349136939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3cc00d04-b6f7-49bf-9771-41f83e9515d6.e2441ccc-acb7-4432-9653-5e9fd8446cf0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:53 devstack sudo[100837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3cc00d04-b6f7-49bf-9771-41f83e9515d6.e2441ccc-acb7-4432-9653-5e9fd8446cf0 Sep 04 18:01:53 devstack sudo[100837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:53 devstack sudo[100837]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-506bba8f-3c3e-4656-a3c6-137f375fbeeb tempest-VolumesSnapshotTestJSON-1349136939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3cc00d04-b6f7-49bf-9771-41f83e9515d6.e2441ccc-acb7-4432-9653-5e9fd8446cf0" returned: 0 in 0.244s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:53 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-506bba8f-3c3e-4656-a3c6-137f375fbeeb tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "cinder-quobyte-e2441ccc-acb7-4432-9653-5e9fd8446cf0" released by "_delete_snapshot" :: held 1.401s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:01:53 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-506bba8f-3c3e-4656-a3c6-137f375fbeeb tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "cinder-quobyte-3cc00d04-b6f7-49bf-9771-41f83e9515d6" released by "delete_snapshot" :: held 1.422s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:01:53 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-506bba8f-3c3e-4656-a3c6-137f375fbeeb tempest-VolumesSnapshotTestJSON-1349136939 None] Created reservations ['bade967a-760c-4714-883e-620d62546f63', '7b49d03a-c614-48e4-8fb9-9ef1a4c16ce6', 'e3886e1f-c8fb-4220-9f3a-4b65ea8a2267', '70c78141-c195-4f26-ada9-bb1dd6571428'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:01:53 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-506bba8f-3c3e-4656-a3c6-137f375fbeeb tempest-VolumesSnapshotTestJSON-1349136939 None] Delete snapshot completed successfully. Sep 04 18:01:53 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-506bba8f-3c3e-4656-a3c6-137f375fbeeb tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "cinder-e2441ccc-acb7-4432-9653-5e9fd8446cf0-delete_snapshot" released by "delete_snapshot" :: held 1.590s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:01:54 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbad20e8-b5a2-4e48-b87e-76570157a535 tempest-VolumesSnapshotTestJSON-1349136939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:01:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bbad20e8-b5a2-4e48-b87e-76570157a535 tempest-VolumesSnapshotTestJSON-1349136939 None] Flow 'volume_create_manager' (b74d527b-7c66-482c-9dd2-8b5699cf78b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:01:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bbad20e8-b5a2-4e48-b87e-76570157a535 tempest-VolumesSnapshotTestJSON-1349136939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7092b12-4173-40a4-8cd3-3170c1587c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:01:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bbad20e8-b5a2-4e48-b87e-76570157a535 tempest-VolumesSnapshotTestJSON-1349136939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7092b12-4173-40a4-8cd3-3170c1587c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:01:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1709179552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a921751-f1b4-4202-8a4c-18b77f6080ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3454598b66b044eaba782c7968c61bd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:01:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:01:55Z,use_quota=True,user_id='3333db5074064e1bafe4fc1cfc243cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:01:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bbad20e8-b5a2-4e48-b87e-76570157a535 tempest-VolumesSnapshotTestJSON-1349136939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e9bcc80-f893-4fdd-9984-23165c67c453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:01:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bbad20e8-b5a2-4e48-b87e-76570157a535 tempest-VolumesSnapshotTestJSON-1349136939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e9bcc80-f893-4fdd-9984-23165c67c453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:01:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bbad20e8-b5a2-4e48-b87e-76570157a535 tempest-VolumesSnapshotTestJSON-1349136939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b03351f-1d9c-44c2-a7fa-1831a9f48004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:01:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bbad20e8-b5a2-4e48-b87e-76570157a535 tempest-VolumesSnapshotTestJSON-1349136939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b03351f-1d9c-44c2-a7fa-1831a9f48004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a921751-f1b4-4202-8a4c-18b77f6080ab', 'volume_name': 'volume-8a921751-f1b4-4202-8a4c-18b77f6080ab', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:01:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bbad20e8-b5a2-4e48-b87e-76570157a535 tempest-VolumesSnapshotTestJSON-1349136939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70047539-dfea-4a4f-a72d-19805c091dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:01:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bbad20e8-b5a2-4e48-b87e-76570157a535 tempest-VolumesSnapshotTestJSON-1349136939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70047539-dfea-4a4f-a72d-19805c091dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:01:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bbad20e8-b5a2-4e48-b87e-76570157a535 tempest-VolumesSnapshotTestJSON-1349136939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2783955d-5fc5-4fc9-9d95-61e69cb463fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:01:54 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-bbad20e8-b5a2-4e48-b87e-76570157a535 tempest-VolumesSnapshotTestJSON-1349136939 None] Volume 8a921751-f1b4-4202-8a4c-18b77f6080ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a921751-f1b4-4202-8a4c-18b77f6080ab', 'volume_size': 1} Sep 04 18:01:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bbad20e8-b5a2-4e48-b87e-76570157a535 tempest-VolumesSnapshotTestJSON-1349136939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:01:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bbad20e8-b5a2-4e48-b87e-76570157a535 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:01:54 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-bbad20e8-b5a2-4e48-b87e-76570157a535 tempest-VolumesSnapshotTestJSON-1349136939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:01:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1709179552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a921751-f1b4-4202-8a4c-18b77f6080ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3454598b66b044eaba782c7968c61bd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:01:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:01:55Z,use_quota=True,user_id='3333db5074064e1bafe4fc1cfc243cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:01:54 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-bbad20e8-b5a2-4e48-b87e-76570157a535 tempest-VolumesSnapshotTestJSON-1349136939 None] Creating volume 8a921751-f1b4-4202-8a4c-18b77f6080ab {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:01:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bbad20e8-b5a2-4e48-b87e-76570157a535 tempest-VolumesSnapshotTestJSON-1349136939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:01:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bbad20e8-b5a2-4e48-b87e-76570157a535 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:01:54 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-bbad20e8-b5a2-4e48-b87e-76570157a535 tempest-VolumesSnapshotTestJSON-1349136939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:01:54 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-bbad20e8-b5a2-4e48-b87e-76570157a535 tempest-VolumesSnapshotTestJSON-1349136939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:01:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bbad20e8-b5a2-4e48-b87e-76570157a535 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:01:54 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-bbad20e8-b5a2-4e48-b87e-76570157a535 tempest-VolumesSnapshotTestJSON-1349136939 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:01:54 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-bbad20e8-b5a2-4e48-b87e-76570157a535 tempest-VolumesSnapshotTestJSON-1349136939 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:01:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bbad20e8-b5a2-4e48-b87e-76570157a535 tempest-VolumesSnapshotTestJSON-1349136939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8a921751-f1b4-4202-8a4c-18b77f6080ab 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:54 devstack sudo[100842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8a921751-f1b4-4202-8a4c-18b77f6080ab 1073741824 Sep 04 18:01:54 devstack sudo[100842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:55 devstack sudo[100842]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bbad20e8-b5a2-4e48-b87e-76570157a535 tempest-VolumesSnapshotTestJSON-1349136939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8a921751-f1b4-4202-8a4c-18b77f6080ab 1073741824" returned: 0 in 0.456s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bbad20e8-b5a2-4e48-b87e-76570157a535 tempest-VolumesSnapshotTestJSON-1349136939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8a921751-f1b4-4202-8a4c-18b77f6080ab {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:55 devstack sudo[100849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8a921751-f1b4-4202-8a4c-18b77f6080ab Sep 04 18:01:55 devstack sudo[100849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:55 devstack sudo[100849]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bbad20e8-b5a2-4e48-b87e-76570157a535 tempest-VolumesSnapshotTestJSON-1349136939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8a921751-f1b4-4202-8a4c-18b77f6080ab" returned: 0 in 0.244s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:55 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-bbad20e8-b5a2-4e48-b87e-76570157a535 tempest-VolumesSnapshotTestJSON-1349136939 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:01:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bbad20e8-b5a2-4e48-b87e-76570157a535 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:01:55 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bbad20e8-b5a2-4e48-b87e-76570157a535 tempest-VolumesSnapshotTestJSON-1349136939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2783955d-5fc5-4fc9-9d95-61e69cb463fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a921751-f1b4-4202-8a4c-18b77f6080ab', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:01:55 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bbad20e8-b5a2-4e48-b87e-76570157a535 tempest-VolumesSnapshotTestJSON-1349136939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0a06907-e056-42c5-be08-72007b7804db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:01:55 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-bbad20e8-b5a2-4e48-b87e-76570157a535 tempest-VolumesSnapshotTestJSON-1349136939 None] Volume volume-8a921751-f1b4-4202-8a4c-18b77f6080ab (8a921751-f1b4-4202-8a4c-18b77f6080ab): created successfully Sep 04 18:01:55 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bbad20e8-b5a2-4e48-b87e-76570157a535 tempest-VolumesSnapshotTestJSON-1349136939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0a06907-e056-42c5-be08-72007b7804db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:01:55 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bbad20e8-b5a2-4e48-b87e-76570157a535 tempest-VolumesSnapshotTestJSON-1349136939 None] Flow 'volume_create_manager' (b74d527b-7c66-482c-9dd2-8b5699cf78b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:01:55 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-bbad20e8-b5a2-4e48-b87e-76570157a535 tempest-VolumesSnapshotTestJSON-1349136939 None] Created volume successfully. Sep 04 18:01:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fce0feda-bcca-4d92-ba3d-c40dcfa18b39 tempest-VolumesSnapshotTestJSON-1349136939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:01:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fce0feda-bcca-4d92-ba3d-c40dcfa18b39 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:01:55 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-fce0feda-bcca-4d92-ba3d-c40dcfa18b39 tempest-VolumesSnapshotTestJSON-1349136939 None] Creating offline snapshot 2f43ae3f-557f-4d6e-99fe-ff9975e4a725 of volume 8a921751-f1b4-4202-8a4c-18b77f6080ab {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 18:01:55 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[49fe3f16-51b3-4294-9a68-70c0754f627b]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:01:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fce0feda-bcca-4d92-ba3d-c40dcfa18b39 tempest-VolumesSnapshotTestJSON-1349136939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8a921751-f1b4-4202-8a4c-18b77f6080ab {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:56 devstack sudo[100852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8a921751-f1b4-4202-8a4c-18b77f6080ab Sep 04 18:01:56 devstack sudo[100852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:56 devstack sudo[100852]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fce0feda-bcca-4d92-ba3d-c40dcfa18b39 tempest-VolumesSnapshotTestJSON-1349136939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8a921751-f1b4-4202-8a4c-18b77f6080ab" returned: 0 in 0.364s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fce0feda-bcca-4d92-ba3d-c40dcfa18b39 tempest-VolumesSnapshotTestJSON-1349136939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8a921751-f1b4-4202-8a4c-18b77f6080ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8a921751-f1b4-4202-8a4c-18b77f6080ab.2f43ae3f-557f-4d6e-99fe-ff9975e4a725 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:56 devstack sudo[100857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8a921751-f1b4-4202-8a4c-18b77f6080ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8a921751-f1b4-4202-8a4c-18b77f6080ab.2f43ae3f-557f-4d6e-99fe-ff9975e4a725 1G Sep 04 18:01:56 devstack sudo[100857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:56 devstack sudo[100857]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fce0feda-bcca-4d92-ba3d-c40dcfa18b39 tempest-VolumesSnapshotTestJSON-1349136939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8a921751-f1b4-4202-8a4c-18b77f6080ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8a921751-f1b4-4202-8a4c-18b77f6080ab.2f43ae3f-557f-4d6e-99fe-ff9975e4a725 1G" returned: 0 in 0.418s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fce0feda-bcca-4d92-ba3d-c40dcfa18b39 tempest-VolumesSnapshotTestJSON-1349136939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a921751-f1b4-4202-8a4c-18b77f6080ab -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8a921751-f1b4-4202-8a4c-18b77f6080ab.2f43ae3f-557f-4d6e-99fe-ff9975e4a725 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:56 devstack sudo[100863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a921751-f1b4-4202-8a4c-18b77f6080ab -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8a921751-f1b4-4202-8a4c-18b77f6080ab.2f43ae3f-557f-4d6e-99fe-ff9975e4a725 Sep 04 18:01:56 devstack sudo[100863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:57 devstack sudo[100863]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fce0feda-bcca-4d92-ba3d-c40dcfa18b39 tempest-VolumesSnapshotTestJSON-1349136939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a921751-f1b4-4202-8a4c-18b77f6080ab -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8a921751-f1b4-4202-8a4c-18b77f6080ab.2f43ae3f-557f-4d6e-99fe-ff9975e4a725" returned: 0 in 0.304s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:57 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-fce0feda-bcca-4d92-ba3d-c40dcfa18b39 tempest-VolumesSnapshotTestJSON-1349136939 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8a921751-f1b4-4202-8a4c-18b77f6080ab.2f43ae3f-557f-4d6e-99fe-ff9975e4a725 is being set with open permissions: ugo+rw Sep 04 18:01:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fce0feda-bcca-4d92-ba3d-c40dcfa18b39 tempest-VolumesSnapshotTestJSON-1349136939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8a921751-f1b4-4202-8a4c-18b77f6080ab.2f43ae3f-557f-4d6e-99fe-ff9975e4a725 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:57 devstack sudo[100868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8a921751-f1b4-4202-8a4c-18b77f6080ab.2f43ae3f-557f-4d6e-99fe-ff9975e4a725 Sep 04 18:01:57 devstack sudo[100868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:57 devstack sudo[100868]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fce0feda-bcca-4d92-ba3d-c40dcfa18b39 tempest-VolumesSnapshotTestJSON-1349136939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8a921751-f1b4-4202-8a4c-18b77f6080ab.2f43ae3f-557f-4d6e-99fe-ff9975e4a725" returned: 0 in 0.254s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fce0feda-bcca-4d92-ba3d-c40dcfa18b39 tempest-VolumesSnapshotTestJSON-1349136939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8a921751-f1b4-4202-8a4c-18b77f6080ab.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:57 devstack sudo[100871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8a921751-f1b4-4202-8a4c-18b77f6080ab.info Sep 04 18:01:57 devstack sudo[100871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:57 devstack sudo[100871]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fce0feda-bcca-4d92-ba3d-c40dcfa18b39 tempest-VolumesSnapshotTestJSON-1349136939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8a921751-f1b4-4202-8a4c-18b77f6080ab.info" returned: 0 in 0.266s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:57 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-fce0feda-bcca-4d92-ba3d-c40dcfa18b39 tempest-VolumesSnapshotTestJSON-1349136939 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8a921751-f1b4-4202-8a4c-18b77f6080ab.info is being set with open permissions: ugo+rw Sep 04 18:01:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fce0feda-bcca-4d92-ba3d-c40dcfa18b39 tempest-VolumesSnapshotTestJSON-1349136939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8a921751-f1b4-4202-8a4c-18b77f6080ab.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:57 devstack sudo[100875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8a921751-f1b4-4202-8a4c-18b77f6080ab.info Sep 04 18:01:57 devstack sudo[100875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:57 devstack sudo[100875]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fce0feda-bcca-4d92-ba3d-c40dcfa18b39 tempest-VolumesSnapshotTestJSON-1349136939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8a921751-f1b4-4202-8a4c-18b77f6080ab.info" returned: 0 in 0.246s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fce0feda-bcca-4d92-ba3d-c40dcfa18b39 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.951s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:01:57 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-fce0feda-bcca-4d92-ba3d-c40dcfa18b39 tempest-VolumesSnapshotTestJSON-1349136939 None] Create snapshot completed successfully Sep 04 18:01:58 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-77747a92-8fc0-4ad3-a7e2-bdeb7dd6f1f4 tempest-VolumesNegativeTest-187336238 None] Acquiring lock "cinder-cdc774fa-0bb5-4a88-a316-3820de65ac22-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:01:58 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-77747a92-8fc0-4ad3-a7e2-bdeb7dd6f1f4 tempest-VolumesNegativeTest-187336238 None] Lock "cinder-cdc774fa-0bb5-4a88-a316-3820de65ac22-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:01:58 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-77747a92-8fc0-4ad3-a7e2-bdeb7dd6f1f4 tempest-VolumesNegativeTest-187336238 None] Acquiring lock "cinder-quobyte-cdc774fa-0bb5-4a88-a316-3820de65ac22" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:01:58 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-77747a92-8fc0-4ad3-a7e2-bdeb7dd6f1f4 tempest-VolumesNegativeTest-187336238 None] Lock "cinder-quobyte-cdc774fa-0bb5-4a88-a316-3820de65ac22" acquired by "delete_volume" :: waited 0.023s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:01:58 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[2047305a-26bd-4d95-a7f7-62b2da978e7c]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:01:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-77747a92-8fc0-4ad3-a7e2-bdeb7dd6f1f4 tempest-VolumesNegativeTest-187336238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cdc774fa-0bb5-4a88-a316-3820de65ac22 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:58 devstack sudo[100878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cdc774fa-0bb5-4a88-a316-3820de65ac22 Sep 04 18:01:58 devstack sudo[100878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:58 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-29631f09-da45-4995-84cf-fd01ed81ceb1 tempest-VolumesSnapshotTestJSON-1349136939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:01:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-29631f09-da45-4995-84cf-fd01ed81ceb1 tempest-VolumesSnapshotTestJSON-1349136939 None] Flow 'volume_create_manager' (aad9ec7d-008f-4e2e-a468-77db5f2e33c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:01:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-29631f09-da45-4995-84cf-fd01ed81ceb1 tempest-VolumesSnapshotTestJSON-1349136939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b7fadc7-77d7-45b7-8011-219a8867d916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:01:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-29631f09-da45-4995-84cf-fd01ed81ceb1 tempest-VolumesSnapshotTestJSON-1349136939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b7fadc7-77d7-45b7-8011-219a8867d916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:01:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-409124710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=537009ce-647b-4b9f-8605-05addc64a3a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3454598b66b044eaba782c7968c61bd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:01:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=2f43ae3f-557f-4d6e-99fe-ff9975e4a725,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:01:59Z,use_quota=True,user_id='3333db5074064e1bafe4fc1cfc243cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:01:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-29631f09-da45-4995-84cf-fd01ed81ceb1 tempest-VolumesSnapshotTestJSON-1349136939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8b59a1d-9e55-44ab-9dca-d8c5589fdea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:01:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-29631f09-da45-4995-84cf-fd01ed81ceb1 tempest-VolumesSnapshotTestJSON-1349136939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8b59a1d-9e55-44ab-9dca-d8c5589fdea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:01:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-29631f09-da45-4995-84cf-fd01ed81ceb1 tempest-VolumesSnapshotTestJSON-1349136939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c4bebbd-6322-44cb-9b86-9d9957cbf56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:01:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-29631f09-da45-4995-84cf-fd01ed81ceb1 tempest-VolumesSnapshotTestJSON-1349136939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c4bebbd-6322-44cb-9b86-9d9957cbf56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '537009ce-647b-4b9f-8605-05addc64a3a9', 'volume_name': 'volume-537009ce-647b-4b9f-8605-05addc64a3a9', 'volume_size': 2, 'snapshot_id': '2f43ae3f-557f-4d6e-99fe-ff9975e4a725'}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:01:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-29631f09-da45-4995-84cf-fd01ed81ceb1 tempest-VolumesSnapshotTestJSON-1349136939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (016215e9-b24f-4131-829b-55a2d3e69f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:01:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-29631f09-da45-4995-84cf-fd01ed81ceb1 tempest-VolumesSnapshotTestJSON-1349136939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (016215e9-b24f-4131-829b-55a2d3e69f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:01:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-29631f09-da45-4995-84cf-fd01ed81ceb1 tempest-VolumesSnapshotTestJSON-1349136939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f025eba-9e9c-48d3-afdc-7129509dd506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:01:58 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-29631f09-da45-4995-84cf-fd01ed81ceb1 tempest-VolumesSnapshotTestJSON-1349136939 None] Volume 537009ce-647b-4b9f-8605-05addc64a3a9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-537009ce-647b-4b9f-8605-05addc64a3a9', 'volume_size': 2, 'snapshot_id': '2f43ae3f-557f-4d6e-99fe-ff9975e4a725'} Sep 04 18:01:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-29631f09-da45-4995-84cf-fd01ed81ceb1 tempest-VolumesSnapshotTestJSON-1349136939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:01:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-29631f09-da45-4995-84cf-fd01ed81ceb1 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:01:58 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-29631f09-da45-4995-84cf-fd01ed81ceb1 tempest-VolumesSnapshotTestJSON-1349136939 None] Acquiring lock "cinder-quobyte-2f43ae3f-557f-4d6e-99fe-ff9975e4a725-537009ce-647b-4b9f-8605-05addc64a3a9" by "_create_volume_from_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:01:58 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-29631f09-da45-4995-84cf-fd01ed81ceb1 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "cinder-quobyte-2f43ae3f-557f-4d6e-99fe-ff9975e4a725-537009ce-647b-4b9f-8605-05addc64a3a9" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:01:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-29631f09-da45-4995-84cf-fd01ed81ceb1 tempest-VolumesSnapshotTestJSON-1349136939 None] Creating volume 537009ce-647b-4b9f-8605-05addc64a3a9 from snapshot 2f43ae3f-557f-4d6e-99fe-ff9975e4a725 {{(pid=87314) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 04 18:01:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-29631f09-da45-4995-84cf-fd01ed81ceb1 tempest-VolumesSnapshotTestJSON-1349136939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:01:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-29631f09-da45-4995-84cf-fd01ed81ceb1 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:01:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-29631f09-da45-4995-84cf-fd01ed81ceb1 tempest-VolumesSnapshotTestJSON-1349136939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:01:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-29631f09-da45-4995-84cf-fd01ed81ceb1 tempest-VolumesSnapshotTestJSON-1349136939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:01:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-29631f09-da45-4995-84cf-fd01ed81ceb1 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:01:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-29631f09-da45-4995-84cf-fd01ed81ceb1 tempest-VolumesSnapshotTestJSON-1349136939 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:01:58 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-29631f09-da45-4995-84cf-fd01ed81ceb1 tempest-VolumesSnapshotTestJSON-1349136939 None] Acquiring lock "cinder-quobyte-537009ce-647b-4b9f-8605-05addc64a3a9" by "_copy_volume_from_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:01:58 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-29631f09-da45-4995-84cf-fd01ed81ceb1 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "cinder-quobyte-537009ce-647b-4b9f-8605-05addc64a3a9" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:01:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-29631f09-da45-4995-84cf-fd01ed81ceb1 tempest-VolumesSnapshotTestJSON-1349136939 None] snapshot: 2f43ae3f-557f-4d6e-99fe-ff9975e4a725, volume: 537009ce-647b-4b9f-8605-05addc64a3a9, {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 04 18:01:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-29631f09-da45-4995-84cf-fd01ed81ceb1 tempest-VolumesSnapshotTestJSON-1349136939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:01:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-29631f09-da45-4995-84cf-fd01ed81ceb1 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:01:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-29631f09-da45-4995-84cf-fd01ed81ceb1 tempest-VolumesSnapshotTestJSON-1349136939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:01:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-29631f09-da45-4995-84cf-fd01ed81ceb1 tempest-VolumesSnapshotTestJSON-1349136939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:01:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-29631f09-da45-4995-84cf-fd01ed81ceb1 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:01:58 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[44af8acc-7cb6-4211-803e-8c054d63c584]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:01:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-29631f09-da45-4995-84cf-fd01ed81ceb1 tempest-VolumesSnapshotTestJSON-1349136939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8a921751-f1b4-4202-8a4c-18b77f6080ab.2f43ae3f-557f-4d6e-99fe-ff9975e4a725 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:58 devstack sudo[100878]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-77747a92-8fc0-4ad3-a7e2-bdeb7dd6f1f4 tempest-VolumesNegativeTest-187336238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cdc774fa-0bb5-4a88-a316-3820de65ac22" returned: 0 in 0.358s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-77747a92-8fc0-4ad3-a7e2-bdeb7dd6f1f4 tempest-VolumesNegativeTest-187336238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cdc774fa-0bb5-4a88-a316-3820de65ac22 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:58 devstack sudo[100884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cdc774fa-0bb5-4a88-a316-3820de65ac22 Sep 04 18:01:58 devstack sudo[100884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:58 devstack sudo[100883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8a921751-f1b4-4202-8a4c-18b77f6080ab.2f43ae3f-557f-4d6e-99fe-ff9975e4a725 Sep 04 18:01:58 devstack sudo[100883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:59 devstack sudo[100884]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-77747a92-8fc0-4ad3-a7e2-bdeb7dd6f1f4 tempest-VolumesNegativeTest-187336238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cdc774fa-0bb5-4a88-a316-3820de65ac22" returned: 0 in 0.254s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:59 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-77747a92-8fc0-4ad3-a7e2-bdeb7dd6f1f4 tempest-VolumesNegativeTest-187336238 None] Lock "cinder-quobyte-cdc774fa-0bb5-4a88-a316-3820de65ac22" released by "delete_volume" :: held 0.652s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:01:59 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-77747a92-8fc0-4ad3-a7e2-bdeb7dd6f1f4 tempest-VolumesNegativeTest-187336238 None] Created reservations ['dd370c5b-386b-44ae-bd66-d5a886993c0b', '5cf5d945-d20c-48d7-811d-a975a9adef5a', '9418358c-b1ac-4280-82b1-7c5f0322784b', '3f5f8c2e-ff65-4589-94ee-d9c0410d27a6'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:01:59 devstack sudo[100883]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-29631f09-da45-4995-84cf-fd01ed81ceb1 tempest-VolumesSnapshotTestJSON-1349136939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8a921751-f1b4-4202-8a4c-18b77f6080ab.2f43ae3f-557f-4d6e-99fe-ff9975e4a725" returned: 0 in 0.365s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:59 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-29631f09-da45-4995-84cf-fd01ed81ceb1 tempest-VolumesSnapshotTestJSON-1349136939 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a921751-f1b4-4202-8a4c-18b77f6080ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 18:01:59 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f2aec0-b343-45b4-a380-e81f30e69434]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:01:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-29631f09-da45-4995-84cf-fd01ed81ceb1 tempest-VolumesSnapshotTestJSON-1349136939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8a921751-f1b4-4202-8a4c-18b77f6080ab {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-77747a92-8fc0-4ad3-a7e2-bdeb7dd6f1f4 tempest-VolumesNegativeTest-187336238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:01:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-77747a92-8fc0-4ad3-a7e2-bdeb7dd6f1f4 tempest-VolumesNegativeTest-187336238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:01:59 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-77747a92-8fc0-4ad3-a7e2-bdeb7dd6f1f4 tempest-VolumesNegativeTest-187336238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:01:59 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-77747a92-8fc0-4ad3-a7e2-bdeb7dd6f1f4 tempest-VolumesNegativeTest-187336238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:01:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-77747a92-8fc0-4ad3-a7e2-bdeb7dd6f1f4 tempest-VolumesNegativeTest-187336238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:01:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-77747a92-8fc0-4ad3-a7e2-bdeb7dd6f1f4 tempest-VolumesNegativeTest-187336238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:59 devstack sudo[100893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:01:59 devstack sudo[100893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:59 devstack sudo[100892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8a921751-f1b4-4202-8a4c-18b77f6080ab Sep 04 18:01:59 devstack sudo[100892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:01:59 devstack sudo[100893]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-77747a92-8fc0-4ad3-a7e2-bdeb7dd6f1f4 tempest-VolumesNegativeTest-187336238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.243s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:59 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-77747a92-8fc0-4ad3-a7e2-bdeb7dd6f1f4 tempest-VolumesNegativeTest-187336238 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:01:59 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-77747a92-8fc0-4ad3-a7e2-bdeb7dd6f1f4 tempest-VolumesNegativeTest-187336238 None] Deleted volume successfully. Sep 04 18:01:59 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-77747a92-8fc0-4ad3-a7e2-bdeb7dd6f1f4 tempest-VolumesNegativeTest-187336238 None] Lock "cinder-cdc774fa-0bb5-4a88-a316-3820de65ac22-delete_volume" released by "delete_volume" :: held 1.164s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:01:59 devstack sudo[100892]: pam_unix(sudo:session): session closed for user root Sep 04 18:01:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-29631f09-da45-4995-84cf-fd01ed81ceb1 tempest-VolumesSnapshotTestJSON-1349136939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8a921751-f1b4-4202-8a4c-18b77f6080ab" returned: 0 in 0.390s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:01:59 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-29631f09-da45-4995-84cf-fd01ed81ceb1 tempest-VolumesSnapshotTestJSON-1349136939 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8a921751-f1b4-4202-8a4c-18b77f6080ab {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 04 18:01:59 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-29631f09-da45-4995-84cf-fd01ed81ceb1 tempest-VolumesSnapshotTestJSON-1349136939 None] Creating direct copy from snapshot {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 04 18:01:59 devstack cinder-volume[87314]: DEBUG cinder.utils [None req-29631f09-da45-4995-84cf-fd01ed81ceb1 tempest-VolumesSnapshotTestJSON-1349136939 None] Path /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-537009ce-647b-4b9f-8605-05addc64a3a9 not found in is_blk_device check {{(pid=87314) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 04 18:01:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-29631f09-da45-4995-84cf-fd01ed81ceb1 tempest-VolumesSnapshotTestJSON-1349136939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8a921751-f1b4-4202-8a4c-18b77f6080ab /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-537009ce-647b-4b9f-8605-05addc64a3a9 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:01:59 devstack sudo[100901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8a921751-f1b4-4202-8a4c-18b77f6080ab /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-537009ce-647b-4b9f-8605-05addc64a3a9 Sep 04 18:01:59 devstack sudo[100901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:04 devstack sudo[100901]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-29631f09-da45-4995-84cf-fd01ed81ceb1 tempest-VolumesSnapshotTestJSON-1349136939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8a921751-f1b4-4202-8a4c-18b77f6080ab /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-537009ce-647b-4b9f-8605-05addc64a3a9" returned: 0 in 4.912s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:04 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-29631f09-da45-4995-84cf-fd01ed81ceb1 tempest-VolumesSnapshotTestJSON-1349136939 None] Image conversion details: src /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8a921751-f1b4-4202-8a4c-18b77f6080ab, size 1024.00 MB, duration 4.91 sec, destination /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-537009ce-647b-4b9f-8605-05addc64a3a9 {{(pid=87314) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 18:02:04 devstack cinder-volume[87314]: INFO cinder.image.image_utils [None req-29631f09-da45-4995-84cf-fd01ed81ceb1 tempest-VolumesSnapshotTestJSON-1349136939 None] Converted 1024.00 MB image at 208.40 MB/s Sep 04 18:02:04 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-29631f09-da45-4995-84cf-fd01ed81ceb1 tempest-VolumesSnapshotTestJSON-1349136939 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-537009ce-647b-4b9f-8605-05addc64a3a9 is being set with open permissions: ugo+rw Sep 04 18:02:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-29631f09-da45-4995-84cf-fd01ed81ceb1 tempest-VolumesSnapshotTestJSON-1349136939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-537009ce-647b-4b9f-8605-05addc64a3a9 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:04 devstack sudo[100923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-537009ce-647b-4b9f-8605-05addc64a3a9 Sep 04 18:02:04 devstack sudo[100923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:04 devstack sudo[100923]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-29631f09-da45-4995-84cf-fd01ed81ceb1 tempest-VolumesSnapshotTestJSON-1349136939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-537009ce-647b-4b9f-8605-05addc64a3a9" returned: 0 in 0.248s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:04 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-29631f09-da45-4995-84cf-fd01ed81ceb1 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "cinder-quobyte-537009ce-647b-4b9f-8605-05addc64a3a9" released by "_copy_volume_from_snapshot" :: held 6.005s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:02:04 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-29631f09-da45-4995-84cf-fd01ed81ceb1 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "cinder-quobyte-2f43ae3f-557f-4d6e-99fe-ff9975e4a725-537009ce-647b-4b9f-8605-05addc64a3a9" released by "_create_volume_from_snapshot" :: held 6.090s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:02:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-29631f09-da45-4995-84cf-fd01ed81ceb1 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.107s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:02:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-29631f09-da45-4995-84cf-fd01ed81ceb1 tempest-VolumesSnapshotTestJSON-1349136939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f025eba-9e9c-48d3-afdc-7129509dd506) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-537009ce-647b-4b9f-8605-05addc64a3a9', 'volume_size': 2, 'snapshot_id': '2f43ae3f-557f-4d6e-99fe-ff9975e4a725'}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:02:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-29631f09-da45-4995-84cf-fd01ed81ceb1 tempest-VolumesSnapshotTestJSON-1349136939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (977a286a-a5bc-44ba-b779-fb6976b7322d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:02:04 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-29631f09-da45-4995-84cf-fd01ed81ceb1 tempest-VolumesSnapshotTestJSON-1349136939 None] Volume volume-537009ce-647b-4b9f-8605-05addc64a3a9 (537009ce-647b-4b9f-8605-05addc64a3a9): created successfully Sep 04 18:02:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-29631f09-da45-4995-84cf-fd01ed81ceb1 tempest-VolumesSnapshotTestJSON-1349136939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (977a286a-a5bc-44ba-b779-fb6976b7322d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:02:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-29631f09-da45-4995-84cf-fd01ed81ceb1 tempest-VolumesSnapshotTestJSON-1349136939 None] Flow 'volume_create_manager' (aad9ec7d-008f-4e2e-a468-77db5f2e33c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:02:04 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-29631f09-da45-4995-84cf-fd01ed81ceb1 tempest-VolumesSnapshotTestJSON-1349136939 None] Created volume successfully. Sep 04 18:02:05 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d04a310d-c41f-452f-8c66-f8fad3143ed1 tempest-VolumesSnapshotTestJSON-1349136939 None] Acquiring lock "cinder-537009ce-647b-4b9f-8605-05addc64a3a9-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:02:05 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d04a310d-c41f-452f-8c66-f8fad3143ed1 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "cinder-537009ce-647b-4b9f-8605-05addc64a3a9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:02:05 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d04a310d-c41f-452f-8c66-f8fad3143ed1 tempest-VolumesSnapshotTestJSON-1349136939 None] Acquiring lock "cinder-quobyte-537009ce-647b-4b9f-8605-05addc64a3a9" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:02:05 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d04a310d-c41f-452f-8c66-f8fad3143ed1 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "cinder-quobyte-537009ce-647b-4b9f-8605-05addc64a3a9" acquired by "delete_volume" :: waited 0.017s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:02:05 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8331d51-a5da-485d-9223-928096664e7b]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:02:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d04a310d-c41f-452f-8c66-f8fad3143ed1 tempest-VolumesSnapshotTestJSON-1349136939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-537009ce-647b-4b9f-8605-05addc64a3a9 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:05 devstack sudo[100926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-537009ce-647b-4b9f-8605-05addc64a3a9 Sep 04 18:02:05 devstack sudo[100926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:05 devstack sudo[100926]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d04a310d-c41f-452f-8c66-f8fad3143ed1 tempest-VolumesSnapshotTestJSON-1349136939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-537009ce-647b-4b9f-8605-05addc64a3a9" returned: 0 in 0.392s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d04a310d-c41f-452f-8c66-f8fad3143ed1 tempest-VolumesSnapshotTestJSON-1349136939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-537009ce-647b-4b9f-8605-05addc64a3a9 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:05 devstack sudo[100931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-537009ce-647b-4b9f-8605-05addc64a3a9 Sep 04 18:02:05 devstack sudo[100931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:06 devstack sudo[100931]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d04a310d-c41f-452f-8c66-f8fad3143ed1 tempest-VolumesSnapshotTestJSON-1349136939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-537009ce-647b-4b9f-8605-05addc64a3a9" returned: 0 in 0.286s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:06 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d04a310d-c41f-452f-8c66-f8fad3143ed1 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "cinder-quobyte-537009ce-647b-4b9f-8605-05addc64a3a9" released by "delete_volume" :: held 0.728s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:02:06 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-d04a310d-c41f-452f-8c66-f8fad3143ed1 tempest-VolumesSnapshotTestJSON-1349136939 None] Created reservations ['de7e59aa-7a8c-43e2-b989-07f02e63c9ba', 'ee4cf177-a0b5-4ea5-a6ca-2e8095705522', '7a7b72ea-9d3d-416b-b7be-ddfbcb1b68da', '7b5e207e-b63e-423c-98fe-f15fb61dd7e9'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:02:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d04a310d-c41f-452f-8c66-f8fad3143ed1 tempest-VolumesSnapshotTestJSON-1349136939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:02:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d04a310d-c41f-452f-8c66-f8fad3143ed1 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:02:06 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d04a310d-c41f-452f-8c66-f8fad3143ed1 tempest-VolumesSnapshotTestJSON-1349136939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:02:06 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d04a310d-c41f-452f-8c66-f8fad3143ed1 tempest-VolumesSnapshotTestJSON-1349136939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:02:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d04a310d-c41f-452f-8c66-f8fad3143ed1 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:02:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d04a310d-c41f-452f-8c66-f8fad3143ed1 tempest-VolumesSnapshotTestJSON-1349136939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:06 devstack sudo[100934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:02:06 devstack sudo[100934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:06 devstack sudo[100934]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d04a310d-c41f-452f-8c66-f8fad3143ed1 tempest-VolumesSnapshotTestJSON-1349136939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.283s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:06 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-d04a310d-c41f-452f-8c66-f8fad3143ed1 tempest-VolumesSnapshotTestJSON-1349136939 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:02:06 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8d838e2d-2317-44c1-a8ff-b6585a4dfa74 tempest-VolumesSnapshotTestJSON-1349136939 None] Acquiring lock "cinder-2f43ae3f-557f-4d6e-99fe-ff9975e4a725-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:02:06 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-d04a310d-c41f-452f-8c66-f8fad3143ed1 tempest-VolumesSnapshotTestJSON-1349136939 None] Deleted volume successfully. Sep 04 18:02:06 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8d838e2d-2317-44c1-a8ff-b6585a4dfa74 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "cinder-2f43ae3f-557f-4d6e-99fe-ff9975e4a725-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:02:06 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8d838e2d-2317-44c1-a8ff-b6585a4dfa74 tempest-VolumesSnapshotTestJSON-1349136939 None] Acquiring lock "cinder-quobyte-8a921751-f1b4-4202-8a4c-18b77f6080ab" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:02:06 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d04a310d-c41f-452f-8c66-f8fad3143ed1 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "cinder-537009ce-647b-4b9f-8605-05addc64a3a9-delete_volume" released by "delete_volume" :: held 1.243s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:02:06 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8d838e2d-2317-44c1-a8ff-b6585a4dfa74 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "cinder-quobyte-8a921751-f1b4-4202-8a4c-18b77f6080ab" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:02:06 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8d838e2d-2317-44c1-a8ff-b6585a4dfa74 tempest-VolumesSnapshotTestJSON-1349136939 None] Acquiring lock "cinder-quobyte-2f43ae3f-557f-4d6e-99fe-ff9975e4a725" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:02:06 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8d838e2d-2317-44c1-a8ff-b6585a4dfa74 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "cinder-quobyte-2f43ae3f-557f-4d6e-99fe-ff9975e4a725" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:02:06 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-8d838e2d-2317-44c1-a8ff-b6585a4dfa74 tempest-VolumesSnapshotTestJSON-1349136939 None] Deleting offline snapshot 2f43ae3f-557f-4d6e-99fe-ff9975e4a725 of volume 8a921751-f1b4-4202-8a4c-18b77f6080ab {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 18:02:06 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-8d838e2d-2317-44c1-a8ff-b6585a4dfa74 tempest-VolumesSnapshotTestJSON-1349136939 None] snapshot_file for this snap is: volume-8a921751-f1b4-4202-8a4c-18b77f6080ab.2f43ae3f-557f-4d6e-99fe-ff9975e4a725 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 18:02:06 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c65b38-975e-4fca-b9b6-38cbdbddd441]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:02:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8d838e2d-2317-44c1-a8ff-b6585a4dfa74 tempest-VolumesSnapshotTestJSON-1349136939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8a921751-f1b4-4202-8a4c-18b77f6080ab.2f43ae3f-557f-4d6e-99fe-ff9975e4a725 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:06 devstack sudo[100937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8a921751-f1b4-4202-8a4c-18b77f6080ab.2f43ae3f-557f-4d6e-99fe-ff9975e4a725 Sep 04 18:02:06 devstack sudo[100937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:07 devstack sudo[100937]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8d838e2d-2317-44c1-a8ff-b6585a4dfa74 tempest-VolumesSnapshotTestJSON-1349136939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8a921751-f1b4-4202-8a4c-18b77f6080ab.2f43ae3f-557f-4d6e-99fe-ff9975e4a725" returned: 0 in 0.398s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:07 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-8d838e2d-2317-44c1-a8ff-b6585a4dfa74 tempest-VolumesSnapshotTestJSON-1349136939 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a921751-f1b4-4202-8a4c-18b77f6080ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 18:02:07 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[75dfd034-e335-46cb-9ca7-e63bc80b6861]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:02:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8d838e2d-2317-44c1-a8ff-b6585a4dfa74 tempest-VolumesSnapshotTestJSON-1349136939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8a921751-f1b4-4202-8a4c-18b77f6080ab {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:07 devstack sudo[100943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8a921751-f1b4-4202-8a4c-18b77f6080ab Sep 04 18:02:07 devstack sudo[100943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:07 devstack sudo[100943]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8d838e2d-2317-44c1-a8ff-b6585a4dfa74 tempest-VolumesSnapshotTestJSON-1349136939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8a921751-f1b4-4202-8a4c-18b77f6080ab" returned: 0 in 0.546s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8d838e2d-2317-44c1-a8ff-b6585a4dfa74 tempest-VolumesSnapshotTestJSON-1349136939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8a921751-f1b4-4202-8a4c-18b77f6080ab.2f43ae3f-557f-4d6e-99fe-ff9975e4a725 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:07 devstack sudo[100948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8a921751-f1b4-4202-8a4c-18b77f6080ab.2f43ae3f-557f-4d6e-99fe-ff9975e4a725 Sep 04 18:02:07 devstack sudo[100948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:08 devstack sudo[100948]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8d838e2d-2317-44c1-a8ff-b6585a4dfa74 tempest-VolumesSnapshotTestJSON-1349136939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8a921751-f1b4-4202-8a4c-18b77f6080ab.2f43ae3f-557f-4d6e-99fe-ff9975e4a725" returned: 0 in 0.367s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8d838e2d-2317-44c1-a8ff-b6585a4dfa74 tempest-VolumesSnapshotTestJSON-1349136939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8a921751-f1b4-4202-8a4c-18b77f6080ab.2f43ae3f-557f-4d6e-99fe-ff9975e4a725 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:08 devstack sudo[100953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8a921751-f1b4-4202-8a4c-18b77f6080ab.2f43ae3f-557f-4d6e-99fe-ff9975e4a725 Sep 04 18:02:08 devstack sudo[100953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:08 devstack sudo[100953]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8d838e2d-2317-44c1-a8ff-b6585a4dfa74 tempest-VolumesSnapshotTestJSON-1349136939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8a921751-f1b4-4202-8a4c-18b77f6080ab.2f43ae3f-557f-4d6e-99fe-ff9975e4a725" returned: 0 in 0.305s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:08 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8d838e2d-2317-44c1-a8ff-b6585a4dfa74 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "cinder-quobyte-2f43ae3f-557f-4d6e-99fe-ff9975e4a725" released by "_delete_snapshot" :: held 1.736s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:02:08 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8d838e2d-2317-44c1-a8ff-b6585a4dfa74 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "cinder-quobyte-8a921751-f1b4-4202-8a4c-18b77f6080ab" released by "delete_snapshot" :: held 1.762s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:02:08 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-8d838e2d-2317-44c1-a8ff-b6585a4dfa74 tempest-VolumesSnapshotTestJSON-1349136939 None] Created reservations ['b13b55e9-b620-4d98-8fea-6b8fdd3297f6', '93ebcdc8-9022-4769-8956-8cfa547d9bdc', '79b6fdfd-ca4e-4fff-becb-1d902ac034fb', '9dbd8ac5-c812-4c80-bc15-8065476c5883'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:02:08 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-8d838e2d-2317-44c1-a8ff-b6585a4dfa74 tempest-VolumesSnapshotTestJSON-1349136939 None] Delete snapshot completed successfully. Sep 04 18:02:08 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8d838e2d-2317-44c1-a8ff-b6585a4dfa74 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "cinder-2f43ae3f-557f-4d6e-99fe-ff9975e4a725-delete_snapshot" released by "delete_snapshot" :: held 1.973s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:02:08 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-676caeb2-9e0f-449b-a2e0-5dd4cb0fba7b tempest-VolumesSnapshotTestJSON-1349136939 None] Acquiring lock "cinder-8a921751-f1b4-4202-8a4c-18b77f6080ab-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:02:08 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-676caeb2-9e0f-449b-a2e0-5dd4cb0fba7b tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "cinder-8a921751-f1b4-4202-8a4c-18b77f6080ab-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:02:08 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-676caeb2-9e0f-449b-a2e0-5dd4cb0fba7b tempest-VolumesSnapshotTestJSON-1349136939 None] Acquiring lock "cinder-quobyte-8a921751-f1b4-4202-8a4c-18b77f6080ab" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:02:09 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-676caeb2-9e0f-449b-a2e0-5dd4cb0fba7b tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "cinder-quobyte-8a921751-f1b4-4202-8a4c-18b77f6080ab" acquired by "delete_volume" :: waited 0.018s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:02:09 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db9d970-e15f-43ca-81fe-065e9d1b690b]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:02:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-676caeb2-9e0f-449b-a2e0-5dd4cb0fba7b tempest-VolumesSnapshotTestJSON-1349136939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8a921751-f1b4-4202-8a4c-18b77f6080ab {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:09 devstack sudo[100956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8a921751-f1b4-4202-8a4c-18b77f6080ab Sep 04 18:02:09 devstack sudo[100956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:09 devstack sudo[100956]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-676caeb2-9e0f-449b-a2e0-5dd4cb0fba7b tempest-VolumesSnapshotTestJSON-1349136939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8a921751-f1b4-4202-8a4c-18b77f6080ab" returned: 0 in 0.400s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-676caeb2-9e0f-449b-a2e0-5dd4cb0fba7b tempest-VolumesSnapshotTestJSON-1349136939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8a921751-f1b4-4202-8a4c-18b77f6080ab {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:09 devstack sudo[100961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8a921751-f1b4-4202-8a4c-18b77f6080ab Sep 04 18:02:09 devstack sudo[100961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:09 devstack sudo[100961]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-676caeb2-9e0f-449b-a2e0-5dd4cb0fba7b tempest-VolumesSnapshotTestJSON-1349136939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8a921751-f1b4-4202-8a4c-18b77f6080ab" returned: 0 in 0.257s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:09 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-676caeb2-9e0f-449b-a2e0-5dd4cb0fba7b tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "cinder-quobyte-8a921751-f1b4-4202-8a4c-18b77f6080ab" released by "delete_volume" :: held 0.732s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:02:09 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-676caeb2-9e0f-449b-a2e0-5dd4cb0fba7b tempest-VolumesSnapshotTestJSON-1349136939 None] Created reservations ['c93e92bd-bad2-437a-ae8e-ea1ab39efa55', '56d16dad-04a1-4822-b581-1910a428a959', '4d010938-56be-4b2d-a899-d09878e5794c', '41ad756d-1a48-4f7f-9542-21d236981e3c'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:02:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-676caeb2-9e0f-449b-a2e0-5dd4cb0fba7b tempest-VolumesSnapshotTestJSON-1349136939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:02:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-676caeb2-9e0f-449b-a2e0-5dd4cb0fba7b tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:02:09 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-676caeb2-9e0f-449b-a2e0-5dd4cb0fba7b tempest-VolumesSnapshotTestJSON-1349136939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:02:09 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-676caeb2-9e0f-449b-a2e0-5dd4cb0fba7b tempest-VolumesSnapshotTestJSON-1349136939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:02:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-676caeb2-9e0f-449b-a2e0-5dd4cb0fba7b tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:02:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-676caeb2-9e0f-449b-a2e0-5dd4cb0fba7b tempest-VolumesSnapshotTestJSON-1349136939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:09 devstack sudo[100964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:02:09 devstack sudo[100964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:10 devstack sudo[100964]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-676caeb2-9e0f-449b-a2e0-5dd4cb0fba7b tempest-VolumesSnapshotTestJSON-1349136939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.292s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:10 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-676caeb2-9e0f-449b-a2e0-5dd4cb0fba7b tempest-VolumesSnapshotTestJSON-1349136939 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:02:10 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-676caeb2-9e0f-449b-a2e0-5dd4cb0fba7b tempest-VolumesSnapshotTestJSON-1349136939 None] Deleted volume successfully. Sep 04 18:02:10 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-676caeb2-9e0f-449b-a2e0-5dd4cb0fba7b tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "cinder-8a921751-f1b4-4202-8a4c-18b77f6080ab-delete_volume" released by "delete_volume" :: held 1.270s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:02:10 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-d11e8bb7-b5f7-4f69-8802-a187c8618983 tempest-VolumesSnapshotTestJSON-1349136939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:02:10 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d11e8bb7-b5f7-4f69-8802-a187c8618983 tempest-VolumesSnapshotTestJSON-1349136939 None] Flow 'volume_create_manager' (1c9fbfce-8322-4a94-a534-d1bfbcffda4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:02:10 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d11e8bb7-b5f7-4f69-8802-a187c8618983 tempest-VolumesSnapshotTestJSON-1349136939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26716420-9fb9-4506-a600-b91243ff4199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:02:10 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d11e8bb7-b5f7-4f69-8802-a187c8618983 tempest-VolumesSnapshotTestJSON-1349136939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26716420-9fb9-4506-a600-b91243ff4199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:02:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-123842020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5341f21-0243-4fb0-92e5-1409f75ffb5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3454598b66b044eaba782c7968c61bd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:02:11Z,use_quota=True,user_id='3333db5074064e1bafe4fc1cfc243cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:02:10 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d11e8bb7-b5f7-4f69-8802-a187c8618983 tempest-VolumesSnapshotTestJSON-1349136939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76709c2b-65d2-4af9-be06-8200f7157209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:02:10 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d11e8bb7-b5f7-4f69-8802-a187c8618983 tempest-VolumesSnapshotTestJSON-1349136939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76709c2b-65d2-4af9-be06-8200f7157209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:02:10 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d11e8bb7-b5f7-4f69-8802-a187c8618983 tempest-VolumesSnapshotTestJSON-1349136939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfa30d42-0ea3-4b0e-97c8-09e1bf64c362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:02:10 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d11e8bb7-b5f7-4f69-8802-a187c8618983 tempest-VolumesSnapshotTestJSON-1349136939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfa30d42-0ea3-4b0e-97c8-09e1bf64c362) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5341f21-0243-4fb0-92e5-1409f75ffb5e', 'volume_name': 'volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:02:10 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d11e8bb7-b5f7-4f69-8802-a187c8618983 tempest-VolumesSnapshotTestJSON-1349136939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deffcd2b-f18b-441f-add3-5ad173538573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:02:10 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d11e8bb7-b5f7-4f69-8802-a187c8618983 tempest-VolumesSnapshotTestJSON-1349136939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deffcd2b-f18b-441f-add3-5ad173538573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:02:10 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d11e8bb7-b5f7-4f69-8802-a187c8618983 tempest-VolumesSnapshotTestJSON-1349136939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e1fedbd-3853-4736-b790-4db0e18935bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:02:10 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-d11e8bb7-b5f7-4f69-8802-a187c8618983 tempest-VolumesSnapshotTestJSON-1349136939 None] Volume f5341f21-0243-4fb0-92e5-1409f75ffb5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e', 'volume_size': 1} Sep 04 18:02:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d11e8bb7-b5f7-4f69-8802-a187c8618983 tempest-VolumesSnapshotTestJSON-1349136939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:02:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d11e8bb7-b5f7-4f69-8802-a187c8618983 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:02:10 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d11e8bb7-b5f7-4f69-8802-a187c8618983 tempest-VolumesSnapshotTestJSON-1349136939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:02:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-123842020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5341f21-0243-4fb0-92e5-1409f75ffb5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3454598b66b044eaba782c7968c61bd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:02:11Z,use_quota=True,user_id='3333db5074064e1bafe4fc1cfc243cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:02:10 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-d11e8bb7-b5f7-4f69-8802-a187c8618983 tempest-VolumesSnapshotTestJSON-1349136939 None] Creating volume f5341f21-0243-4fb0-92e5-1409f75ffb5e {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:02:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d11e8bb7-b5f7-4f69-8802-a187c8618983 tempest-VolumesSnapshotTestJSON-1349136939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:02:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d11e8bb7-b5f7-4f69-8802-a187c8618983 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:02:10 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d11e8bb7-b5f7-4f69-8802-a187c8618983 tempest-VolumesSnapshotTestJSON-1349136939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:02:10 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d11e8bb7-b5f7-4f69-8802-a187c8618983 tempest-VolumesSnapshotTestJSON-1349136939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:02:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d11e8bb7-b5f7-4f69-8802-a187c8618983 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:02:10 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d11e8bb7-b5f7-4f69-8802-a187c8618983 tempest-VolumesSnapshotTestJSON-1349136939 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:02:10 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-d11e8bb7-b5f7-4f69-8802-a187c8618983 tempest-VolumesSnapshotTestJSON-1349136939 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:02:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d11e8bb7-b5f7-4f69-8802-a187c8618983 tempest-VolumesSnapshotTestJSON-1349136939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:10 devstack sudo[100969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e 1073741824 Sep 04 18:02:10 devstack sudo[100969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:11 devstack sudo[100969]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d11e8bb7-b5f7-4f69-8802-a187c8618983 tempest-VolumesSnapshotTestJSON-1349136939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e 1073741824" returned: 0 in 0.477s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d11e8bb7-b5f7-4f69-8802-a187c8618983 tempest-VolumesSnapshotTestJSON-1349136939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:11 devstack sudo[100975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e Sep 04 18:02:11 devstack sudo[100975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:11 devstack sudo[100975]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d11e8bb7-b5f7-4f69-8802-a187c8618983 tempest-VolumesSnapshotTestJSON-1349136939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e" returned: 0 in 0.242s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d11e8bb7-b5f7-4f69-8802-a187c8618983 tempest-VolumesSnapshotTestJSON-1349136939 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:02:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d11e8bb7-b5f7-4f69-8802-a187c8618983 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:02:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d11e8bb7-b5f7-4f69-8802-a187c8618983 tempest-VolumesSnapshotTestJSON-1349136939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e1fedbd-3853-4736-b790-4db0e18935bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:02:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d11e8bb7-b5f7-4f69-8802-a187c8618983 tempest-VolumesSnapshotTestJSON-1349136939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d9a5185-9963-49c7-ba68-7b3d73fe2922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:02:11 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-d11e8bb7-b5f7-4f69-8802-a187c8618983 tempest-VolumesSnapshotTestJSON-1349136939 None] Volume volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e (f5341f21-0243-4fb0-92e5-1409f75ffb5e): created successfully Sep 04 18:02:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d11e8bb7-b5f7-4f69-8802-a187c8618983 tempest-VolumesSnapshotTestJSON-1349136939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d9a5185-9963-49c7-ba68-7b3d73fe2922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:02:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d11e8bb7-b5f7-4f69-8802-a187c8618983 tempest-VolumesSnapshotTestJSON-1349136939 None] Flow 'volume_create_manager' (1c9fbfce-8322-4a94-a534-d1bfbcffda4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:02:11 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-d11e8bb7-b5f7-4f69-8802-a187c8618983 tempest-VolumesSnapshotTestJSON-1349136939 None] Created volume successfully. Sep 04 18:02:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5c4581d8-3943-4b88-8eaa-5d31a49c0b14 tempest-VolumesSnapshotTestJSON-1349136939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:02:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5c4581d8-3943-4b88-8eaa-5d31a49c0b14 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:02:13 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-5c4581d8-3943-4b88-8eaa-5d31a49c0b14 tempest-VolumesSnapshotTestJSON-1349136939 None] Creating offline snapshot 7bf0a3e4-0bf6-49b6-a38e-ffaa8fada180 of volume f5341f21-0243-4fb0-92e5-1409f75ffb5e {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 18:02:13 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[45bfaf45-d4c9-44f4-9ed4-0859b6010d6a]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:02:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5c4581d8-3943-4b88-8eaa-5d31a49c0b14 tempest-VolumesSnapshotTestJSON-1349136939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:13 devstack sudo[100978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e Sep 04 18:02:13 devstack sudo[100978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:13 devstack sudo[100978]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5c4581d8-3943-4b88-8eaa-5d31a49c0b14 tempest-VolumesSnapshotTestJSON-1349136939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e" returned: 0 in 0.370s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5c4581d8-3943-4b88-8eaa-5d31a49c0b14 tempest-VolumesSnapshotTestJSON-1349136939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e.7bf0a3e4-0bf6-49b6-a38e-ffaa8fada180 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:13 devstack sudo[100984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e.7bf0a3e4-0bf6-49b6-a38e-ffaa8fada180 1G Sep 04 18:02:13 devstack sudo[100984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:13 devstack sudo[100984]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5c4581d8-3943-4b88-8eaa-5d31a49c0b14 tempest-VolumesSnapshotTestJSON-1349136939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e.7bf0a3e4-0bf6-49b6-a38e-ffaa8fada180 1G" returned: 0 in 0.485s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5c4581d8-3943-4b88-8eaa-5d31a49c0b14 tempest-VolumesSnapshotTestJSON-1349136939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e.7bf0a3e4-0bf6-49b6-a38e-ffaa8fada180 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:13 devstack sudo[100990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e.7bf0a3e4-0bf6-49b6-a38e-ffaa8fada180 Sep 04 18:02:13 devstack sudo[100990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:14 devstack sudo[100990]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5c4581d8-3943-4b88-8eaa-5d31a49c0b14 tempest-VolumesSnapshotTestJSON-1349136939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e.7bf0a3e4-0bf6-49b6-a38e-ffaa8fada180" returned: 0 in 0.323s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:14 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-5c4581d8-3943-4b88-8eaa-5d31a49c0b14 tempest-VolumesSnapshotTestJSON-1349136939 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e.7bf0a3e4-0bf6-49b6-a38e-ffaa8fada180 is being set with open permissions: ugo+rw Sep 04 18:02:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5c4581d8-3943-4b88-8eaa-5d31a49c0b14 tempest-VolumesSnapshotTestJSON-1349136939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e.7bf0a3e4-0bf6-49b6-a38e-ffaa8fada180 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:14 devstack sudo[100995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e.7bf0a3e4-0bf6-49b6-a38e-ffaa8fada180 Sep 04 18:02:14 devstack sudo[100995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:14 devstack sudo[100995]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5c4581d8-3943-4b88-8eaa-5d31a49c0b14 tempest-VolumesSnapshotTestJSON-1349136939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e.7bf0a3e4-0bf6-49b6-a38e-ffaa8fada180" returned: 0 in 0.254s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5c4581d8-3943-4b88-8eaa-5d31a49c0b14 tempest-VolumesSnapshotTestJSON-1349136939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:14 devstack sudo[100998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e.info Sep 04 18:02:14 devstack sudo[100998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:14 devstack sudo[100998]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5c4581d8-3943-4b88-8eaa-5d31a49c0b14 tempest-VolumesSnapshotTestJSON-1349136939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e.info" returned: 0 in 0.257s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:14 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-5c4581d8-3943-4b88-8eaa-5d31a49c0b14 tempest-VolumesSnapshotTestJSON-1349136939 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e.info is being set with open permissions: ugo+rw Sep 04 18:02:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5c4581d8-3943-4b88-8eaa-5d31a49c0b14 tempest-VolumesSnapshotTestJSON-1349136939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:14 devstack sudo[101001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e.info Sep 04 18:02:14 devstack sudo[101001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:15 devstack sudo[101001]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5c4581d8-3943-4b88-8eaa-5d31a49c0b14 tempest-VolumesSnapshotTestJSON-1349136939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e.info" returned: 0 in 0.268s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5c4581d8-3943-4b88-8eaa-5d31a49c0b14 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.065s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:02:15 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-5c4581d8-3943-4b88-8eaa-5d31a49c0b14 tempest-VolumesSnapshotTestJSON-1349136939 None] Create snapshot completed successfully Sep 04 18:02:16 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-42993dc8-062f-4b28-9c0e-b0ec0ecd8662 tempest-VolumesSnapshotTestJSON-1349136939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:02:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-42993dc8-062f-4b28-9c0e-b0ec0ecd8662 tempest-VolumesSnapshotTestJSON-1349136939 None] Flow 'volume_create_manager' (9fa19814-5203-40ea-93ec-3d11e611bfaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:02:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-42993dc8-062f-4b28-9c0e-b0ec0ecd8662 tempest-VolumesSnapshotTestJSON-1349136939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7a6ab6f-3910-4970-b5df-82da2d059271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:02:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-42993dc8-062f-4b28-9c0e-b0ec0ecd8662 tempest-VolumesSnapshotTestJSON-1349136939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7a6ab6f-3910-4970-b5df-82da2d059271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:02:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1005896705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b9fb54f-6dc6-4a05-b703-c00f81ef2b29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3454598b66b044eaba782c7968c61bd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:02:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7bf0a3e4-0bf6-49b6-a38e-ffaa8fada180,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:02:17Z,use_quota=True,user_id='3333db5074064e1bafe4fc1cfc243cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:02:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-42993dc8-062f-4b28-9c0e-b0ec0ecd8662 tempest-VolumesSnapshotTestJSON-1349136939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3f00b42-72f7-45e3-b85e-d18cd26e6868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:02:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-42993dc8-062f-4b28-9c0e-b0ec0ecd8662 tempest-VolumesSnapshotTestJSON-1349136939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3f00b42-72f7-45e3-b85e-d18cd26e6868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:02:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-42993dc8-062f-4b28-9c0e-b0ec0ecd8662 tempest-VolumesSnapshotTestJSON-1349136939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (627c9e6b-1141-42f0-9665-194361ccbd98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:02:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-42993dc8-062f-4b28-9c0e-b0ec0ecd8662 tempest-VolumesSnapshotTestJSON-1349136939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (627c9e6b-1141-42f0-9665-194361ccbd98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1b9fb54f-6dc6-4a05-b703-c00f81ef2b29', 'volume_name': 'volume-1b9fb54f-6dc6-4a05-b703-c00f81ef2b29', 'volume_size': 1, 'snapshot_id': '7bf0a3e4-0bf6-49b6-a38e-ffaa8fada180'}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:02:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-42993dc8-062f-4b28-9c0e-b0ec0ecd8662 tempest-VolumesSnapshotTestJSON-1349136939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b9aeb02-2f95-4dfc-a9d9-43db77963923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:02:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-42993dc8-062f-4b28-9c0e-b0ec0ecd8662 tempest-VolumesSnapshotTestJSON-1349136939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b9aeb02-2f95-4dfc-a9d9-43db77963923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:02:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-42993dc8-062f-4b28-9c0e-b0ec0ecd8662 tempest-VolumesSnapshotTestJSON-1349136939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eadf5900-7fdf-4135-a85a-a564af5f51c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:02:16 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-42993dc8-062f-4b28-9c0e-b0ec0ecd8662 tempest-VolumesSnapshotTestJSON-1349136939 None] Volume 1b9fb54f-6dc6-4a05-b703-c00f81ef2b29: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1b9fb54f-6dc6-4a05-b703-c00f81ef2b29', 'volume_size': 1, 'snapshot_id': '7bf0a3e4-0bf6-49b6-a38e-ffaa8fada180'} Sep 04 18:02:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-42993dc8-062f-4b28-9c0e-b0ec0ecd8662 tempest-VolumesSnapshotTestJSON-1349136939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:02:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-42993dc8-062f-4b28-9c0e-b0ec0ecd8662 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:02:16 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-42993dc8-062f-4b28-9c0e-b0ec0ecd8662 tempest-VolumesSnapshotTestJSON-1349136939 None] Acquiring lock "cinder-quobyte-7bf0a3e4-0bf6-49b6-a38e-ffaa8fada180-1b9fb54f-6dc6-4a05-b703-c00f81ef2b29" by "_create_volume_from_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:02:16 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-42993dc8-062f-4b28-9c0e-b0ec0ecd8662 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "cinder-quobyte-7bf0a3e4-0bf6-49b6-a38e-ffaa8fada180-1b9fb54f-6dc6-4a05-b703-c00f81ef2b29" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:02:16 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-42993dc8-062f-4b28-9c0e-b0ec0ecd8662 tempest-VolumesSnapshotTestJSON-1349136939 None] Creating volume 1b9fb54f-6dc6-4a05-b703-c00f81ef2b29 from snapshot 7bf0a3e4-0bf6-49b6-a38e-ffaa8fada180 {{(pid=87314) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 04 18:02:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-42993dc8-062f-4b28-9c0e-b0ec0ecd8662 tempest-VolumesSnapshotTestJSON-1349136939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:02:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-42993dc8-062f-4b28-9c0e-b0ec0ecd8662 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:02:16 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-42993dc8-062f-4b28-9c0e-b0ec0ecd8662 tempest-VolumesSnapshotTestJSON-1349136939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:02:16 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-42993dc8-062f-4b28-9c0e-b0ec0ecd8662 tempest-VolumesSnapshotTestJSON-1349136939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:02:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-42993dc8-062f-4b28-9c0e-b0ec0ecd8662 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:02:16 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-42993dc8-062f-4b28-9c0e-b0ec0ecd8662 tempest-VolumesSnapshotTestJSON-1349136939 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:02:16 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-42993dc8-062f-4b28-9c0e-b0ec0ecd8662 tempest-VolumesSnapshotTestJSON-1349136939 None] Acquiring lock "cinder-quobyte-1b9fb54f-6dc6-4a05-b703-c00f81ef2b29" by "_copy_volume_from_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:02:16 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-42993dc8-062f-4b28-9c0e-b0ec0ecd8662 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "cinder-quobyte-1b9fb54f-6dc6-4a05-b703-c00f81ef2b29" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:02:16 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-42993dc8-062f-4b28-9c0e-b0ec0ecd8662 tempest-VolumesSnapshotTestJSON-1349136939 None] snapshot: 7bf0a3e4-0bf6-49b6-a38e-ffaa8fada180, volume: 1b9fb54f-6dc6-4a05-b703-c00f81ef2b29, {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 04 18:02:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-42993dc8-062f-4b28-9c0e-b0ec0ecd8662 tempest-VolumesSnapshotTestJSON-1349136939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:02:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-42993dc8-062f-4b28-9c0e-b0ec0ecd8662 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:02:16 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-42993dc8-062f-4b28-9c0e-b0ec0ecd8662 tempest-VolumesSnapshotTestJSON-1349136939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:02:16 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-42993dc8-062f-4b28-9c0e-b0ec0ecd8662 tempest-VolumesSnapshotTestJSON-1349136939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:02:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-42993dc8-062f-4b28-9c0e-b0ec0ecd8662 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:02:16 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b69b5e2-7381-4a81-ae45-bdfa7121d4ac]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:02:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-42993dc8-062f-4b28-9c0e-b0ec0ecd8662 tempest-VolumesSnapshotTestJSON-1349136939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e.7bf0a3e4-0bf6-49b6-a38e-ffaa8fada180 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:17 devstack sudo[101004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e.7bf0a3e4-0bf6-49b6-a38e-ffaa8fada180 Sep 04 18:02:17 devstack sudo[101004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:17 devstack sudo[101004]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-42993dc8-062f-4b28-9c0e-b0ec0ecd8662 tempest-VolumesSnapshotTestJSON-1349136939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e.7bf0a3e4-0bf6-49b6-a38e-ffaa8fada180" returned: 0 in 0.384s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:17 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-42993dc8-062f-4b28-9c0e-b0ec0ecd8662 tempest-VolumesSnapshotTestJSON-1349136939 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 18:02:17 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce9758a-8f80-422d-9a56-98ab79a5de52]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:02:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-42993dc8-062f-4b28-9c0e-b0ec0ecd8662 tempest-VolumesSnapshotTestJSON-1349136939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:17 devstack sudo[101009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e Sep 04 18:02:17 devstack sudo[101009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:17 devstack sudo[101009]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-42993dc8-062f-4b28-9c0e-b0ec0ecd8662 tempest-VolumesSnapshotTestJSON-1349136939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e" returned: 0 in 0.383s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:17 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-42993dc8-062f-4b28-9c0e-b0ec0ecd8662 tempest-VolumesSnapshotTestJSON-1349136939 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 04 18:02:17 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-42993dc8-062f-4b28-9c0e-b0ec0ecd8662 tempest-VolumesSnapshotTestJSON-1349136939 None] Creating direct copy from snapshot {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 04 18:02:17 devstack cinder-volume[87314]: DEBUG cinder.utils [None req-42993dc8-062f-4b28-9c0e-b0ec0ecd8662 tempest-VolumesSnapshotTestJSON-1349136939 None] Path /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1b9fb54f-6dc6-4a05-b703-c00f81ef2b29 not found in is_blk_device check {{(pid=87314) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 04 18:02:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-42993dc8-062f-4b28-9c0e-b0ec0ecd8662 tempest-VolumesSnapshotTestJSON-1349136939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1b9fb54f-6dc6-4a05-b703-c00f81ef2b29 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:17 devstack sudo[101015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1b9fb54f-6dc6-4a05-b703-c00f81ef2b29 Sep 04 18:02:17 devstack sudo[101015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:21 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 18:02:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:02:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:02:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:02:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:02:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:02:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:21 devstack sudo[101028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:02:21 devstack sudo[101028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:21 devstack sudo[101028]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.531s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:21 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:02:21 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running periodic task VolumeManager._thread_info {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 18:02:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] thread count: 28 {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 18:02:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] thread info: [<_MainThread(MainThread, started 139900377723008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 18:02:22 devstack sudo[101015]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-42993dc8-062f-4b28-9c0e-b0ec0ecd8662 tempest-VolumesSnapshotTestJSON-1349136939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1b9fb54f-6dc6-4a05-b703-c00f81ef2b29" returned: 0 in 4.687s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:22 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-42993dc8-062f-4b28-9c0e-b0ec0ecd8662 tempest-VolumesSnapshotTestJSON-1349136939 None] Image conversion details: src /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e, size 1024.00 MB, duration 4.69 sec, destination /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1b9fb54f-6dc6-4a05-b703-c00f81ef2b29 {{(pid=87314) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 18:02:22 devstack cinder-volume[87314]: INFO cinder.image.image_utils [None req-42993dc8-062f-4b28-9c0e-b0ec0ecd8662 tempest-VolumesSnapshotTestJSON-1349136939 None] Converted 1024.00 MB image at 218.45 MB/s Sep 04 18:02:22 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-42993dc8-062f-4b28-9c0e-b0ec0ecd8662 tempest-VolumesSnapshotTestJSON-1349136939 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1b9fb54f-6dc6-4a05-b703-c00f81ef2b29 is being set with open permissions: ugo+rw Sep 04 18:02:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-42993dc8-062f-4b28-9c0e-b0ec0ecd8662 tempest-VolumesSnapshotTestJSON-1349136939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1b9fb54f-6dc6-4a05-b703-c00f81ef2b29 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:22 devstack sudo[101031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1b9fb54f-6dc6-4a05-b703-c00f81ef2b29 Sep 04 18:02:22 devstack sudo[101031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:22 devstack sudo[101031]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-42993dc8-062f-4b28-9c0e-b0ec0ecd8662 tempest-VolumesSnapshotTestJSON-1349136939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1b9fb54f-6dc6-4a05-b703-c00f81ef2b29" returned: 0 in 0.249s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:22 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-42993dc8-062f-4b28-9c0e-b0ec0ecd8662 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "cinder-quobyte-1b9fb54f-6dc6-4a05-b703-c00f81ef2b29" released by "_copy_volume_from_snapshot" :: held 5.789s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:02:22 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-42993dc8-062f-4b28-9c0e-b0ec0ecd8662 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "cinder-quobyte-7bf0a3e4-0bf6-49b6-a38e-ffaa8fada180-1b9fb54f-6dc6-4a05-b703-c00f81ef2b29" released by "_create_volume_from_snapshot" :: held 5.866s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:02:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-42993dc8-062f-4b28-9c0e-b0ec0ecd8662 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.890s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:02:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-42993dc8-062f-4b28-9c0e-b0ec0ecd8662 tempest-VolumesSnapshotTestJSON-1349136939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eadf5900-7fdf-4135-a85a-a564af5f51c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b9fb54f-6dc6-4a05-b703-c00f81ef2b29', 'volume_size': 1, 'snapshot_id': '7bf0a3e4-0bf6-49b6-a38e-ffaa8fada180'}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:02:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-42993dc8-062f-4b28-9c0e-b0ec0ecd8662 tempest-VolumesSnapshotTestJSON-1349136939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (956035fd-e8b9-43ce-b446-b8b2a7ea75ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:02:22 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-42993dc8-062f-4b28-9c0e-b0ec0ecd8662 tempest-VolumesSnapshotTestJSON-1349136939 None] Volume volume-1b9fb54f-6dc6-4a05-b703-c00f81ef2b29 (1b9fb54f-6dc6-4a05-b703-c00f81ef2b29): created successfully Sep 04 18:02:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-42993dc8-062f-4b28-9c0e-b0ec0ecd8662 tempest-VolumesSnapshotTestJSON-1349136939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (956035fd-e8b9-43ce-b446-b8b2a7ea75ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:02:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-42993dc8-062f-4b28-9c0e-b0ec0ecd8662 tempest-VolumesSnapshotTestJSON-1349136939 None] Flow 'volume_create_manager' (9fa19814-5203-40ea-93ec-3d11e611bfaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:02:22 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-42993dc8-062f-4b28-9c0e-b0ec0ecd8662 tempest-VolumesSnapshotTestJSON-1349136939 None] Created volume successfully. Sep 04 18:02:23 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-22f5a4cb-3f01-4069-9fa9-7722c7c48f60 tempest-VolumesSnapshotTestJSON-1349136939 None] Acquiring lock "cinder-1b9fb54f-6dc6-4a05-b703-c00f81ef2b29-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:02:23 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-22f5a4cb-3f01-4069-9fa9-7722c7c48f60 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "cinder-1b9fb54f-6dc6-4a05-b703-c00f81ef2b29-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:02:23 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-22f5a4cb-3f01-4069-9fa9-7722c7c48f60 tempest-VolumesSnapshotTestJSON-1349136939 None] Acquiring lock "cinder-quobyte-1b9fb54f-6dc6-4a05-b703-c00f81ef2b29" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:02:23 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-22f5a4cb-3f01-4069-9fa9-7722c7c48f60 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "cinder-quobyte-1b9fb54f-6dc6-4a05-b703-c00f81ef2b29" acquired by "delete_volume" :: waited 0.023s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:02:23 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d75d942-6d73-4d04-bc2e-528d03e7b3a1]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:02:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-22f5a4cb-3f01-4069-9fa9-7722c7c48f60 tempest-VolumesSnapshotTestJSON-1349136939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1b9fb54f-6dc6-4a05-b703-c00f81ef2b29 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:23 devstack sudo[101035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1b9fb54f-6dc6-4a05-b703-c00f81ef2b29 Sep 04 18:02:23 devstack sudo[101035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:24 devstack sudo[101035]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-22f5a4cb-3f01-4069-9fa9-7722c7c48f60 tempest-VolumesSnapshotTestJSON-1349136939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1b9fb54f-6dc6-4a05-b703-c00f81ef2b29" returned: 0 in 0.397s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-22f5a4cb-3f01-4069-9fa9-7722c7c48f60 tempest-VolumesSnapshotTestJSON-1349136939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1b9fb54f-6dc6-4a05-b703-c00f81ef2b29 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:24 devstack sudo[101041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1b9fb54f-6dc6-4a05-b703-c00f81ef2b29 Sep 04 18:02:24 devstack sudo[101041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:24 devstack sudo[101041]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-22f5a4cb-3f01-4069-9fa9-7722c7c48f60 tempest-VolumesSnapshotTestJSON-1349136939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1b9fb54f-6dc6-4a05-b703-c00f81ef2b29" returned: 0 in 0.300s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:24 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-22f5a4cb-3f01-4069-9fa9-7722c7c48f60 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "cinder-quobyte-1b9fb54f-6dc6-4a05-b703-c00f81ef2b29" released by "delete_volume" :: held 0.746s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:02:24 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-22f5a4cb-3f01-4069-9fa9-7722c7c48f60 tempest-VolumesSnapshotTestJSON-1349136939 None] Created reservations ['e8f8fd73-41e5-48a1-8899-f7f8379f3d2b', 'a45c38f6-77d5-4507-bcca-c007798eef6f', '04cb13f8-0e8b-4b05-b509-e7de4154221f', '40e369b0-6800-452f-a18a-e8474e3f41be'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:02:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-22f5a4cb-3f01-4069-9fa9-7722c7c48f60 tempest-VolumesSnapshotTestJSON-1349136939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:02:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-22f5a4cb-3f01-4069-9fa9-7722c7c48f60 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:02:24 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-22f5a4cb-3f01-4069-9fa9-7722c7c48f60 tempest-VolumesSnapshotTestJSON-1349136939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:02:24 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-22f5a4cb-3f01-4069-9fa9-7722c7c48f60 tempest-VolumesSnapshotTestJSON-1349136939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:02:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-22f5a4cb-3f01-4069-9fa9-7722c7c48f60 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:02:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-22f5a4cb-3f01-4069-9fa9-7722c7c48f60 tempest-VolumesSnapshotTestJSON-1349136939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:24 devstack sudo[101044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:02:24 devstack sudo[101044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:24 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-21c704a0-5e03-4466-825a-0a6e7ff72504 tempest-VolumesSnapshotTestJSON-1349136939 None] Acquiring lock "cinder-7bf0a3e4-0bf6-49b6-a38e-ffaa8fada180-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:02:24 devstack sudo[101044]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-22f5a4cb-3f01-4069-9fa9-7722c7c48f60 tempest-VolumesSnapshotTestJSON-1349136939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.309s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:24 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-22f5a4cb-3f01-4069-9fa9-7722c7c48f60 tempest-VolumesSnapshotTestJSON-1349136939 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:02:24 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-22f5a4cb-3f01-4069-9fa9-7722c7c48f60 tempest-VolumesSnapshotTestJSON-1349136939 None] Deleted volume successfully. Sep 04 18:02:24 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-21c704a0-5e03-4466-825a-0a6e7ff72504 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "cinder-7bf0a3e4-0bf6-49b6-a38e-ffaa8fada180-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:02:24 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-21c704a0-5e03-4466-825a-0a6e7ff72504 tempest-VolumesSnapshotTestJSON-1349136939 None] Acquiring lock "cinder-quobyte-f5341f21-0243-4fb0-92e5-1409f75ffb5e" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:02:24 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-21c704a0-5e03-4466-825a-0a6e7ff72504 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "cinder-quobyte-f5341f21-0243-4fb0-92e5-1409f75ffb5e" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:02:24 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-21c704a0-5e03-4466-825a-0a6e7ff72504 tempest-VolumesSnapshotTestJSON-1349136939 None] Acquiring lock "cinder-quobyte-7bf0a3e4-0bf6-49b6-a38e-ffaa8fada180" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:02:24 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-22f5a4cb-3f01-4069-9fa9-7722c7c48f60 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "cinder-1b9fb54f-6dc6-4a05-b703-c00f81ef2b29-delete_volume" released by "delete_volume" :: held 1.329s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:02:24 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-21c704a0-5e03-4466-825a-0a6e7ff72504 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "cinder-quobyte-7bf0a3e4-0bf6-49b6-a38e-ffaa8fada180" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:02:24 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-21c704a0-5e03-4466-825a-0a6e7ff72504 tempest-VolumesSnapshotTestJSON-1349136939 None] Deleting offline snapshot 7bf0a3e4-0bf6-49b6-a38e-ffaa8fada180 of volume f5341f21-0243-4fb0-92e5-1409f75ffb5e {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 18:02:24 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-21c704a0-5e03-4466-825a-0a6e7ff72504 tempest-VolumesSnapshotTestJSON-1349136939 None] snapshot_file for this snap is: volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e.7bf0a3e4-0bf6-49b6-a38e-ffaa8fada180 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 18:02:24 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[780a1a60-7ca4-45ed-bb9d-3e5cf4257e5a]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:02:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-21c704a0-5e03-4466-825a-0a6e7ff72504 tempest-VolumesSnapshotTestJSON-1349136939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e.7bf0a3e4-0bf6-49b6-a38e-ffaa8fada180 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:25 devstack sudo[101047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e.7bf0a3e4-0bf6-49b6-a38e-ffaa8fada180 Sep 04 18:02:25 devstack sudo[101047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:25 devstack sudo[101047]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-21c704a0-5e03-4466-825a-0a6e7ff72504 tempest-VolumesSnapshotTestJSON-1349136939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e.7bf0a3e4-0bf6-49b6-a38e-ffaa8fada180" returned: 0 in 0.386s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:25 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-21c704a0-5e03-4466-825a-0a6e7ff72504 tempest-VolumesSnapshotTestJSON-1349136939 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 18:02:25 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[d33aad4a-e6fc-4511-ae64-d34945e89f44]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:02:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-21c704a0-5e03-4466-825a-0a6e7ff72504 tempest-VolumesSnapshotTestJSON-1349136939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:25 devstack sudo[101052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e Sep 04 18:02:25 devstack sudo[101052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:25 devstack sudo[101052]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-21c704a0-5e03-4466-825a-0a6e7ff72504 tempest-VolumesSnapshotTestJSON-1349136939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e" returned: 0 in 0.562s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-21c704a0-5e03-4466-825a-0a6e7ff72504 tempest-VolumesSnapshotTestJSON-1349136939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e.7bf0a3e4-0bf6-49b6-a38e-ffaa8fada180 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:25 devstack sudo[101057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e.7bf0a3e4-0bf6-49b6-a38e-ffaa8fada180 Sep 04 18:02:25 devstack sudo[101057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:26 devstack sudo[101057]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-21c704a0-5e03-4466-825a-0a6e7ff72504 tempest-VolumesSnapshotTestJSON-1349136939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e.7bf0a3e4-0bf6-49b6-a38e-ffaa8fada180" returned: 0 in 0.382s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-21c704a0-5e03-4466-825a-0a6e7ff72504 tempest-VolumesSnapshotTestJSON-1349136939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e.7bf0a3e4-0bf6-49b6-a38e-ffaa8fada180 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:26 devstack sudo[101062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e.7bf0a3e4-0bf6-49b6-a38e-ffaa8fada180 Sep 04 18:02:26 devstack sudo[101062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:26 devstack sudo[101062]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-21c704a0-5e03-4466-825a-0a6e7ff72504 tempest-VolumesSnapshotTestJSON-1349136939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e.7bf0a3e4-0bf6-49b6-a38e-ffaa8fada180" returned: 0 in 0.248s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:26 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=107,cinder:UPDATE=118,cinder:INSERT=33,cinder:DELETE=8 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 18:02:26 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=97,cinder:INSERT=36,cinder:UPDATE=120,cinder:DELETE=14 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 18:02:26 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-21c704a0-5e03-4466-825a-0a6e7ff72504 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "cinder-quobyte-7bf0a3e4-0bf6-49b6-a38e-ffaa8fada180" released by "_delete_snapshot" :: held 1.707s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:02:26 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-21c704a0-5e03-4466-825a-0a6e7ff72504 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "cinder-quobyte-f5341f21-0243-4fb0-92e5-1409f75ffb5e" released by "delete_snapshot" :: held 1.748s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:02:26 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-21c704a0-5e03-4466-825a-0a6e7ff72504 tempest-VolumesSnapshotTestJSON-1349136939 None] Created reservations ['9a6da930-7d3a-46bd-87ed-d3ae771e333c', 'cd6d169c-eb1e-45bb-be63-c4600ca7e139', '8277af31-b86f-404e-8e0a-b0e64ee7b217', 'b513bea0-d03d-46fc-a0f7-43baf576448f'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:02:26 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-21c704a0-5e03-4466-825a-0a6e7ff72504 tempest-VolumesSnapshotTestJSON-1349136939 None] Delete snapshot completed successfully. Sep 04 18:02:26 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-21c704a0-5e03-4466-825a-0a6e7ff72504 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "cinder-7bf0a3e4-0bf6-49b6-a38e-ffaa8fada180-delete_snapshot" released by "delete_snapshot" :: held 1.988s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:02:27 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8287b244-9b44-4167-8117-ed1c49917ea5 tempest-VolumesSnapshotTestJSON-1349136939 None] Acquiring lock "cinder-f5341f21-0243-4fb0-92e5-1409f75ffb5e-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:02:27 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8287b244-9b44-4167-8117-ed1c49917ea5 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "cinder-f5341f21-0243-4fb0-92e5-1409f75ffb5e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:02:27 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8287b244-9b44-4167-8117-ed1c49917ea5 tempest-VolumesSnapshotTestJSON-1349136939 None] Acquiring lock "cinder-quobyte-f5341f21-0243-4fb0-92e5-1409f75ffb5e" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:02:27 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8287b244-9b44-4167-8117-ed1c49917ea5 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "cinder-quobyte-f5341f21-0243-4fb0-92e5-1409f75ffb5e" acquired by "delete_volume" :: waited 0.020s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:02:27 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[56302f49-4c02-4a6d-b620-91e2d5939172]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:02:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8287b244-9b44-4167-8117-ed1c49917ea5 tempest-VolumesSnapshotTestJSON-1349136939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:27 devstack sudo[101065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e Sep 04 18:02:27 devstack sudo[101065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:27 devstack sudo[101065]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8287b244-9b44-4167-8117-ed1c49917ea5 tempest-VolumesSnapshotTestJSON-1349136939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e" returned: 0 in 0.383s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8287b244-9b44-4167-8117-ed1c49917ea5 tempest-VolumesSnapshotTestJSON-1349136939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:27 devstack sudo[101070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e Sep 04 18:02:27 devstack sudo[101070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:27 devstack sudo[101070]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8287b244-9b44-4167-8117-ed1c49917ea5 tempest-VolumesSnapshotTestJSON-1349136939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f5341f21-0243-4fb0-92e5-1409f75ffb5e" returned: 0 in 0.253s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:27 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8287b244-9b44-4167-8117-ed1c49917ea5 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "cinder-quobyte-f5341f21-0243-4fb0-92e5-1409f75ffb5e" released by "delete_volume" :: held 0.703s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:02:27 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-8287b244-9b44-4167-8117-ed1c49917ea5 tempest-VolumesSnapshotTestJSON-1349136939 None] Created reservations ['37e91900-ee41-4053-aaa8-78178c4bc934', 'd39dbf76-4dac-4fed-a735-cc8e99c8799c', '60cdb88d-8e30-49ef-8e82-adcd2c61c6b1', 'b5fc27f3-41a6-480f-b9e0-89946adba2e9'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:02:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8287b244-9b44-4167-8117-ed1c49917ea5 tempest-VolumesSnapshotTestJSON-1349136939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:02:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8287b244-9b44-4167-8117-ed1c49917ea5 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:02:27 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8287b244-9b44-4167-8117-ed1c49917ea5 tempest-VolumesSnapshotTestJSON-1349136939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:02:27 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8287b244-9b44-4167-8117-ed1c49917ea5 tempest-VolumesSnapshotTestJSON-1349136939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:02:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8287b244-9b44-4167-8117-ed1c49917ea5 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:02:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8287b244-9b44-4167-8117-ed1c49917ea5 tempest-VolumesSnapshotTestJSON-1349136939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:27 devstack sudo[101073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:02:27 devstack sudo[101073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:28 devstack sudo[101073]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8287b244-9b44-4167-8117-ed1c49917ea5 tempest-VolumesSnapshotTestJSON-1349136939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.264s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:28 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-8287b244-9b44-4167-8117-ed1c49917ea5 tempest-VolumesSnapshotTestJSON-1349136939 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:02:28 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-8287b244-9b44-4167-8117-ed1c49917ea5 tempest-VolumesSnapshotTestJSON-1349136939 None] Deleted volume successfully. Sep 04 18:02:28 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8287b244-9b44-4167-8117-ed1c49917ea5 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "cinder-f5341f21-0243-4fb0-92e5-1409f75ffb5e-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:02:28 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-61dbf471-ea7a-4e36-8dd2-25101614e0a2 tempest-VolumesSnapshotTestJSON-1349136939 None] Acquiring lock "cinder-3cc00d04-b6f7-49bf-9771-41f83e9515d6-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:02:28 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-61dbf471-ea7a-4e36-8dd2-25101614e0a2 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "cinder-3cc00d04-b6f7-49bf-9771-41f83e9515d6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:02:28 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-61dbf471-ea7a-4e36-8dd2-25101614e0a2 tempest-VolumesSnapshotTestJSON-1349136939 None] Acquiring lock "cinder-quobyte-3cc00d04-b6f7-49bf-9771-41f83e9515d6" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:02:28 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-61dbf471-ea7a-4e36-8dd2-25101614e0a2 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "cinder-quobyte-3cc00d04-b6f7-49bf-9771-41f83e9515d6" acquired by "delete_volume" :: waited 0.013s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:02:28 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00a89b7-3e26-4993-81bf-6406fc7acd8e]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:02:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-61dbf471-ea7a-4e36-8dd2-25101614e0a2 tempest-VolumesSnapshotTestJSON-1349136939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3cc00d04-b6f7-49bf-9771-41f83e9515d6 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:28 devstack sudo[101076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3cc00d04-b6f7-49bf-9771-41f83e9515d6 Sep 04 18:02:28 devstack sudo[101076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:28 devstack sudo[101076]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-61dbf471-ea7a-4e36-8dd2-25101614e0a2 tempest-VolumesSnapshotTestJSON-1349136939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3cc00d04-b6f7-49bf-9771-41f83e9515d6" returned: 0 in 0.431s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-61dbf471-ea7a-4e36-8dd2-25101614e0a2 tempest-VolumesSnapshotTestJSON-1349136939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3cc00d04-b6f7-49bf-9771-41f83e9515d6 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:28 devstack sudo[101081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3cc00d04-b6f7-49bf-9771-41f83e9515d6 Sep 04 18:02:28 devstack sudo[101081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:29 devstack sudo[101081]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-61dbf471-ea7a-4e36-8dd2-25101614e0a2 tempest-VolumesSnapshotTestJSON-1349136939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3cc00d04-b6f7-49bf-9771-41f83e9515d6" returned: 0 in 0.251s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:29 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-61dbf471-ea7a-4e36-8dd2-25101614e0a2 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "cinder-quobyte-3cc00d04-b6f7-49bf-9771-41f83e9515d6" released by "delete_volume" :: held 0.749s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:02:29 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-61dbf471-ea7a-4e36-8dd2-25101614e0a2 tempest-VolumesSnapshotTestJSON-1349136939 None] Created reservations ['bbf3cbbd-84a6-4f09-b266-950ae577c2ca', 'a8212445-d27b-4065-9b31-824a9ab3e848', 'b49ae990-a3d2-49a6-aeea-9d7d29a444c8', '2b2d1daa-900d-4ba1-996b-eb98fffb562a'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:02:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-61dbf471-ea7a-4e36-8dd2-25101614e0a2 tempest-VolumesSnapshotTestJSON-1349136939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:02:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-61dbf471-ea7a-4e36-8dd2-25101614e0a2 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:02:29 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-61dbf471-ea7a-4e36-8dd2-25101614e0a2 tempest-VolumesSnapshotTestJSON-1349136939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:02:29 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-61dbf471-ea7a-4e36-8dd2-25101614e0a2 tempest-VolumesSnapshotTestJSON-1349136939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:02:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-61dbf471-ea7a-4e36-8dd2-25101614e0a2 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:02:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-61dbf471-ea7a-4e36-8dd2-25101614e0a2 tempest-VolumesSnapshotTestJSON-1349136939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:29 devstack sudo[101084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:02:29 devstack sudo[101084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:29 devstack sudo[101084]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-61dbf471-ea7a-4e36-8dd2-25101614e0a2 tempest-VolumesSnapshotTestJSON-1349136939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.250s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:29 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-61dbf471-ea7a-4e36-8dd2-25101614e0a2 tempest-VolumesSnapshotTestJSON-1349136939 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:02:29 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-61dbf471-ea7a-4e36-8dd2-25101614e0a2 tempest-VolumesSnapshotTestJSON-1349136939 None] Deleted volume successfully. Sep 04 18:02:29 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-61dbf471-ea7a-4e36-8dd2-25101614e0a2 tempest-VolumesSnapshotTestJSON-1349136939 None] Lock "cinder-3cc00d04-b6f7-49bf-9771-41f83e9515d6-delete_volume" released by "delete_volume" :: held 1.223s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:02:32 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b9b9bff-c5df-4688-814a-9dbecbc94a93 tempest-TestInstancesWithCinderVolumes-750005214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:02:32 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3b9b9bff-c5df-4688-814a-9dbecbc94a93 tempest-TestInstancesWithCinderVolumes-750005214 None] Flow 'volume_create_manager' (685d830f-7eb6-47bb-8875-0378924ade36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:02:32 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3b9b9bff-c5df-4688-814a-9dbecbc94a93 tempest-TestInstancesWithCinderVolumes-750005214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa4c4ca8-e320-4ea8-81a4-2e3d5f3829dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:02:32 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3b9b9bff-c5df-4688-814a-9dbecbc94a93 tempest-TestInstancesWithCinderVolumes-750005214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa4c4ca8-e320-4ea8-81a4-2e3d5f3829dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:02:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-409953152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cdef629-a821-4289-ae6a-5873fa3f1c04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff4e5ab87db24263923955a6d4bd3d99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:02:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:02:32Z,use_quota=True,user_id='e5aeba5fc57c4c0c895ce2985de58d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb455f29-688b-4827-8ac9-f43ffdfd6a60),volume_type_id=fb455f29-688b-4827-8ac9-f43ffdfd6a60)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:02:32 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3b9b9bff-c5df-4688-814a-9dbecbc94a93 tempest-TestInstancesWithCinderVolumes-750005214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a0df6cf-e8d8-4e96-b710-07e2870839a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:02:32 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3b9b9bff-c5df-4688-814a-9dbecbc94a93 tempest-TestInstancesWithCinderVolumes-750005214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a0df6cf-e8d8-4e96-b710-07e2870839a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:02:32 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3b9b9bff-c5df-4688-814a-9dbecbc94a93 tempest-TestInstancesWithCinderVolumes-750005214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa579983-0b5a-4986-ba7f-9d193b3d56ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:02:32 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3b9b9bff-c5df-4688-814a-9dbecbc94a93 tempest-TestInstancesWithCinderVolumes-750005214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa579983-0b5a-4986-ba7f-9d193b3d56ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cdef629-a821-4289-ae6a-5873fa3f1c04', 'volume_name': 'volume-9cdef629-a821-4289-ae6a-5873fa3f1c04', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:02:32 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3b9b9bff-c5df-4688-814a-9dbecbc94a93 tempest-TestInstancesWithCinderVolumes-750005214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2b43dd7-c0c3-4e19-8173-038c90f3f1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:02:32 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3b9b9bff-c5df-4688-814a-9dbecbc94a93 tempest-TestInstancesWithCinderVolumes-750005214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2b43dd7-c0c3-4e19-8173-038c90f3f1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:02:32 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3b9b9bff-c5df-4688-814a-9dbecbc94a93 tempest-TestInstancesWithCinderVolumes-750005214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c9f8be8-ba2f-47d4-9bcf-14ad90cf7552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:02:32 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-3b9b9bff-c5df-4688-814a-9dbecbc94a93 tempest-TestInstancesWithCinderVolumes-750005214 None] Volume 9cdef629-a821-4289-ae6a-5873fa3f1c04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cdef629-a821-4289-ae6a-5873fa3f1c04', 'volume_size': 1} Sep 04 18:02:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3b9b9bff-c5df-4688-814a-9dbecbc94a93 tempest-TestInstancesWithCinderVolumes-750005214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:02:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3b9b9bff-c5df-4688-814a-9dbecbc94a93 tempest-TestInstancesWithCinderVolumes-750005214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:02:32 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-3b9b9bff-c5df-4688-814a-9dbecbc94a93 tempest-TestInstancesWithCinderVolumes-750005214 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:02:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-409953152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cdef629-a821-4289-ae6a-5873fa3f1c04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff4e5ab87db24263923955a6d4bd3d99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:02:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:02:32Z,use_quota=True,user_id='e5aeba5fc57c4c0c895ce2985de58d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb455f29-688b-4827-8ac9-f43ffdfd6a60),volume_type_id=fb455f29-688b-4827-8ac9-f43ffdfd6a60)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:02:32 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-3b9b9bff-c5df-4688-814a-9dbecbc94a93 tempest-TestInstancesWithCinderVolumes-750005214 None] Creating volume 9cdef629-a821-4289-ae6a-5873fa3f1c04 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:02:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3b9b9bff-c5df-4688-814a-9dbecbc94a93 tempest-TestInstancesWithCinderVolumes-750005214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:02:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3b9b9bff-c5df-4688-814a-9dbecbc94a93 tempest-TestInstancesWithCinderVolumes-750005214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:02:32 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-3b9b9bff-c5df-4688-814a-9dbecbc94a93 tempest-TestInstancesWithCinderVolumes-750005214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:02:32 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-3b9b9bff-c5df-4688-814a-9dbecbc94a93 tempest-TestInstancesWithCinderVolumes-750005214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:02:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3b9b9bff-c5df-4688-814a-9dbecbc94a93 tempest-TestInstancesWithCinderVolumes-750005214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:02:32 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-3b9b9bff-c5df-4688-814a-9dbecbc94a93 tempest-TestInstancesWithCinderVolumes-750005214 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:02:32 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-3b9b9bff-c5df-4688-814a-9dbecbc94a93 tempest-TestInstancesWithCinderVolumes-750005214 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:02:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3b9b9bff-c5df-4688-814a-9dbecbc94a93 tempest-TestInstancesWithCinderVolumes-750005214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9cdef629-a821-4289-ae6a-5873fa3f1c04 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:32 devstack sudo[101088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9cdef629-a821-4289-ae6a-5873fa3f1c04 1073741824 Sep 04 18:02:32 devstack sudo[101088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:32 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ca8ba49-3d1a-4dba-b633-daa0f1645376 tempest-TestInstancesWithCinderVolumes-750005214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:02:32 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3ca8ba49-3d1a-4dba-b633-daa0f1645376 tempest-TestInstancesWithCinderVolumes-750005214 None] Flow 'volume_create_manager' (cd76bc67-7274-4ed0-b915-fceb07a63c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:02:32 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3ca8ba49-3d1a-4dba-b633-daa0f1645376 tempest-TestInstancesWithCinderVolumes-750005214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b15b9fea-94f7-45ff-b9a3-86d647378007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:02:32 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3ca8ba49-3d1a-4dba-b633-daa0f1645376 tempest-TestInstancesWithCinderVolumes-750005214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b15b9fea-94f7-45ff-b9a3-86d647378007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:02:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1896236525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e84a8d40-0d9f-4c25-aede-024c8573e738,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff4e5ab87db24263923955a6d4bd3d99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:02:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:02:33Z,use_quota=True,user_id='e5aeba5fc57c4c0c895ce2985de58d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(910021ac-9df6-45a7-870a-641e4fb3d4a7),volume_type_id=910021ac-9df6-45a7-870a-641e4fb3d4a7)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:02:32 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3ca8ba49-3d1a-4dba-b633-daa0f1645376 tempest-TestInstancesWithCinderVolumes-750005214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb3a53a6-55a7-46f1-8f66-bb7bcf300226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:02:32 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3ca8ba49-3d1a-4dba-b633-daa0f1645376 tempest-TestInstancesWithCinderVolumes-750005214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb3a53a6-55a7-46f1-8f66-bb7bcf300226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:02:32 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3ca8ba49-3d1a-4dba-b633-daa0f1645376 tempest-TestInstancesWithCinderVolumes-750005214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (850b99e5-6548-404e-9b29-bc7a354039b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:02:32 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3ca8ba49-3d1a-4dba-b633-daa0f1645376 tempest-TestInstancesWithCinderVolumes-750005214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (850b99e5-6548-404e-9b29-bc7a354039b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e84a8d40-0d9f-4c25-aede-024c8573e738', 'volume_name': 'volume-e84a8d40-0d9f-4c25-aede-024c8573e738', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:02:32 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3ca8ba49-3d1a-4dba-b633-daa0f1645376 tempest-TestInstancesWithCinderVolumes-750005214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57b0d00c-6f8b-421c-8c34-d369dbebcd62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:02:32 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3ca8ba49-3d1a-4dba-b633-daa0f1645376 tempest-TestInstancesWithCinderVolumes-750005214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57b0d00c-6f8b-421c-8c34-d369dbebcd62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:02:32 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3ca8ba49-3d1a-4dba-b633-daa0f1645376 tempest-TestInstancesWithCinderVolumes-750005214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (660e0a68-6e6c-4fd2-bed4-87447ed89e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:02:32 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-3ca8ba49-3d1a-4dba-b633-daa0f1645376 tempest-TestInstancesWithCinderVolumes-750005214 None] Volume e84a8d40-0d9f-4c25-aede-024c8573e738: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e84a8d40-0d9f-4c25-aede-024c8573e738', 'volume_size': 1} Sep 04 18:02:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3ca8ba49-3d1a-4dba-b633-daa0f1645376 tempest-TestInstancesWithCinderVolumes-750005214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:02:32 devstack sudo[101088]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3b9b9bff-c5df-4688-814a-9dbecbc94a93 tempest-TestInstancesWithCinderVolumes-750005214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9cdef629-a821-4289-ae6a-5873fa3f1c04 1073741824" returned: 0 in 0.534s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3b9b9bff-c5df-4688-814a-9dbecbc94a93 tempest-TestInstancesWithCinderVolumes-750005214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9cdef629-a821-4289-ae6a-5873fa3f1c04 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:33 devstack sudo[101095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9cdef629-a821-4289-ae6a-5873fa3f1c04 Sep 04 18:02:33 devstack sudo[101095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:33 devstack sudo[101095]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3b9b9bff-c5df-4688-814a-9dbecbc94a93 tempest-TestInstancesWithCinderVolumes-750005214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9cdef629-a821-4289-ae6a-5873fa3f1c04" returned: 0 in 0.364s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:33 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-3b9b9bff-c5df-4688-814a-9dbecbc94a93 tempest-TestInstancesWithCinderVolumes-750005214 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:02:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3b9b9bff-c5df-4688-814a-9dbecbc94a93 tempest-TestInstancesWithCinderVolumes-750005214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:02:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3ca8ba49-3d1a-4dba-b633-daa0f1645376 tempest-TestInstancesWithCinderVolumes-750005214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.487s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:02:33 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-3ca8ba49-3d1a-4dba-b633-daa0f1645376 tempest-TestInstancesWithCinderVolumes-750005214 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:02:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1896236525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e84a8d40-0d9f-4c25-aede-024c8573e738,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff4e5ab87db24263923955a6d4bd3d99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:02:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:02:33Z,use_quota=True,user_id='e5aeba5fc57c4c0c895ce2985de58d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(910021ac-9df6-45a7-870a-641e4fb3d4a7),volume_type_id=910021ac-9df6-45a7-870a-641e4fb3d4a7)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:02:33 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-3ca8ba49-3d1a-4dba-b633-daa0f1645376 tempest-TestInstancesWithCinderVolumes-750005214 None] Creating volume e84a8d40-0d9f-4c25-aede-024c8573e738 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:02:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3ca8ba49-3d1a-4dba-b633-daa0f1645376 tempest-TestInstancesWithCinderVolumes-750005214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:02:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3ca8ba49-3d1a-4dba-b633-daa0f1645376 tempest-TestInstancesWithCinderVolumes-750005214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:02:33 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-3ca8ba49-3d1a-4dba-b633-daa0f1645376 tempest-TestInstancesWithCinderVolumes-750005214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:02:33 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-3ca8ba49-3d1a-4dba-b633-daa0f1645376 tempest-TestInstancesWithCinderVolumes-750005214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:02:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3ca8ba49-3d1a-4dba-b633-daa0f1645376 tempest-TestInstancesWithCinderVolumes-750005214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:02:33 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-3ca8ba49-3d1a-4dba-b633-daa0f1645376 tempest-TestInstancesWithCinderVolumes-750005214 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:02:33 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-3ca8ba49-3d1a-4dba-b633-daa0f1645376 tempest-TestInstancesWithCinderVolumes-750005214 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:02:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3ca8ba49-3d1a-4dba-b633-daa0f1645376 tempest-TestInstancesWithCinderVolumes-750005214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-e84a8d40-0d9f-4c25-aede-024c8573e738 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3b9b9bff-c5df-4688-814a-9dbecbc94a93 tempest-TestInstancesWithCinderVolumes-750005214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c9f8be8-ba2f-47d4-9bcf-14ad90cf7552) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cdef629-a821-4289-ae6a-5873fa3f1c04', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:02:33 devstack sudo[101098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-e84a8d40-0d9f-4c25-aede-024c8573e738 1073741824 Sep 04 18:02:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3b9b9bff-c5df-4688-814a-9dbecbc94a93 tempest-TestInstancesWithCinderVolumes-750005214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6efd174c-f7ba-4024-9798-c81d7d789a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:02:33 devstack sudo[101098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:33 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-3b9b9bff-c5df-4688-814a-9dbecbc94a93 tempest-TestInstancesWithCinderVolumes-750005214 None] Volume volume-9cdef629-a821-4289-ae6a-5873fa3f1c04 (9cdef629-a821-4289-ae6a-5873fa3f1c04): created successfully Sep 04 18:02:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3b9b9bff-c5df-4688-814a-9dbecbc94a93 tempest-TestInstancesWithCinderVolumes-750005214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6efd174c-f7ba-4024-9798-c81d7d789a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:02:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3b9b9bff-c5df-4688-814a-9dbecbc94a93 tempest-TestInstancesWithCinderVolumes-750005214 None] Flow 'volume_create_manager' (685d830f-7eb6-47bb-8875-0378924ade36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:02:33 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-85a7498f-0328-4699-8279-f474ec5fa170 tempest-TestInstancesWithCinderVolumes-750005214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:02:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-85a7498f-0328-4699-8279-f474ec5fa170 tempest-TestInstancesWithCinderVolumes-750005214 None] Flow 'volume_create_manager' (d7a3e3ae-ae3e-43ec-9571-2ba3c0767786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:02:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-85a7498f-0328-4699-8279-f474ec5fa170 tempest-TestInstancesWithCinderVolumes-750005214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c05830b-17ce-46f6-a650-4bed5346993b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:02:33 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-3b9b9bff-c5df-4688-814a-9dbecbc94a93 tempest-TestInstancesWithCinderVolumes-750005214 None] Created volume successfully. Sep 04 18:02:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-85a7498f-0328-4699-8279-f474ec5fa170 tempest-TestInstancesWithCinderVolumes-750005214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c05830b-17ce-46f6-a650-4bed5346993b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:02:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-844598832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d144b76d-2a1f-46fc-81ff-153170e27448,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff4e5ab87db24263923955a6d4bd3d99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:02:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:02:33Z,use_quota=True,user_id='e5aeba5fc57c4c0c895ce2985de58d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0da2f3c-8241-479c-b97d-fceeca3b6b70),volume_type_id=f0da2f3c-8241-479c-b97d-fceeca3b6b70)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:02:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-85a7498f-0328-4699-8279-f474ec5fa170 tempest-TestInstancesWithCinderVolumes-750005214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d357127-ef64-4e60-8fd2-3f62eb5a5241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:02:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-85a7498f-0328-4699-8279-f474ec5fa170 tempest-TestInstancesWithCinderVolumes-750005214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d357127-ef64-4e60-8fd2-3f62eb5a5241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:02:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-85a7498f-0328-4699-8279-f474ec5fa170 tempest-TestInstancesWithCinderVolumes-750005214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbcc23cd-d213-453d-a7b8-f38f23ee01de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:02:33 devstack cinder-volume[87314]: DEBUG cinder.image.glance [None req-85a7498f-0328-4699-8279-f474ec5fa170 tempest-TestInstancesWithCinderVolumes-750005214 None] Creating Keystone auth plugin from conf {{(pid=87314) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 04 18:02:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-85a7498f-0328-4699-8279-f474ec5fa170 tempest-TestInstancesWithCinderVolumes-750005214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbcc23cd-d213-453d-a7b8-f38f23ee01de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd144b76d-2a1f-46fc-81ff-153170e27448', 'volume_name': 'volume-d144b76d-2a1f-46fc-81ff-153170e27448', 'volume_size': 1, 'image_id': 'eea085de-0e7a-4835-a0ae-32382d04d958', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eea085de-0e7a-4835-a0ae-32382d04d958', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1931988306', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ff4e5ab87db24263923955a6d4bd3d99', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eea085de-0e7a-4835-a0ae-32382d04d958', 'created_at': datetime.datetime(2026, 9, 4, 16, 2, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 16, 2, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eea085de-0e7a-4835-a0ae-32382d04d958/file', 'properties': {}}, 'image_service': }' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:02:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-85a7498f-0328-4699-8279-f474ec5fa170 tempest-TestInstancesWithCinderVolumes-750005214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c565082-d7ee-4d04-b8e2-d32260a5ecdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:02:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-85a7498f-0328-4699-8279-f474ec5fa170 tempest-TestInstancesWithCinderVolumes-750005214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c565082-d7ee-4d04-b8e2-d32260a5ecdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:02:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-85a7498f-0328-4699-8279-f474ec5fa170 tempest-TestInstancesWithCinderVolumes-750005214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5402ce1-3466-4711-9bd1-16ce7dfe2f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:02:33 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-85a7498f-0328-4699-8279-f474ec5fa170 tempest-TestInstancesWithCinderVolumes-750005214 None] Volume d144b76d-2a1f-46fc-81ff-153170e27448: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d144b76d-2a1f-46fc-81ff-153170e27448', 'volume_size': 1, 'image_id': 'eea085de-0e7a-4835-a0ae-32382d04d958', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eea085de-0e7a-4835-a0ae-32382d04d958', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1931988306', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ff4e5ab87db24263923955a6d4bd3d99', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eea085de-0e7a-4835-a0ae-32382d04d958', 'created_at': datetime.datetime(2026, 9, 4, 16, 2, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 16, 2, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eea085de-0e7a-4835-a0ae-32382d04d958/file', 'properties': {}}, 'image_service': } Sep 04 18:02:33 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-85a7498f-0328-4699-8279-f474ec5fa170 tempest-TestInstancesWithCinderVolumes-750005214 None] Trying to clone d144b76d-2a1f-46fc-81ff-153170e27448 from image eea085de-0e7a-4835-a0ae-32382d04d958 at location (None, [{'url': 'file:///opt/stack/data/glance/images/eea085de-0e7a-4835-a0ae-32382d04d958', 'metadata': {}}]). {{(pid=87314) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 04 18:02:33 devstack sudo[101098]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3ca8ba49-3d1a-4dba-b633-daa0f1645376 tempest-TestInstancesWithCinderVolumes-750005214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-e84a8d40-0d9f-4c25-aede-024c8573e738 1073741824" returned: 0 in 0.593s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3ca8ba49-3d1a-4dba-b633-daa0f1645376 tempest-TestInstancesWithCinderVolumes-750005214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-e84a8d40-0d9f-4c25-aede-024c8573e738 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:34 devstack sudo[101105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-e84a8d40-0d9f-4c25-aede-024c8573e738 Sep 04 18:02:34 devstack sudo[101105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:34 devstack sudo[101105]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3ca8ba49-3d1a-4dba-b633-daa0f1645376 tempest-TestInstancesWithCinderVolumes-750005214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-e84a8d40-0d9f-4c25-aede-024c8573e738" returned: 0 in 0.303s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:34 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-3ca8ba49-3d1a-4dba-b633-daa0f1645376 tempest-TestInstancesWithCinderVolumes-750005214 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:02:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3ca8ba49-3d1a-4dba-b633-daa0f1645376 tempest-TestInstancesWithCinderVolumes-750005214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:02:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3ca8ba49-3d1a-4dba-b633-daa0f1645376 tempest-TestInstancesWithCinderVolumes-750005214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (660e0a68-6e6c-4fd2-bed4-87447ed89e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e84a8d40-0d9f-4c25-aede-024c8573e738', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:02:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3ca8ba49-3d1a-4dba-b633-daa0f1645376 tempest-TestInstancesWithCinderVolumes-750005214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b31a3cfa-8cab-43ee-8ef3-793d69a0dc43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:02:34 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-3ca8ba49-3d1a-4dba-b633-daa0f1645376 tempest-TestInstancesWithCinderVolumes-750005214 None] Volume volume-e84a8d40-0d9f-4c25-aede-024c8573e738 (e84a8d40-0d9f-4c25-aede-024c8573e738): created successfully Sep 04 18:02:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3ca8ba49-3d1a-4dba-b633-daa0f1645376 tempest-TestInstancesWithCinderVolumes-750005214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b31a3cfa-8cab-43ee-8ef3-793d69a0dc43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:02:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3ca8ba49-3d1a-4dba-b633-daa0f1645376 tempest-TestInstancesWithCinderVolumes-750005214 None] Flow 'volume_create_manager' (cd76bc67-7274-4ed0-b915-fceb07a63c66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:02:34 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-3ca8ba49-3d1a-4dba-b633-daa0f1645376 tempest-TestInstancesWithCinderVolumes-750005214 None] Created volume successfully. Sep 04 18:02:36 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b1d0151-7f3b-4e9c-9298-1b52c3abb075 tempest-VolumesSnapshotListTestJSON-1629775123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:02:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9b1d0151-7f3b-4e9c-9298-1b52c3abb075 tempest-VolumesSnapshotListTestJSON-1629775123 None] Flow 'volume_create_manager' (71ab64cf-cd44-4740-9239-11a5771463e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:02:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9b1d0151-7f3b-4e9c-9298-1b52c3abb075 tempest-VolumesSnapshotListTestJSON-1629775123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09624e71-516c-43cc-a5cc-4af3532c4059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:02:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9b1d0151-7f3b-4e9c-9298-1b52c3abb075 tempest-VolumesSnapshotListTestJSON-1629775123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09624e71-516c-43cc-a5cc-4af3532c4059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:02:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-975723681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b28871c0-9599-4865-ba2c-62286b233fba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7bc57874d434598827b8fd7f77606de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:02:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:02:37Z,use_quota=True,user_id='3d61df31ace04bd592828ce2634fdef9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:02:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9b1d0151-7f3b-4e9c-9298-1b52c3abb075 tempest-VolumesSnapshotListTestJSON-1629775123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddf2e475-5bfa-45a6-a519-a3838088c492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:02:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9b1d0151-7f3b-4e9c-9298-1b52c3abb075 tempest-VolumesSnapshotListTestJSON-1629775123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddf2e475-5bfa-45a6-a519-a3838088c492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:02:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9b1d0151-7f3b-4e9c-9298-1b52c3abb075 tempest-VolumesSnapshotListTestJSON-1629775123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71c80a54-a481-4227-9f8f-3ac73ea0f9d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:02:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9b1d0151-7f3b-4e9c-9298-1b52c3abb075 tempest-VolumesSnapshotListTestJSON-1629775123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71c80a54-a481-4227-9f8f-3ac73ea0f9d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b28871c0-9599-4865-ba2c-62286b233fba', 'volume_name': 'volume-b28871c0-9599-4865-ba2c-62286b233fba', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:02:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9b1d0151-7f3b-4e9c-9298-1b52c3abb075 tempest-VolumesSnapshotListTestJSON-1629775123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5db7fe1d-b29e-4733-9fe4-48b3117f58f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:02:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9b1d0151-7f3b-4e9c-9298-1b52c3abb075 tempest-VolumesSnapshotListTestJSON-1629775123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5db7fe1d-b29e-4733-9fe4-48b3117f58f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:02:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9b1d0151-7f3b-4e9c-9298-1b52c3abb075 tempest-VolumesSnapshotListTestJSON-1629775123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff233754-4d8f-458a-9de7-92db77bb61b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:02:36 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-9b1d0151-7f3b-4e9c-9298-1b52c3abb075 tempest-VolumesSnapshotListTestJSON-1629775123 None] Volume b28871c0-9599-4865-ba2c-62286b233fba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b28871c0-9599-4865-ba2c-62286b233fba', 'volume_size': 1} Sep 04 18:02:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9b1d0151-7f3b-4e9c-9298-1b52c3abb075 tempest-VolumesSnapshotListTestJSON-1629775123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:02:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9b1d0151-7f3b-4e9c-9298-1b52c3abb075 tempest-VolumesSnapshotListTestJSON-1629775123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:02:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9b1d0151-7f3b-4e9c-9298-1b52c3abb075 tempest-VolumesSnapshotListTestJSON-1629775123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:02:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-975723681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b28871c0-9599-4865-ba2c-62286b233fba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7bc57874d434598827b8fd7f77606de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:02:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:02:37Z,use_quota=True,user_id='3d61df31ace04bd592828ce2634fdef9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:02:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-9b1d0151-7f3b-4e9c-9298-1b52c3abb075 tempest-VolumesSnapshotListTestJSON-1629775123 None] Creating volume b28871c0-9599-4865-ba2c-62286b233fba {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:02:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9b1d0151-7f3b-4e9c-9298-1b52c3abb075 tempest-VolumesSnapshotListTestJSON-1629775123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:02:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9b1d0151-7f3b-4e9c-9298-1b52c3abb075 tempest-VolumesSnapshotListTestJSON-1629775123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:02:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9b1d0151-7f3b-4e9c-9298-1b52c3abb075 tempest-VolumesSnapshotListTestJSON-1629775123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:02:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9b1d0151-7f3b-4e9c-9298-1b52c3abb075 tempest-VolumesSnapshotListTestJSON-1629775123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:02:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9b1d0151-7f3b-4e9c-9298-1b52c3abb075 tempest-VolumesSnapshotListTestJSON-1629775123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:02:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9b1d0151-7f3b-4e9c-9298-1b52c3abb075 tempest-VolumesSnapshotListTestJSON-1629775123 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:02:36 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-9b1d0151-7f3b-4e9c-9298-1b52c3abb075 tempest-VolumesSnapshotListTestJSON-1629775123 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:02:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9b1d0151-7f3b-4e9c-9298-1b52c3abb075 tempest-VolumesSnapshotListTestJSON-1629775123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:36 devstack sudo[101109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba 1073741824 Sep 04 18:02:36 devstack sudo[101109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:37 devstack sudo[101109]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:37 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-85a7498f-0328-4699-8279-f474ec5fa170 tempest-TestInstancesWithCinderVolumes-750005214 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_eea085de-0e7a-4835-a0ae-32382d04d958_tesk68sldevstack@QuobyteHD, size 20.69 MB, duration 3.51 sec {{(pid=87314) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 04 18:02:37 devstack cinder-volume[87314]: INFO cinder.image.image_utils [None req-85a7498f-0328-4699-8279-f474ec5fa170 tempest-TestInstancesWithCinderVolumes-750005214 None] Image download 20.69 MB at 5.89 MB/s Sep 04 18:02:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9b1d0151-7f3b-4e9c-9298-1b52c3abb075 tempest-VolumesSnapshotListTestJSON-1629775123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba 1073741824" returned: 0 in 0.432s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:37 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[023cc0d1-a38f-4002-bbc8-c164873fe020]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:02:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-85a7498f-0328-4699-8279-f474ec5fa170 tempest-TestInstancesWithCinderVolumes-750005214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eea085de-0e7a-4835-a0ae-32382d04d958_tesk68sldevstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9b1d0151-7f3b-4e9c-9298-1b52c3abb075 tempest-VolumesSnapshotListTestJSON-1629775123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:37 devstack sudo[101116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba Sep 04 18:02:37 devstack sudo[101116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:37 devstack sudo[101115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eea085de-0e7a-4835-a0ae-32382d04d958_tesk68sldevstack@QuobyteHD Sep 04 18:02:37 devstack sudo[101115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:37 devstack sudo[101116]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9b1d0151-7f3b-4e9c-9298-1b52c3abb075 tempest-VolumesSnapshotListTestJSON-1629775123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba" returned: 0 in 0.264s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:37 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9b1d0151-7f3b-4e9c-9298-1b52c3abb075 tempest-VolumesSnapshotListTestJSON-1629775123 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:02:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9b1d0151-7f3b-4e9c-9298-1b52c3abb075 tempest-VolumesSnapshotListTestJSON-1629775123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:02:37 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9b1d0151-7f3b-4e9c-9298-1b52c3abb075 tempest-VolumesSnapshotListTestJSON-1629775123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff233754-4d8f-458a-9de7-92db77bb61b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b28871c0-9599-4865-ba2c-62286b233fba', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:02:37 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9b1d0151-7f3b-4e9c-9298-1b52c3abb075 tempest-VolumesSnapshotListTestJSON-1629775123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52ae459a-08f5-4f7a-967f-28e6581a65d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:02:37 devstack sudo[101115]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-85a7498f-0328-4699-8279-f474ec5fa170 tempest-TestInstancesWithCinderVolumes-750005214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eea085de-0e7a-4835-a0ae-32382d04d958_tesk68sldevstack@QuobyteHD" returned: 0 in 0.323s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:37 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-85a7498f-0328-4699-8279-f474ec5fa170 tempest-TestInstancesWithCinderVolumes-750005214 None] Temporary image eea085de-0e7a-4835-a0ae-32382d04d958 is fetched for user e5aeba5fc57c4c0c895ce2985de58d2f. {{(pid=87314) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 04 18:02:37 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-9b1d0151-7f3b-4e9c-9298-1b52c3abb075 tempest-VolumesSnapshotListTestJSON-1629775123 None] Volume volume-b28871c0-9599-4865-ba2c-62286b233fba (b28871c0-9599-4865-ba2c-62286b233fba): created successfully Sep 04 18:02:37 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9b1d0151-7f3b-4e9c-9298-1b52c3abb075 tempest-VolumesSnapshotListTestJSON-1629775123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52ae459a-08f5-4f7a-967f-28e6581a65d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:02:37 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9b1d0151-7f3b-4e9c-9298-1b52c3abb075 tempest-VolumesSnapshotListTestJSON-1629775123 None] Flow 'volume_create_manager' (71ab64cf-cd44-4740-9239-11a5771463e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:02:37 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-9b1d0151-7f3b-4e9c-9298-1b52c3abb075 tempest-VolumesSnapshotListTestJSON-1629775123 None] Created volume successfully. Sep 04 18:02:37 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[e215dd6b-cf8b-40c9-b0be-981c85d1569d]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:02:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-85a7498f-0328-4699-8279-f474ec5fa170 tempest-TestInstancesWithCinderVolumes-750005214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eea085de-0e7a-4835-a0ae-32382d04d958_tesk68sldevstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:37 devstack sudo[101123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eea085de-0e7a-4835-a0ae-32382d04d958_tesk68sldevstack@QuobyteHD Sep 04 18:02:37 devstack sudo[101123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-635920dc-8581-4450-a525-f34ab6f870b6 tempest-VolumesSnapshotListTestJSON-1629775123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:02:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-635920dc-8581-4450-a525-f34ab6f870b6 tempest-VolumesSnapshotListTestJSON-1629775123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:02:38 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-635920dc-8581-4450-a525-f34ab6f870b6 tempest-VolumesSnapshotListTestJSON-1629775123 None] Creating offline snapshot 6b164e91-4581-4179-b6cb-a1fc82dc09bc of volume b28871c0-9599-4865-ba2c-62286b233fba {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 18:02:38 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[8242e282-6a10-4e64-a31a-f0433f86263b]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:02:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-635920dc-8581-4450-a525-f34ab6f870b6 tempest-VolumesSnapshotListTestJSON-1629775123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:38 devstack sudo[101123]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-85a7498f-0328-4699-8279-f474ec5fa170 tempest-TestInstancesWithCinderVolumes-750005214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eea085de-0e7a-4835-a0ae-32382d04d958_tesk68sldevstack@QuobyteHD" returned: 0 in 0.354s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-85a7498f-0328-4699-8279-f474ec5fa170 tempest-TestInstancesWithCinderVolumes-750005214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:02:38 devstack sudo[101125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba Sep 04 18:02:38 devstack sudo[101125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:38 devstack sudo[101125]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-635920dc-8581-4450-a525-f34ab6f870b6 tempest-VolumesSnapshotListTestJSON-1629775123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba" returned: 0 in 0.350s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-635920dc-8581-4450-a525-f34ab6f870b6 tempest-VolumesSnapshotListTestJSON-1629775123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.6b164e91-4581-4179-b6cb-a1fc82dc09bc 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:38 devstack sudo[101133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.6b164e91-4581-4179-b6cb-a1fc82dc09bc 1G Sep 04 18:02:38 devstack sudo[101133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:38 devstack sudo[101133]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-635920dc-8581-4450-a525-f34ab6f870b6 tempest-VolumesSnapshotListTestJSON-1629775123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.6b164e91-4581-4179-b6cb-a1fc82dc09bc 1G" returned: 0 in 0.379s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-635920dc-8581-4450-a525-f34ab6f870b6 tempest-VolumesSnapshotListTestJSON-1629775123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b28871c0-9599-4865-ba2c-62286b233fba -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.6b164e91-4581-4179-b6cb-a1fc82dc09bc {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:38 devstack sudo[101138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b28871c0-9599-4865-ba2c-62286b233fba -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.6b164e91-4581-4179-b6cb-a1fc82dc09bc Sep 04 18:02:38 devstack sudo[101138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:39 devstack sudo[101138]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-635920dc-8581-4450-a525-f34ab6f870b6 tempest-VolumesSnapshotListTestJSON-1629775123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b28871c0-9599-4865-ba2c-62286b233fba -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.6b164e91-4581-4179-b6cb-a1fc82dc09bc" returned: 0 in 0.295s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:39 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-635920dc-8581-4450-a525-f34ab6f870b6 tempest-VolumesSnapshotListTestJSON-1629775123 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.6b164e91-4581-4179-b6cb-a1fc82dc09bc is being set with open permissions: ugo+rw Sep 04 18:02:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-635920dc-8581-4450-a525-f34ab6f870b6 tempest-VolumesSnapshotListTestJSON-1629775123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.6b164e91-4581-4179-b6cb-a1fc82dc09bc {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:39 devstack sudo[101145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.6b164e91-4581-4179-b6cb-a1fc82dc09bc Sep 04 18:02:39 devstack sudo[101145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:39 devstack sudo[101145]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-635920dc-8581-4450-a525-f34ab6f870b6 tempest-VolumesSnapshotListTestJSON-1629775123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.6b164e91-4581-4179-b6cb-a1fc82dc09bc" returned: 0 in 0.238s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-635920dc-8581-4450-a525-f34ab6f870b6 tempest-VolumesSnapshotListTestJSON-1629775123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:39 devstack sudo[101148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.info Sep 04 18:02:39 devstack sudo[101148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:39 devstack sudo[101148]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-635920dc-8581-4450-a525-f34ab6f870b6 tempest-VolumesSnapshotListTestJSON-1629775123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.info" returned: 0 in 0.255s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:39 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-635920dc-8581-4450-a525-f34ab6f870b6 tempest-VolumesSnapshotListTestJSON-1629775123 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.info is being set with open permissions: ugo+rw Sep 04 18:02:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-635920dc-8581-4450-a525-f34ab6f870b6 tempest-VolumesSnapshotListTestJSON-1629775123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:39 devstack sudo[101151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.info Sep 04 18:02:39 devstack sudo[101151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:39 devstack sudo[101151]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-635920dc-8581-4450-a525-f34ab6f870b6 tempest-VolumesSnapshotListTestJSON-1629775123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.info" returned: 0 in 0.255s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-635920dc-8581-4450-a525-f34ab6f870b6 tempest-VolumesSnapshotListTestJSON-1629775123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.864s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:02:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-85a7498f-0328-4699-8279-f474ec5fa170 tempest-TestInstancesWithCinderVolumes-750005214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.756s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:02:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-85a7498f-0328-4699-8279-f474ec5fa170 tempest-TestInstancesWithCinderVolumes-750005214 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:02:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-844598832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d144b76d-2a1f-46fc-81ff-153170e27448,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff4e5ab87db24263923955a6d4bd3d99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:02:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:02:33Z,use_quota=True,user_id='e5aeba5fc57c4c0c895ce2985de58d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0da2f3c-8241-479c-b97d-fceeca3b6b70),volume_type_id=f0da2f3c-8241-479c-b97d-fceeca3b6b70)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:02:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-85a7498f-0328-4699-8279-f474ec5fa170 tempest-TestInstancesWithCinderVolumes-750005214 None] Creating volume d144b76d-2a1f-46fc-81ff-153170e27448 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:02:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-85a7498f-0328-4699-8279-f474ec5fa170 tempest-TestInstancesWithCinderVolumes-750005214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:02:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-85a7498f-0328-4699-8279-f474ec5fa170 tempest-TestInstancesWithCinderVolumes-750005214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:02:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-85a7498f-0328-4699-8279-f474ec5fa170 tempest-TestInstancesWithCinderVolumes-750005214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:02:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-85a7498f-0328-4699-8279-f474ec5fa170 tempest-TestInstancesWithCinderVolumes-750005214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:02:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-85a7498f-0328-4699-8279-f474ec5fa170 tempest-TestInstancesWithCinderVolumes-750005214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:02:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-85a7498f-0328-4699-8279-f474ec5fa170 tempest-TestInstancesWithCinderVolumes-750005214 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:02:39 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-85a7498f-0328-4699-8279-f474ec5fa170 tempest-TestInstancesWithCinderVolumes-750005214 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:02:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-85a7498f-0328-4699-8279-f474ec5fa170 tempest-TestInstancesWithCinderVolumes-750005214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d144b76d-2a1f-46fc-81ff-153170e27448 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:39 devstack sudo[101154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d144b76d-2a1f-46fc-81ff-153170e27448 1073741824 Sep 04 18:02:39 devstack sudo[101154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:39 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-635920dc-8581-4450-a525-f34ab6f870b6 tempest-VolumesSnapshotListTestJSON-1629775123 None] Create snapshot completed successfully Sep 04 18:02:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1f675fde-6b5f-4760-810e-f6961db65359 tempest-VolumesSnapshotListTestJSON-1629775123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:02:40 devstack sudo[101154]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-85a7498f-0328-4699-8279-f474ec5fa170 tempest-TestInstancesWithCinderVolumes-750005214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d144b76d-2a1f-46fc-81ff-153170e27448 1073741824" returned: 0 in 0.459s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-85a7498f-0328-4699-8279-f474ec5fa170 tempest-TestInstancesWithCinderVolumes-750005214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d144b76d-2a1f-46fc-81ff-153170e27448 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:40 devstack sudo[101160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d144b76d-2a1f-46fc-81ff-153170e27448 Sep 04 18:02:40 devstack sudo[101160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:40 devstack sudo[101160]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-85a7498f-0328-4699-8279-f474ec5fa170 tempest-TestInstancesWithCinderVolumes-750005214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d144b76d-2a1f-46fc-81ff-153170e27448" returned: 0 in 0.247s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-85a7498f-0328-4699-8279-f474ec5fa170 tempest-TestInstancesWithCinderVolumes-750005214 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:02:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-85a7498f-0328-4699-8279-f474ec5fa170 tempest-TestInstancesWithCinderVolumes-750005214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:02:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1f675fde-6b5f-4760-810e-f6961db65359 tempest-VolumesSnapshotListTestJSON-1629775123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.331s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:02:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-1f675fde-6b5f-4760-810e-f6961db65359 tempest-VolumesSnapshotListTestJSON-1629775123 None] Creating offline snapshot 6ff1fe94-8ca5-4707-8833-52d4507dcacd of volume b28871c0-9599-4865-ba2c-62286b233fba {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 18:02:40 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[51bd5a37-8a38-424d-8b13-0fe30884bed2]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:02:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1f675fde-6b5f-4760-810e-f6961db65359 tempest-VolumesSnapshotListTestJSON-1629775123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.6b164e91-4581-4179-b6cb-a1fc82dc09bc {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:40 devstack cinder-volume[87314]: DEBUG cinder.volume.volume_utils [None req-85a7498f-0328-4699-8279-f474ec5fa170 tempest-TestInstancesWithCinderVolumes-750005214 None] Attempting download of eea085de-0e7a-4835-a0ae-32382d04d958 ((None, [{'url': 'file:///opt/stack/data/glance/images/eea085de-0e7a-4835-a0ae-32382d04d958', 'metadata': {}}])) to volume d144b76d-2a1f-46fc-81ff-153170e27448. {{(pid=87314) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 04 18:02:40 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf745a8-bec2-4c40-b8ba-56f7b9615d7c]: (4, 'raw') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:02:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-85a7498f-0328-4699-8279-f474ec5fa170 tempest-TestInstancesWithCinderVolumes-750005214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eea085de-0e7a-4835-a0ae-32382d04d958_a4z7bopw {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:40 devstack sudo[101163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.6b164e91-4581-4179-b6cb-a1fc82dc09bc Sep 04 18:02:40 devstack sudo[101163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:40 devstack sudo[101164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eea085de-0e7a-4835-a0ae-32382d04d958_a4z7bopw Sep 04 18:02:40 devstack sudo[101164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:41 devstack sudo[101163]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1f675fde-6b5f-4760-810e-f6961db65359 tempest-VolumesSnapshotListTestJSON-1629775123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.6b164e91-4581-4179-b6cb-a1fc82dc09bc" returned: 0 in 0.368s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:41 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-1f675fde-6b5f-4760-810e-f6961db65359 tempest-VolumesSnapshotListTestJSON-1629775123 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b28871c0-9599-4865-ba2c-62286b233fba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 18:02:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1f675fde-6b5f-4760-810e-f6961db65359 tempest-VolumesSnapshotListTestJSON-1629775123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.6b164e91-4581-4179-b6cb-a1fc82dc09bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.6ff1fe94-8ca5-4707-8833-52d4507dcacd 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:41 devstack sudo[101170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.6b164e91-4581-4179-b6cb-a1fc82dc09bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.6ff1fe94-8ca5-4707-8833-52d4507dcacd 1G Sep 04 18:02:41 devstack sudo[101170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:41 devstack sudo[101164]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-85a7498f-0328-4699-8279-f474ec5fa170 tempest-TestInstancesWithCinderVolumes-750005214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eea085de-0e7a-4835-a0ae-32382d04d958_a4z7bopw" returned: 0 in 0.357s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-85a7498f-0328-4699-8279-f474ec5fa170 tempest-TestInstancesWithCinderVolumes-750005214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eea085de-0e7a-4835-a0ae-32382d04d958_a4z7bopw {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:41 devstack sudo[101174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eea085de-0e7a-4835-a0ae-32382d04d958_a4z7bopw Sep 04 18:02:41 devstack sudo[101174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:41 devstack sudo[101174]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-85a7498f-0328-4699-8279-f474ec5fa170 tempest-TestInstancesWithCinderVolumes-750005214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eea085de-0e7a-4835-a0ae-32382d04d958_a4z7bopw" returned: 1 in 0.363s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-85a7498f-0328-4699-8279-f474ec5fa170 tempest-TestInstancesWithCinderVolumes-750005214 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eea085de-0e7a-4835-a0ae-32382d04d958_a4z7bopw' failed. Not Retrying. {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 18:02:41 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1134b87-b457-4be2-916a-493c9d91e61d]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:02:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-85a7498f-0328-4699-8279-f474ec5fa170 tempest-TestInstancesWithCinderVolumes-750005214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eea085de-0e7a-4835-a0ae-32382d04d958_tesk68sldevstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:41 devstack sudo[101170]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1f675fde-6b5f-4760-810e-f6961db65359 tempest-VolumesSnapshotListTestJSON-1629775123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.6b164e91-4581-4179-b6cb-a1fc82dc09bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.6ff1fe94-8ca5-4707-8833-52d4507dcacd 1G" returned: 0 in 0.441s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1f675fde-6b5f-4760-810e-f6961db65359 tempest-VolumesSnapshotListTestJSON-1629775123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b28871c0-9599-4865-ba2c-62286b233fba.6b164e91-4581-4179-b6cb-a1fc82dc09bc -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.6ff1fe94-8ca5-4707-8833-52d4507dcacd {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:41 devstack sudo[101183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b28871c0-9599-4865-ba2c-62286b233fba.6b164e91-4581-4179-b6cb-a1fc82dc09bc -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.6ff1fe94-8ca5-4707-8833-52d4507dcacd Sep 04 18:02:41 devstack sudo[101183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:41 devstack sudo[101182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eea085de-0e7a-4835-a0ae-32382d04d958_tesk68sldevstack@QuobyteHD Sep 04 18:02:41 devstack sudo[101182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:41 devstack sudo[101183]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1f675fde-6b5f-4760-810e-f6961db65359 tempest-VolumesSnapshotListTestJSON-1629775123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b28871c0-9599-4865-ba2c-62286b233fba.6b164e91-4581-4179-b6cb-a1fc82dc09bc -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.6ff1fe94-8ca5-4707-8833-52d4507dcacd" returned: 0 in 0.287s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:41 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-1f675fde-6b5f-4760-810e-f6961db65359 tempest-VolumesSnapshotListTestJSON-1629775123 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.6ff1fe94-8ca5-4707-8833-52d4507dcacd is being set with open permissions: ugo+rw Sep 04 18:02:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1f675fde-6b5f-4760-810e-f6961db65359 tempest-VolumesSnapshotListTestJSON-1629775123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.6ff1fe94-8ca5-4707-8833-52d4507dcacd {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:41 devstack sudo[101189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.6ff1fe94-8ca5-4707-8833-52d4507dcacd Sep 04 18:02:41 devstack sudo[101189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:41 devstack sudo[101182]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-85a7498f-0328-4699-8279-f474ec5fa170 tempest-TestInstancesWithCinderVolumes-750005214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eea085de-0e7a-4835-a0ae-32382d04d958_tesk68sldevstack@QuobyteHD" returned: 0 in 0.390s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:41 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-85a7498f-0328-4699-8279-f474ec5fa170 tempest-TestInstancesWithCinderVolumes-750005214 None] eea085de-0e7a-4835-a0ae-32382d04d958 was qcow2, converting to qcow2 {{(pid=87314) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 04 18:02:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-85a7498f-0328-4699-8279-f474ec5fa170 tempest-TestInstancesWithCinderVolumes-750005214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eea085de-0e7a-4835-a0ae-32382d04d958_tesk68sldevstack@QuobyteHD /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d144b76d-2a1f-46fc-81ff-153170e27448 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:41 devstack sudo[101195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eea085de-0e7a-4835-a0ae-32382d04d958_tesk68sldevstack@QuobyteHD /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d144b76d-2a1f-46fc-81ff-153170e27448 Sep 04 18:02:41 devstack sudo[101195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:42 devstack sudo[101189]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1f675fde-6b5f-4760-810e-f6961db65359 tempest-VolumesSnapshotListTestJSON-1629775123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.6ff1fe94-8ca5-4707-8833-52d4507dcacd" returned: 0 in 0.262s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1f675fde-6b5f-4760-810e-f6961db65359 tempest-VolumesSnapshotListTestJSON-1629775123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.456s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:02:42 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-1f675fde-6b5f-4760-810e-f6961db65359 tempest-VolumesSnapshotListTestJSON-1629775123 None] Create snapshot completed successfully Sep 04 18:02:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8e006df0-93e3-4520-aac8-176f0a7b161d tempest-VolumesSnapshotListTestJSON-1629775123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:02:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8e006df0-93e3-4520-aac8-176f0a7b161d tempest-VolumesSnapshotListTestJSON-1629775123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:02:42 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-8e006df0-93e3-4520-aac8-176f0a7b161d tempest-VolumesSnapshotListTestJSON-1629775123 None] Creating offline snapshot e35e713e-27e3-4b0b-8967-d19659cceec5 of volume b28871c0-9599-4865-ba2c-62286b233fba {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 18:02:42 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[2351c153-f12a-4d09-a67b-d6640121f8f1]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:02:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8e006df0-93e3-4520-aac8-176f0a7b161d tempest-VolumesSnapshotListTestJSON-1629775123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.6ff1fe94-8ca5-4707-8833-52d4507dcacd {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:42 devstack sudo[101207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.6ff1fe94-8ca5-4707-8833-52d4507dcacd Sep 04 18:02:42 devstack sudo[101207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:43 devstack sudo[101207]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8e006df0-93e3-4520-aac8-176f0a7b161d tempest-VolumesSnapshotListTestJSON-1629775123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.6ff1fe94-8ca5-4707-8833-52d4507dcacd" returned: 0 in 0.397s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:43 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-8e006df0-93e3-4520-aac8-176f0a7b161d tempest-VolumesSnapshotListTestJSON-1629775123 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b28871c0-9599-4865-ba2c-62286b233fba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 18:02:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8e006df0-93e3-4520-aac8-176f0a7b161d tempest-VolumesSnapshotListTestJSON-1629775123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.6ff1fe94-8ca5-4707-8833-52d4507dcacd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.e35e713e-27e3-4b0b-8967-d19659cceec5 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:43 devstack sudo[101212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.6ff1fe94-8ca5-4707-8833-52d4507dcacd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.e35e713e-27e3-4b0b-8967-d19659cceec5 1G Sep 04 18:02:43 devstack sudo[101212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:43 devstack sudo[101195]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-85a7498f-0328-4699-8279-f474ec5fa170 tempest-TestInstancesWithCinderVolumes-750005214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eea085de-0e7a-4835-a0ae-32382d04d958_tesk68sldevstack@QuobyteHD /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d144b76d-2a1f-46fc-81ff-153170e27448" returned: 0 in 1.645s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:43 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-85a7498f-0328-4699-8279-f474ec5fa170 tempest-TestInstancesWithCinderVolumes-750005214 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_eea085de-0e7a-4835-a0ae-32382d04d958_tesk68sldevstack@QuobyteHD, size 112.00 MB, duration 1.65 sec, destination /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d144b76d-2a1f-46fc-81ff-153170e27448 {{(pid=87314) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 18:02:43 devstack cinder-volume[87314]: INFO cinder.image.image_utils [None req-85a7498f-0328-4699-8279-f474ec5fa170 tempest-TestInstancesWithCinderVolumes-750005214 None] Converted 112.00 MB image at 68.01 MB/s Sep 04 18:02:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-85a7498f-0328-4699-8279-f474ec5fa170 tempest-TestInstancesWithCinderVolumes-750005214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d144b76d-2a1f-46fc-81ff-153170e27448 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:43 devstack sudo[101212]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8e006df0-93e3-4520-aac8-176f0a7b161d tempest-VolumesSnapshotListTestJSON-1629775123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.6ff1fe94-8ca5-4707-8833-52d4507dcacd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.e35e713e-27e3-4b0b-8967-d19659cceec5 1G" returned: 0 in 0.487s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8e006df0-93e3-4520-aac8-176f0a7b161d tempest-VolumesSnapshotListTestJSON-1629775123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b28871c0-9599-4865-ba2c-62286b233fba.6ff1fe94-8ca5-4707-8833-52d4507dcacd -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.e35e713e-27e3-4b0b-8967-d19659cceec5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:43 devstack sudo[101217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d144b76d-2a1f-46fc-81ff-153170e27448 1G Sep 04 18:02:43 devstack sudo[101217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:43 devstack sudo[101218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b28871c0-9599-4865-ba2c-62286b233fba.6ff1fe94-8ca5-4707-8833-52d4507dcacd -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.e35e713e-27e3-4b0b-8967-d19659cceec5 Sep 04 18:02:43 devstack sudo[101218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:43 devstack sudo[101218]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8e006df0-93e3-4520-aac8-176f0a7b161d tempest-VolumesSnapshotListTestJSON-1629775123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b28871c0-9599-4865-ba2c-62286b233fba.6ff1fe94-8ca5-4707-8833-52d4507dcacd -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.e35e713e-27e3-4b0b-8967-d19659cceec5" returned: 0 in 0.279s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:43 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-8e006df0-93e3-4520-aac8-176f0a7b161d tempest-VolumesSnapshotListTestJSON-1629775123 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.e35e713e-27e3-4b0b-8967-d19659cceec5 is being set with open permissions: ugo+rw Sep 04 18:02:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8e006df0-93e3-4520-aac8-176f0a7b161d tempest-VolumesSnapshotListTestJSON-1629775123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.e35e713e-27e3-4b0b-8967-d19659cceec5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:43 devstack sudo[101217]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-85a7498f-0328-4699-8279-f474ec5fa170 tempest-TestInstancesWithCinderVolumes-750005214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d144b76d-2a1f-46fc-81ff-153170e27448 1G" returned: 0 in 0.313s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:43 devstack cinder-volume[87314]: DEBUG cinder.volume.volume_utils [None req-85a7498f-0328-4699-8279-f474ec5fa170 tempest-TestInstancesWithCinderVolumes-750005214 None] Downloaded image eea085de-0e7a-4835-a0ae-32382d04d958 ((None, [{'url': 'file:///opt/stack/data/glance/images/eea085de-0e7a-4835-a0ae-32382d04d958', 'metadata': {}}])) to volume d144b76d-2a1f-46fc-81ff-153170e27448 successfully. {{(pid=87314) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 04 18:02:43 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-85a7498f-0328-4699-8279-f474ec5fa170 tempest-TestInstancesWithCinderVolumes-750005214 None] Temporary image eea085de-0e7a-4835-a0ae-32382d04d958 for user e5aeba5fc57c4c0c895ce2985de58d2f is deleted. {{(pid=87314) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 04 18:02:43 devstack cinder-volume[87314]: DEBUG cinder.volume.volume_utils [None req-85a7498f-0328-4699-8279-f474ec5fa170 tempest-TestInstancesWithCinderVolumes-750005214 None] Marking volume d144b76d-2a1f-46fc-81ff-153170e27448 as bootable. {{(pid=87314) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 04 18:02:43 devstack sudo[101228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.e35e713e-27e3-4b0b-8967-d19659cceec5 Sep 04 18:02:43 devstack sudo[101228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:43 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-85a7498f-0328-4699-8279-f474ec5fa170 tempest-TestInstancesWithCinderVolumes-750005214 None] Copying metadata from image eea085de-0e7a-4835-a0ae-32382d04d958 to d144b76d-2a1f-46fc-81ff-153170e27448. {{(pid=87314) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 04 18:02:43 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-85a7498f-0328-4699-8279-f474ec5fa170 tempest-TestInstancesWithCinderVolumes-750005214 None] Creating volume glance metadata for volume d144b76d-2a1f-46fc-81ff-153170e27448 backed by image eea085de-0e7a-4835-a0ae-32382d04d958 with: {'image_id': 'eea085de-0e7a-4835-a0ae-32382d04d958', 'image_name': 'tempest-scenario-img--1931988306', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87314) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 04 18:02:43 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-85a7498f-0328-4699-8279-f474ec5fa170 tempest-TestInstancesWithCinderVolumes-750005214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5402ce1-3466-4711-9bd1-16ce7dfe2f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d144b76d-2a1f-46fc-81ff-153170e27448', 'volume_size': 1, 'image_id': 'eea085de-0e7a-4835-a0ae-32382d04d958', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eea085de-0e7a-4835-a0ae-32382d04d958', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1931988306', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ff4e5ab87db24263923955a6d4bd3d99', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eea085de-0e7a-4835-a0ae-32382d04d958', 'created_at': datetime.datetime(2026, 9, 4, 16, 2, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 16, 2, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eea085de-0e7a-4835-a0ae-32382d04d958/file', 'properties': {}}, 'image_service': }' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:02:43 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-85a7498f-0328-4699-8279-f474ec5fa170 tempest-TestInstancesWithCinderVolumes-750005214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c04a7fed-753b-4d68-9822-0122a772b705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:02:43 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-85a7498f-0328-4699-8279-f474ec5fa170 tempest-TestInstancesWithCinderVolumes-750005214 None] Volume volume-d144b76d-2a1f-46fc-81ff-153170e27448 (d144b76d-2a1f-46fc-81ff-153170e27448): created successfully Sep 04 18:02:43 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-85a7498f-0328-4699-8279-f474ec5fa170 tempest-TestInstancesWithCinderVolumes-750005214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c04a7fed-753b-4d68-9822-0122a772b705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:02:43 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-85a7498f-0328-4699-8279-f474ec5fa170 tempest-TestInstancesWithCinderVolumes-750005214 None] Flow 'volume_create_manager' (d7a3e3ae-ae3e-43ec-9571-2ba3c0767786) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:02:43 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-85a7498f-0328-4699-8279-f474ec5fa170 tempest-TestInstancesWithCinderVolumes-750005214 None] Created volume successfully. Sep 04 18:02:44 devstack sudo[101228]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8e006df0-93e3-4520-aac8-176f0a7b161d tempest-VolumesSnapshotListTestJSON-1629775123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.e35e713e-27e3-4b0b-8967-d19659cceec5" returned: 0 in 0.254s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8e006df0-93e3-4520-aac8-176f0a7b161d tempest-VolumesSnapshotListTestJSON-1629775123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.557s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:02:44 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-8e006df0-93e3-4520-aac8-176f0a7b161d tempest-VolumesSnapshotListTestJSON-1629775123 None] Create snapshot completed successfully Sep 04 18:02:45 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-432cc965-f079-4b50-830f-fbcd5d34cba1 tempest-VolumesSnapshotListTestJSON-1629775123 None] Acquiring lock "cinder-e35e713e-27e3-4b0b-8967-d19659cceec5-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:02:45 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-432cc965-f079-4b50-830f-fbcd5d34cba1 tempest-VolumesSnapshotListTestJSON-1629775123 None] Lock "cinder-e35e713e-27e3-4b0b-8967-d19659cceec5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:02:45 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-432cc965-f079-4b50-830f-fbcd5d34cba1 tempest-VolumesSnapshotListTestJSON-1629775123 None] Acquiring lock "cinder-quobyte-b28871c0-9599-4865-ba2c-62286b233fba" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:02:45 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-432cc965-f079-4b50-830f-fbcd5d34cba1 tempest-VolumesSnapshotListTestJSON-1629775123 None] Lock "cinder-quobyte-b28871c0-9599-4865-ba2c-62286b233fba" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:02:45 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-432cc965-f079-4b50-830f-fbcd5d34cba1 tempest-VolumesSnapshotListTestJSON-1629775123 None] Acquiring lock "cinder-quobyte-e35e713e-27e3-4b0b-8967-d19659cceec5" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:02:45 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-432cc965-f079-4b50-830f-fbcd5d34cba1 tempest-VolumesSnapshotListTestJSON-1629775123 None] Lock "cinder-quobyte-e35e713e-27e3-4b0b-8967-d19659cceec5" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:02:45 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-432cc965-f079-4b50-830f-fbcd5d34cba1 tempest-VolumesSnapshotListTestJSON-1629775123 None] Deleting offline snapshot e35e713e-27e3-4b0b-8967-d19659cceec5 of volume b28871c0-9599-4865-ba2c-62286b233fba {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 18:02:45 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-432cc965-f079-4b50-830f-fbcd5d34cba1 tempest-VolumesSnapshotListTestJSON-1629775123 None] snapshot_file for this snap is: volume-b28871c0-9599-4865-ba2c-62286b233fba.e35e713e-27e3-4b0b-8967-d19659cceec5 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 18:02:45 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[4566ebc3-161c-427f-9974-8aed91eaf9d1]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:02:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-432cc965-f079-4b50-830f-fbcd5d34cba1 tempest-VolumesSnapshotListTestJSON-1629775123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.e35e713e-27e3-4b0b-8967-d19659cceec5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:45 devstack sudo[101268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.e35e713e-27e3-4b0b-8967-d19659cceec5 Sep 04 18:02:45 devstack sudo[101268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:46 devstack sudo[101268]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-432cc965-f079-4b50-830f-fbcd5d34cba1 tempest-VolumesSnapshotListTestJSON-1629775123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.e35e713e-27e3-4b0b-8967-d19659cceec5" returned: 0 in 0.409s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:46 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-432cc965-f079-4b50-830f-fbcd5d34cba1 tempest-VolumesSnapshotListTestJSON-1629775123 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b28871c0-9599-4865-ba2c-62286b233fba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 18:02:46 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8496649-c092-42d3-9992-4e7b27e6ac3e]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:02:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-432cc965-f079-4b50-830f-fbcd5d34cba1 tempest-VolumesSnapshotListTestJSON-1629775123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.6ff1fe94-8ca5-4707-8833-52d4507dcacd {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:46 devstack sudo[101275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.6ff1fe94-8ca5-4707-8833-52d4507dcacd Sep 04 18:02:46 devstack sudo[101275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:46 devstack sudo[101275]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-432cc965-f079-4b50-830f-fbcd5d34cba1 tempest-VolumesSnapshotListTestJSON-1629775123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.6ff1fe94-8ca5-4707-8833-52d4507dcacd" returned: 0 in 0.415s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:46 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-432cc965-f079-4b50-830f-fbcd5d34cba1 tempest-VolumesSnapshotListTestJSON-1629775123 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b28871c0-9599-4865-ba2c-62286b233fba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 18:02:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-432cc965-f079-4b50-830f-fbcd5d34cba1 tempest-VolumesSnapshotListTestJSON-1629775123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.e35e713e-27e3-4b0b-8967-d19659cceec5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:46 devstack sudo[101289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.e35e713e-27e3-4b0b-8967-d19659cceec5 Sep 04 18:02:46 devstack sudo[101289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-4a31c514-03c2-4af5-acbe-faecd3d0d9bb req-79f9940d-1183-47ca-8c44-a7b9051b6a0f tempest-TestInstancesWithCinderVolumes-750005214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:02:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-4a31c514-03c2-4af5-acbe-faecd3d0d9bb req-79f9940d-1183-47ca-8c44-a7b9051b6a0f tempest-TestInstancesWithCinderVolumes-750005214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:02:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-4a31c514-03c2-4af5-acbe-faecd3d0d9bb req-79f9940d-1183-47ca-8c44-a7b9051b6a0f tempest-TestInstancesWithCinderVolumes-750005214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:02:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-4a31c514-03c2-4af5-acbe-faecd3d0d9bb req-79f9940d-1183-47ca-8c44-a7b9051b6a0f tempest-TestInstancesWithCinderVolumes-750005214 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a', 'name': 'volume-d144b76d-2a1f-46fc-81ff-153170e27448', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8af81807-c7c8-47a6-af3f-d4e9bbd58c0d', 'enforce_multipath': True} {{(pid=87314) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 18:02:46 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-4a31c514-03c2-4af5-acbe-faecd3d0d9bb req-79f9940d-1183-47ca-8c44-a7b9051b6a0f tempest-TestInstancesWithCinderVolumes-750005214 None] attachment_update completed successfully. Sep 04 18:02:47 devstack sudo[101289]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-432cc965-f079-4b50-830f-fbcd5d34cba1 tempest-VolumesSnapshotListTestJSON-1629775123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.e35e713e-27e3-4b0b-8967-d19659cceec5" returned: 0 in 0.611s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-432cc965-f079-4b50-830f-fbcd5d34cba1 tempest-VolumesSnapshotListTestJSON-1629775123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.e35e713e-27e3-4b0b-8967-d19659cceec5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:47 devstack sudo[101296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.e35e713e-27e3-4b0b-8967-d19659cceec5 Sep 04 18:02:47 devstack sudo[101296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:47 devstack sudo[101296]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-432cc965-f079-4b50-830f-fbcd5d34cba1 tempest-VolumesSnapshotListTestJSON-1629775123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.e35e713e-27e3-4b0b-8967-d19659cceec5" returned: 0 in 0.250s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:47 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-432cc965-f079-4b50-830f-fbcd5d34cba1 tempest-VolumesSnapshotListTestJSON-1629775123 None] Lock "cinder-quobyte-e35e713e-27e3-4b0b-8967-d19659cceec5" released by "_delete_snapshot" :: held 1.824s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:02:47 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-432cc965-f079-4b50-830f-fbcd5d34cba1 tempest-VolumesSnapshotListTestJSON-1629775123 None] Lock "cinder-quobyte-b28871c0-9599-4865-ba2c-62286b233fba" released by "delete_snapshot" :: held 1.863s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:02:47 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-432cc965-f079-4b50-830f-fbcd5d34cba1 tempest-VolumesSnapshotListTestJSON-1629775123 None] Created reservations ['41af1042-0139-4bff-a148-33c6b22528cc', 'eb7241a2-074a-4371-bbf7-996ceb746cd3', 'cde3d235-40b7-48ee-a6d3-3772a5485bb5', 'c07fbef4-f74f-4981-b682-5ef5cf05c31d'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:02:47 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-432cc965-f079-4b50-830f-fbcd5d34cba1 tempest-VolumesSnapshotListTestJSON-1629775123 None] Delete snapshot completed successfully. Sep 04 18:02:47 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-432cc965-f079-4b50-830f-fbcd5d34cba1 tempest-VolumesSnapshotListTestJSON-1629775123 None] Lock "cinder-e35e713e-27e3-4b0b-8967-d19659cceec5-delete_snapshot" released by "delete_snapshot" :: held 2.039s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:02:47 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-201751ce-7622-469f-bc05-0d1ca0dd9465 tempest-VolumesSnapshotListTestJSON-1629775123 None] Acquiring lock "cinder-6ff1fe94-8ca5-4707-8833-52d4507dcacd-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:02:47 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-201751ce-7622-469f-bc05-0d1ca0dd9465 tempest-VolumesSnapshotListTestJSON-1629775123 None] Lock "cinder-6ff1fe94-8ca5-4707-8833-52d4507dcacd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:02:47 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-201751ce-7622-469f-bc05-0d1ca0dd9465 tempest-VolumesSnapshotListTestJSON-1629775123 None] Acquiring lock "cinder-quobyte-b28871c0-9599-4865-ba2c-62286b233fba" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:02:47 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-201751ce-7622-469f-bc05-0d1ca0dd9465 tempest-VolumesSnapshotListTestJSON-1629775123 None] Lock "cinder-quobyte-b28871c0-9599-4865-ba2c-62286b233fba" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:02:47 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-201751ce-7622-469f-bc05-0d1ca0dd9465 tempest-VolumesSnapshotListTestJSON-1629775123 None] Acquiring lock "cinder-quobyte-6ff1fe94-8ca5-4707-8833-52d4507dcacd" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:02:47 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-201751ce-7622-469f-bc05-0d1ca0dd9465 tempest-VolumesSnapshotListTestJSON-1629775123 None] Lock "cinder-quobyte-6ff1fe94-8ca5-4707-8833-52d4507dcacd" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:02:47 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-201751ce-7622-469f-bc05-0d1ca0dd9465 tempest-VolumesSnapshotListTestJSON-1629775123 None] Deleting offline snapshot 6ff1fe94-8ca5-4707-8833-52d4507dcacd of volume b28871c0-9599-4865-ba2c-62286b233fba {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 18:02:47 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-201751ce-7622-469f-bc05-0d1ca0dd9465 tempest-VolumesSnapshotListTestJSON-1629775123 None] snapshot_file for this snap is: volume-b28871c0-9599-4865-ba2c-62286b233fba.6ff1fe94-8ca5-4707-8833-52d4507dcacd {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 18:02:47 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[7869ed78-e997-4b79-a27a-d909e239458a]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:02:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-201751ce-7622-469f-bc05-0d1ca0dd9465 tempest-VolumesSnapshotListTestJSON-1629775123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.6ff1fe94-8ca5-4707-8833-52d4507dcacd {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:47 devstack sudo[101299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.6ff1fe94-8ca5-4707-8833-52d4507dcacd Sep 04 18:02:47 devstack sudo[101299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:48 devstack sudo[101299]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-201751ce-7622-469f-bc05-0d1ca0dd9465 tempest-VolumesSnapshotListTestJSON-1629775123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.6ff1fe94-8ca5-4707-8833-52d4507dcacd" returned: 0 in 0.375s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:48 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-201751ce-7622-469f-bc05-0d1ca0dd9465 tempest-VolumesSnapshotListTestJSON-1629775123 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b28871c0-9599-4865-ba2c-62286b233fba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 18:02:48 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4ad373-2443-43d0-8373-f83302cb72e6]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:02:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-201751ce-7622-469f-bc05-0d1ca0dd9465 tempest-VolumesSnapshotListTestJSON-1629775123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.6b164e91-4581-4179-b6cb-a1fc82dc09bc {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:48 devstack sudo[101304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.6b164e91-4581-4179-b6cb-a1fc82dc09bc Sep 04 18:02:48 devstack sudo[101304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:48 devstack sudo[101304]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-201751ce-7622-469f-bc05-0d1ca0dd9465 tempest-VolumesSnapshotListTestJSON-1629775123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.6b164e91-4581-4179-b6cb-a1fc82dc09bc" returned: 0 in 0.370s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:48 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-201751ce-7622-469f-bc05-0d1ca0dd9465 tempest-VolumesSnapshotListTestJSON-1629775123 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b28871c0-9599-4865-ba2c-62286b233fba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 18:02:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-201751ce-7622-469f-bc05-0d1ca0dd9465 tempest-VolumesSnapshotListTestJSON-1629775123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.6ff1fe94-8ca5-4707-8833-52d4507dcacd {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:48 devstack sudo[101310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.6ff1fe94-8ca5-4707-8833-52d4507dcacd Sep 04 18:02:48 devstack sudo[101310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-201751ce-7622-469f-bc05-0d1ca0dd9465 tempest-VolumesSnapshotListTestJSON-1629775123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.6ff1fe94-8ca5-4707-8833-52d4507dcacd" returned: 0 in 0.499s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-201751ce-7622-469f-bc05-0d1ca0dd9465 tempest-VolumesSnapshotListTestJSON-1629775123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.6ff1fe94-8ca5-4707-8833-52d4507dcacd {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:49 devstack sudo[101310]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:49 devstack sudo[101385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.6ff1fe94-8ca5-4707-8833-52d4507dcacd Sep 04 18:02:49 devstack sudo[101385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:49 devstack sudo[101385]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-201751ce-7622-469f-bc05-0d1ca0dd9465 tempest-VolumesSnapshotListTestJSON-1629775123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.6ff1fe94-8ca5-4707-8833-52d4507dcacd" returned: 0 in 0.370s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-201751ce-7622-469f-bc05-0d1ca0dd9465 tempest-VolumesSnapshotListTestJSON-1629775123 None] Lock "cinder-quobyte-6ff1fe94-8ca5-4707-8833-52d4507dcacd" released by "_delete_snapshot" :: held 1.746s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:02:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-201751ce-7622-469f-bc05-0d1ca0dd9465 tempest-VolumesSnapshotListTestJSON-1629775123 None] Lock "cinder-quobyte-b28871c0-9599-4865-ba2c-62286b233fba" released by "delete_snapshot" :: held 1.770s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:02:49 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-201751ce-7622-469f-bc05-0d1ca0dd9465 tempest-VolumesSnapshotListTestJSON-1629775123 None] Created reservations ['e29d1fc4-7283-43d2-b5a2-f1ec21e5e77d', 'b880e9f5-e1ee-4882-a9e3-89f460a75d61', '8e8faf5a-1386-439e-8044-e7607a0e7ccb', 'a3bba0bd-c96d-4d7c-9724-2af9a3667a57'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:02:49 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-201751ce-7622-469f-bc05-0d1ca0dd9465 tempest-VolumesSnapshotListTestJSON-1629775123 None] Delete snapshot completed successfully. Sep 04 18:02:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-201751ce-7622-469f-bc05-0d1ca0dd9465 tempest-VolumesSnapshotListTestJSON-1629775123 None] Lock "cinder-6ff1fe94-8ca5-4707-8833-52d4507dcacd-delete_snapshot" released by "delete_snapshot" :: held 2.007s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:02:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f705532e-a838-4a21-8ccc-33e0540163bf tempest-VolumesSnapshotListTestJSON-1629775123 None] Acquiring lock "cinder-6b164e91-4581-4179-b6cb-a1fc82dc09bc-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:02:50 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f705532e-a838-4a21-8ccc-33e0540163bf tempest-VolumesSnapshotListTestJSON-1629775123 None] Lock "cinder-6b164e91-4581-4179-b6cb-a1fc82dc09bc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:02:50 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f705532e-a838-4a21-8ccc-33e0540163bf tempest-VolumesSnapshotListTestJSON-1629775123 None] Acquiring lock "cinder-quobyte-b28871c0-9599-4865-ba2c-62286b233fba" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:02:50 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f705532e-a838-4a21-8ccc-33e0540163bf tempest-VolumesSnapshotListTestJSON-1629775123 None] Lock "cinder-quobyte-b28871c0-9599-4865-ba2c-62286b233fba" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:02:50 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f705532e-a838-4a21-8ccc-33e0540163bf tempest-VolumesSnapshotListTestJSON-1629775123 None] Acquiring lock "cinder-quobyte-6b164e91-4581-4179-b6cb-a1fc82dc09bc" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:02:50 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f705532e-a838-4a21-8ccc-33e0540163bf tempest-VolumesSnapshotListTestJSON-1629775123 None] Lock "cinder-quobyte-6b164e91-4581-4179-b6cb-a1fc82dc09bc" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:02:50 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-f705532e-a838-4a21-8ccc-33e0540163bf tempest-VolumesSnapshotListTestJSON-1629775123 None] Deleting offline snapshot 6b164e91-4581-4179-b6cb-a1fc82dc09bc of volume b28871c0-9599-4865-ba2c-62286b233fba {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 18:02:50 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-f705532e-a838-4a21-8ccc-33e0540163bf tempest-VolumesSnapshotListTestJSON-1629775123 None] snapshot_file for this snap is: volume-b28871c0-9599-4865-ba2c-62286b233fba.6b164e91-4581-4179-b6cb-a1fc82dc09bc {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 18:02:50 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1968848-95fd-45cb-8671-d92ffc302f52]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:02:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f705532e-a838-4a21-8ccc-33e0540163bf tempest-VolumesSnapshotListTestJSON-1629775123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.6b164e91-4581-4179-b6cb-a1fc82dc09bc {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:50 devstack sudo[101761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.6b164e91-4581-4179-b6cb-a1fc82dc09bc Sep 04 18:02:50 devstack sudo[101761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:50 devstack sudo[101761]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f705532e-a838-4a21-8ccc-33e0540163bf tempest-VolumesSnapshotListTestJSON-1629775123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.6b164e91-4581-4179-b6cb-a1fc82dc09bc" returned: 0 in 0.387s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:50 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-f705532e-a838-4a21-8ccc-33e0540163bf tempest-VolumesSnapshotListTestJSON-1629775123 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b28871c0-9599-4865-ba2c-62286b233fba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 18:02:50 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c6b3de-d5ef-4511-b077-801700820150]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:02:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f705532e-a838-4a21-8ccc-33e0540163bf tempest-VolumesSnapshotListTestJSON-1629775123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:50 devstack sudo[101768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba Sep 04 18:02:50 devstack sudo[101768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:50 devstack sudo[101768]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f705532e-a838-4a21-8ccc-33e0540163bf tempest-VolumesSnapshotListTestJSON-1629775123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba" returned: 0 in 0.437s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f705532e-a838-4a21-8ccc-33e0540163bf tempest-VolumesSnapshotListTestJSON-1629775123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.6b164e91-4581-4179-b6cb-a1fc82dc09bc {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:51 devstack sudo[101775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.6b164e91-4581-4179-b6cb-a1fc82dc09bc Sep 04 18:02:51 devstack sudo[101775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:51 devstack sudo[101775]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f705532e-a838-4a21-8ccc-33e0540163bf tempest-VolumesSnapshotListTestJSON-1629775123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.6b164e91-4581-4179-b6cb-a1fc82dc09bc" returned: 0 in 0.371s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f705532e-a838-4a21-8ccc-33e0540163bf tempest-VolumesSnapshotListTestJSON-1629775123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.6b164e91-4581-4179-b6cb-a1fc82dc09bc {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:51 devstack sudo[101780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.6b164e91-4581-4179-b6cb-a1fc82dc09bc Sep 04 18:02:51 devstack sudo[101780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:51 devstack sudo[101780]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f705532e-a838-4a21-8ccc-33e0540163bf tempest-VolumesSnapshotListTestJSON-1629775123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba.6b164e91-4581-4179-b6cb-a1fc82dc09bc" returned: 0 in 0.265s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:51 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f705532e-a838-4a21-8ccc-33e0540163bf tempest-VolumesSnapshotListTestJSON-1629775123 None] Lock "cinder-quobyte-6b164e91-4581-4179-b6cb-a1fc82dc09bc" released by "_delete_snapshot" :: held 1.642s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:02:51 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f705532e-a838-4a21-8ccc-33e0540163bf tempest-VolumesSnapshotListTestJSON-1629775123 None] Lock "cinder-quobyte-b28871c0-9599-4865-ba2c-62286b233fba" released by "delete_snapshot" :: held 1.684s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:02:51 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-f705532e-a838-4a21-8ccc-33e0540163bf tempest-VolumesSnapshotListTestJSON-1629775123 None] Created reservations ['33fb8301-d21d-43f1-ab6f-f5f9d9cb1e2c', '246f3057-ec32-4308-b3b0-ea657506bc81', '2b07c2a7-3947-4979-85ca-a9efa5b8c21d', 'aa925bc1-5d81-4f0a-97c1-9badb610ebe6'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:02:51 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-f705532e-a838-4a21-8ccc-33e0540163bf tempest-VolumesSnapshotListTestJSON-1629775123 None] Delete snapshot completed successfully. Sep 04 18:02:51 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f705532e-a838-4a21-8ccc-33e0540163bf tempest-VolumesSnapshotListTestJSON-1629775123 None] Lock "cinder-6b164e91-4581-4179-b6cb-a1fc82dc09bc-delete_snapshot" released by "delete_snapshot" :: held 1.931s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:02:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-36a843be-45a6-4214-966f-8ea5d6d335c1 tempest-VolumesSnapshotListTestJSON-1629775123 None] Acquiring lock "cinder-b28871c0-9599-4865-ba2c-62286b233fba-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:02:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-36a843be-45a6-4214-966f-8ea5d6d335c1 tempest-VolumesSnapshotListTestJSON-1629775123 None] Lock "cinder-b28871c0-9599-4865-ba2c-62286b233fba-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:02:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-36a843be-45a6-4214-966f-8ea5d6d335c1 tempest-VolumesSnapshotListTestJSON-1629775123 None] Acquiring lock "cinder-quobyte-b28871c0-9599-4865-ba2c-62286b233fba" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:02:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-36a843be-45a6-4214-966f-8ea5d6d335c1 tempest-VolumesSnapshotListTestJSON-1629775123 None] Lock "cinder-quobyte-b28871c0-9599-4865-ba2c-62286b233fba" acquired by "delete_volume" :: waited 0.023s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:02:52 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[35bda2d7-a179-4a66-8aca-c1589eda7715]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:02:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-36a843be-45a6-4214-966f-8ea5d6d335c1 tempest-VolumesSnapshotListTestJSON-1629775123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:52 devstack sudo[101783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba Sep 04 18:02:52 devstack sudo[101783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:52 devstack sudo[101783]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-36a843be-45a6-4214-966f-8ea5d6d335c1 tempest-VolumesSnapshotListTestJSON-1629775123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba" returned: 0 in 0.434s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-36a843be-45a6-4214-966f-8ea5d6d335c1 tempest-VolumesSnapshotListTestJSON-1629775123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:52 devstack sudo[101788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba Sep 04 18:02:52 devstack sudo[101788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:53 devstack sudo[101788]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-36a843be-45a6-4214-966f-8ea5d6d335c1 tempest-VolumesSnapshotListTestJSON-1629775123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b28871c0-9599-4865-ba2c-62286b233fba" returned: 0 in 0.274s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:53 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-36a843be-45a6-4214-966f-8ea5d6d335c1 tempest-VolumesSnapshotListTestJSON-1629775123 None] Lock "cinder-quobyte-b28871c0-9599-4865-ba2c-62286b233fba" released by "delete_volume" :: held 0.782s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:02:53 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-36a843be-45a6-4214-966f-8ea5d6d335c1 tempest-VolumesSnapshotListTestJSON-1629775123 None] Created reservations ['346cd28b-40df-49b1-b236-6eedf7ba41d3', '7215536c-e56e-4283-a3a1-94fb6eb45438', 'bc4f3d01-ba4d-47bd-87a3-fce0270d782a', '625d812e-7232-4bb5-a170-bdccec23602f'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:02:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-36a843be-45a6-4214-966f-8ea5d6d335c1 tempest-VolumesSnapshotListTestJSON-1629775123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:02:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-36a843be-45a6-4214-966f-8ea5d6d335c1 tempest-VolumesSnapshotListTestJSON-1629775123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:02:53 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-36a843be-45a6-4214-966f-8ea5d6d335c1 tempest-VolumesSnapshotListTestJSON-1629775123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:02:53 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-36a843be-45a6-4214-966f-8ea5d6d335c1 tempest-VolumesSnapshotListTestJSON-1629775123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:02:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-36a843be-45a6-4214-966f-8ea5d6d335c1 tempest-VolumesSnapshotListTestJSON-1629775123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:02:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-36a843be-45a6-4214-966f-8ea5d6d335c1 tempest-VolumesSnapshotListTestJSON-1629775123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:53 devstack sudo[101791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:02:53 devstack sudo[101791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:53 devstack sudo[101791]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-36a843be-45a6-4214-966f-8ea5d6d335c1 tempest-VolumesSnapshotListTestJSON-1629775123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.321s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:53 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-36a843be-45a6-4214-966f-8ea5d6d335c1 tempest-VolumesSnapshotListTestJSON-1629775123 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:02:53 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-36a843be-45a6-4214-966f-8ea5d6d335c1 tempest-VolumesSnapshotListTestJSON-1629775123 None] Deleted volume successfully. Sep 04 18:02:53 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-36a843be-45a6-4214-966f-8ea5d6d335c1 tempest-VolumesSnapshotListTestJSON-1629775123 None] Lock "cinder-b28871c0-9599-4865-ba2c-62286b233fba-delete_volume" released by "delete_volume" :: held 1.393s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:02:57 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-e878701b-9e48-4c40-8ca4-80564eb12830 tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:02:57 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e878701b-9e48-4c40-8ca4-80564eb12830 tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Flow 'volume_create_manager' (c5716e13-4e13-4c7a-976e-c81a0470aa58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:02:57 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e878701b-9e48-4c40-8ca4-80564eb12830 tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60f19056-6f7e-46a4-a7cf-9079773e61c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:02:57 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e878701b-9e48-4c40-8ca4-80564eb12830 tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60f19056-6f7e-46a4-a7cf-9079773e61c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:02:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1219017654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b99a920-8d4e-4388-a9f7-7e0c20585066,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bf6baaaec2c421dab03e1003c60e6f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:02:57Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:02:57Z,use_quota=True,user_id='16bebdd9c00842e289098b530613088e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:02:57 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e878701b-9e48-4c40-8ca4-80564eb12830 tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2ba8e57-3233-4157-9e18-90a51cc9a6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:02:57 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e878701b-9e48-4c40-8ca4-80564eb12830 tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2ba8e57-3233-4157-9e18-90a51cc9a6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:02:57 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e878701b-9e48-4c40-8ca4-80564eb12830 tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9873e7a3-fd92-478d-8d01-99845c7a6e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:02:57 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e878701b-9e48-4c40-8ca4-80564eb12830 tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9873e7a3-fd92-478d-8d01-99845c7a6e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b99a920-8d4e-4388-a9f7-7e0c20585066', 'volume_name': 'volume-6b99a920-8d4e-4388-a9f7-7e0c20585066', 'volume_size': 2}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:02:57 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e878701b-9e48-4c40-8ca4-80564eb12830 tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de6699f6-f3d5-4075-b67f-5d79043f8366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:02:57 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e878701b-9e48-4c40-8ca4-80564eb12830 tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de6699f6-f3d5-4075-b67f-5d79043f8366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:02:57 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e878701b-9e48-4c40-8ca4-80564eb12830 tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71310925-a13d-4f2e-8a0f-7e9f7b28b32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:02:57 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-e878701b-9e48-4c40-8ca4-80564eb12830 tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Volume 6b99a920-8d4e-4388-a9f7-7e0c20585066: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b99a920-8d4e-4388-a9f7-7e0c20585066', 'volume_size': 2} Sep 04 18:02:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e878701b-9e48-4c40-8ca4-80564eb12830 tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:02:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e878701b-9e48-4c40-8ca4-80564eb12830 tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:02:57 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e878701b-9e48-4c40-8ca4-80564eb12830 tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:02:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1219017654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b99a920-8d4e-4388-a9f7-7e0c20585066,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bf6baaaec2c421dab03e1003c60e6f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:02:57Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:02:57Z,use_quota=True,user_id='16bebdd9c00842e289098b530613088e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:02:57 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-e878701b-9e48-4c40-8ca4-80564eb12830 tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Creating volume 6b99a920-8d4e-4388-a9f7-7e0c20585066 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:02:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e878701b-9e48-4c40-8ca4-80564eb12830 tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:02:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e878701b-9e48-4c40-8ca4-80564eb12830 tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:02:57 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e878701b-9e48-4c40-8ca4-80564eb12830 tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:02:57 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e878701b-9e48-4c40-8ca4-80564eb12830 tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:02:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e878701b-9e48-4c40-8ca4-80564eb12830 tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:02:57 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e878701b-9e48-4c40-8ca4-80564eb12830 tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:02:57 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-e878701b-9e48-4c40-8ca4-80564eb12830 tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:02:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e878701b-9e48-4c40-8ca4-80564eb12830 tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6b99a920-8d4e-4388-a9f7-7e0c20585066 2147483648 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:57 devstack sudo[101797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6b99a920-8d4e-4388-a9f7-7e0c20585066 2147483648 Sep 04 18:02:57 devstack sudo[101797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:57 devstack sudo[101797]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e878701b-9e48-4c40-8ca4-80564eb12830 tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6b99a920-8d4e-4388-a9f7-7e0c20585066 2147483648" returned: 0 in 0.565s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e878701b-9e48-4c40-8ca4-80564eb12830 tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6b99a920-8d4e-4388-a9f7-7e0c20585066 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:58 devstack sudo[101803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6b99a920-8d4e-4388-a9f7-7e0c20585066 Sep 04 18:02:58 devstack sudo[101803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:58 devstack sudo[101803]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e878701b-9e48-4c40-8ca4-80564eb12830 tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6b99a920-8d4e-4388-a9f7-7e0c20585066" returned: 0 in 0.318s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e878701b-9e48-4c40-8ca4-80564eb12830 tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:02:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e878701b-9e48-4c40-8ca4-80564eb12830 tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:02:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e878701b-9e48-4c40-8ca4-80564eb12830 tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71310925-a13d-4f2e-8a0f-7e9f7b28b32c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b99a920-8d4e-4388-a9f7-7e0c20585066', 'volume_size': 2}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:02:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e878701b-9e48-4c40-8ca4-80564eb12830 tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25cc29c7-2048-4a76-a265-44e1a2596a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:02:58 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-e878701b-9e48-4c40-8ca4-80564eb12830 tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Volume volume-6b99a920-8d4e-4388-a9f7-7e0c20585066 (6b99a920-8d4e-4388-a9f7-7e0c20585066): created successfully Sep 04 18:02:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e878701b-9e48-4c40-8ca4-80564eb12830 tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25cc29c7-2048-4a76-a265-44e1a2596a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:02:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e878701b-9e48-4c40-8ca4-80564eb12830 tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Flow 'volume_create_manager' (c5716e13-4e13-4c7a-976e-c81a0470aa58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:02:58 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-e878701b-9e48-4c40-8ca4-80564eb12830 tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Created volume successfully. Sep 04 18:02:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-062c2614-a185-4082-bce7-9cf1744e92cd tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:02:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-062c2614-a185-4082-bce7-9cf1744e92cd tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:02:59 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-062c2614-a185-4082-bce7-9cf1744e92cd tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Creating offline snapshot be51482b-842e-4057-91c4-d8f419a16807 of volume 6b99a920-8d4e-4388-a9f7-7e0c20585066 {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 18:02:59 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb0bec2-b253-4942-a3d8-f3a61757c466]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:02:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-062c2614-a185-4082-bce7-9cf1744e92cd tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6b99a920-8d4e-4388-a9f7-7e0c20585066 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:59 devstack sudo[101807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6b99a920-8d4e-4388-a9f7-7e0c20585066 Sep 04 18:02:59 devstack sudo[101807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:02:59 devstack sudo[101807]: pam_unix(sudo:session): session closed for user root Sep 04 18:02:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-062c2614-a185-4082-bce7-9cf1744e92cd tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6b99a920-8d4e-4388-a9f7-7e0c20585066" returned: 0 in 0.351s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:02:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-062c2614-a185-4082-bce7-9cf1744e92cd tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6b99a920-8d4e-4388-a9f7-7e0c20585066,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6b99a920-8d4e-4388-a9f7-7e0c20585066.be51482b-842e-4057-91c4-d8f419a16807 2G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:02:59 devstack sudo[101812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6b99a920-8d4e-4388-a9f7-7e0c20585066,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6b99a920-8d4e-4388-a9f7-7e0c20585066.be51482b-842e-4057-91c4-d8f419a16807 2G Sep 04 18:02:59 devstack sudo[101812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:03:00 devstack sudo[101812]: pam_unix(sudo:session): session closed for user root Sep 04 18:03:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-062c2614-a185-4082-bce7-9cf1744e92cd tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6b99a920-8d4e-4388-a9f7-7e0c20585066,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6b99a920-8d4e-4388-a9f7-7e0c20585066.be51482b-842e-4057-91c4-d8f419a16807 2G" returned: 0 in 0.370s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:03:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-062c2614-a185-4082-bce7-9cf1744e92cd tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b99a920-8d4e-4388-a9f7-7e0c20585066 -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6b99a920-8d4e-4388-a9f7-7e0c20585066.be51482b-842e-4057-91c4-d8f419a16807 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:03:00 devstack sudo[101818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b99a920-8d4e-4388-a9f7-7e0c20585066 -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6b99a920-8d4e-4388-a9f7-7e0c20585066.be51482b-842e-4057-91c4-d8f419a16807 Sep 04 18:03:00 devstack sudo[101818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:03:00 devstack sudo[101818]: pam_unix(sudo:session): session closed for user root Sep 04 18:03:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-062c2614-a185-4082-bce7-9cf1744e92cd tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b99a920-8d4e-4388-a9f7-7e0c20585066 -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6b99a920-8d4e-4388-a9f7-7e0c20585066.be51482b-842e-4057-91c4-d8f419a16807" returned: 0 in 0.311s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:03:00 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-062c2614-a185-4082-bce7-9cf1744e92cd tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6b99a920-8d4e-4388-a9f7-7e0c20585066.be51482b-842e-4057-91c4-d8f419a16807 is being set with open permissions: ugo+rw Sep 04 18:03:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-062c2614-a185-4082-bce7-9cf1744e92cd tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6b99a920-8d4e-4388-a9f7-7e0c20585066.be51482b-842e-4057-91c4-d8f419a16807 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:03:00 devstack sudo[101829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6b99a920-8d4e-4388-a9f7-7e0c20585066.be51482b-842e-4057-91c4-d8f419a16807 Sep 04 18:03:00 devstack sudo[101829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:03:00 devstack sudo[101829]: pam_unix(sudo:session): session closed for user root Sep 04 18:03:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-062c2614-a185-4082-bce7-9cf1744e92cd tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6b99a920-8d4e-4388-a9f7-7e0c20585066.be51482b-842e-4057-91c4-d8f419a16807" returned: 0 in 0.235s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:03:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-062c2614-a185-4082-bce7-9cf1744e92cd tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6b99a920-8d4e-4388-a9f7-7e0c20585066.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:03:00 devstack sudo[101832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6b99a920-8d4e-4388-a9f7-7e0c20585066.info Sep 04 18:03:00 devstack sudo[101832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:03:01 devstack sudo[101832]: pam_unix(sudo:session): session closed for user root Sep 04 18:03:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-062c2614-a185-4082-bce7-9cf1744e92cd tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6b99a920-8d4e-4388-a9f7-7e0c20585066.info" returned: 0 in 0.237s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:03:01 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-062c2614-a185-4082-bce7-9cf1744e92cd tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6b99a920-8d4e-4388-a9f7-7e0c20585066.info is being set with open permissions: ugo+rw Sep 04 18:03:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-062c2614-a185-4082-bce7-9cf1744e92cd tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6b99a920-8d4e-4388-a9f7-7e0c20585066.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:03:01 devstack sudo[101835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6b99a920-8d4e-4388-a9f7-7e0c20585066.info Sep 04 18:03:01 devstack sudo[101835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:03:01 devstack sudo[101835]: pam_unix(sudo:session): session closed for user root Sep 04 18:03:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-062c2614-a185-4082-bce7-9cf1744e92cd tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6b99a920-8d4e-4388-a9f7-7e0c20585066.info" returned: 0 in 0.236s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:03:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-062c2614-a185-4082-bce7-9cf1744e92cd tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.829s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:03:01 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-062c2614-a185-4082-bce7-9cf1744e92cd tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Create snapshot completed successfully Sep 04 18:03:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f7b869ab-8822-410f-ad1c-335f35cf2819 tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Acquiring lock "cinder-be51482b-842e-4057-91c4-d8f419a16807-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:03:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f7b869ab-8822-410f-ad1c-335f35cf2819 tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Lock "cinder-be51482b-842e-4057-91c4-d8f419a16807-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:03:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f7b869ab-8822-410f-ad1c-335f35cf2819 tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Acquiring lock "cinder-quobyte-6b99a920-8d4e-4388-a9f7-7e0c20585066" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:03:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f7b869ab-8822-410f-ad1c-335f35cf2819 tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Lock "cinder-quobyte-6b99a920-8d4e-4388-a9f7-7e0c20585066" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:03:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f7b869ab-8822-410f-ad1c-335f35cf2819 tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Acquiring lock "cinder-quobyte-be51482b-842e-4057-91c4-d8f419a16807" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:03:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f7b869ab-8822-410f-ad1c-335f35cf2819 tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Lock "cinder-quobyte-be51482b-842e-4057-91c4-d8f419a16807" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:03:01 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-f7b869ab-8822-410f-ad1c-335f35cf2819 tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Deleting offline snapshot be51482b-842e-4057-91c4-d8f419a16807 of volume 6b99a920-8d4e-4388-a9f7-7e0c20585066 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 18:03:01 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-f7b869ab-8822-410f-ad1c-335f35cf2819 tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] snapshot_file for this snap is: volume-6b99a920-8d4e-4388-a9f7-7e0c20585066.be51482b-842e-4057-91c4-d8f419a16807 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 18:03:01 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[458eaf5b-dd64-4ded-ae37-a9d1c0b67b2d]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:03:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f7b869ab-8822-410f-ad1c-335f35cf2819 tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6b99a920-8d4e-4388-a9f7-7e0c20585066.be51482b-842e-4057-91c4-d8f419a16807 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:03:01 devstack sudo[101838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6b99a920-8d4e-4388-a9f7-7e0c20585066.be51482b-842e-4057-91c4-d8f419a16807 Sep 04 18:03:01 devstack sudo[101838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:03:02 devstack sudo[101838]: pam_unix(sudo:session): session closed for user root Sep 04 18:03:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f7b869ab-8822-410f-ad1c-335f35cf2819 tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6b99a920-8d4e-4388-a9f7-7e0c20585066.be51482b-842e-4057-91c4-d8f419a16807" returned: 0 in 0.357s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:03:02 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-f7b869ab-8822-410f-ad1c-335f35cf2819 tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b99a920-8d4e-4388-a9f7-7e0c20585066(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 18:03:02 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe037b7f-596e-4548-a82f-5c3d941f8207]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:03:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f7b869ab-8822-410f-ad1c-335f35cf2819 tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6b99a920-8d4e-4388-a9f7-7e0c20585066 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:03:02 devstack sudo[101843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6b99a920-8d4e-4388-a9f7-7e0c20585066 Sep 04 18:03:02 devstack sudo[101843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:03:02 devstack sudo[101843]: pam_unix(sudo:session): session closed for user root Sep 04 18:03:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f7b869ab-8822-410f-ad1c-335f35cf2819 tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6b99a920-8d4e-4388-a9f7-7e0c20585066" returned: 0 in 0.368s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:03:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f7b869ab-8822-410f-ad1c-335f35cf2819 tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6b99a920-8d4e-4388-a9f7-7e0c20585066.be51482b-842e-4057-91c4-d8f419a16807 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:03:02 devstack sudo[101849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6b99a920-8d4e-4388-a9f7-7e0c20585066.be51482b-842e-4057-91c4-d8f419a16807 Sep 04 18:03:02 devstack sudo[101849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:03:02 devstack sudo[101849]: pam_unix(sudo:session): session closed for user root Sep 04 18:03:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f7b869ab-8822-410f-ad1c-335f35cf2819 tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6b99a920-8d4e-4388-a9f7-7e0c20585066.be51482b-842e-4057-91c4-d8f419a16807" returned: 0 in 0.369s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:03:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f7b869ab-8822-410f-ad1c-335f35cf2819 tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6b99a920-8d4e-4388-a9f7-7e0c20585066.be51482b-842e-4057-91c4-d8f419a16807 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:03:03 devstack sudo[101857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6b99a920-8d4e-4388-a9f7-7e0c20585066.be51482b-842e-4057-91c4-d8f419a16807 Sep 04 18:03:03 devstack sudo[101857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:03:03 devstack sudo[101857]: pam_unix(sudo:session): session closed for user root Sep 04 18:03:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f7b869ab-8822-410f-ad1c-335f35cf2819 tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6b99a920-8d4e-4388-a9f7-7e0c20585066.be51482b-842e-4057-91c4-d8f419a16807" returned: 0 in 0.236s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:03:03 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f7b869ab-8822-410f-ad1c-335f35cf2819 tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Lock "cinder-quobyte-be51482b-842e-4057-91c4-d8f419a16807" released by "_delete_snapshot" :: held 1.426s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:03:03 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f7b869ab-8822-410f-ad1c-335f35cf2819 tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Lock "cinder-quobyte-6b99a920-8d4e-4388-a9f7-7e0c20585066" released by "delete_snapshot" :: held 1.457s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:03:03 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-f7b869ab-8822-410f-ad1c-335f35cf2819 tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Created reservations ['c9591f09-5954-41b4-abc8-3d768a5ca2df', '75f12998-3ac3-49da-91a2-ec9765bf2027', 'c37d44d0-9432-4986-867e-77c001bcc6fc', 'dc05eaf5-e1d3-4a7c-8152-ab9ca821a906'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:03:03 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-f7b869ab-8822-410f-ad1c-335f35cf2819 tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Delete snapshot completed successfully. Sep 04 18:03:03 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f7b869ab-8822-410f-ad1c-335f35cf2819 tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Lock "cinder-be51482b-842e-4057-91c4-d8f419a16807-delete_snapshot" released by "delete_snapshot" :: held 1.599s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:03:04 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5029619a-723f-4947-b41a-acac154018dd tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Acquiring lock "cinder-6b99a920-8d4e-4388-a9f7-7e0c20585066-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:03:04 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5029619a-723f-4947-b41a-acac154018dd tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Lock "cinder-6b99a920-8d4e-4388-a9f7-7e0c20585066-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:03:04 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5029619a-723f-4947-b41a-acac154018dd tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Acquiring lock "cinder-quobyte-6b99a920-8d4e-4388-a9f7-7e0c20585066" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:03:04 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5029619a-723f-4947-b41a-acac154018dd tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Lock "cinder-quobyte-6b99a920-8d4e-4388-a9f7-7e0c20585066" acquired by "delete_volume" :: waited 0.023s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:03:04 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf6852c-8c24-49a4-8de2-0c3bf85e8937]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:03:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5029619a-723f-4947-b41a-acac154018dd tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6b99a920-8d4e-4388-a9f7-7e0c20585066 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:03:04 devstack sudo[101861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6b99a920-8d4e-4388-a9f7-7e0c20585066 Sep 04 18:03:04 devstack sudo[101861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:03:04 devstack sudo[101861]: pam_unix(sudo:session): session closed for user root Sep 04 18:03:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5029619a-723f-4947-b41a-acac154018dd tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6b99a920-8d4e-4388-a9f7-7e0c20585066" returned: 0 in 0.382s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:03:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5029619a-723f-4947-b41a-acac154018dd tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6b99a920-8d4e-4388-a9f7-7e0c20585066 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:03:04 devstack sudo[101866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6b99a920-8d4e-4388-a9f7-7e0c20585066 Sep 04 18:03:04 devstack sudo[101866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:03:04 devstack sudo[101866]: pam_unix(sudo:session): session closed for user root Sep 04 18:03:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5029619a-723f-4947-b41a-acac154018dd tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6b99a920-8d4e-4388-a9f7-7e0c20585066" returned: 0 in 0.240s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:03:04 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5029619a-723f-4947-b41a-acac154018dd tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Lock "cinder-quobyte-6b99a920-8d4e-4388-a9f7-7e0c20585066" released by "delete_volume" :: held 0.684s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:03:04 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-5029619a-723f-4947-b41a-acac154018dd tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Created reservations ['a94b4196-94bb-4e30-9944-1f0b6cdf719b', 'dbdd9b9d-6a3f-4f1a-b7d4-7e2cdfa7ee07', '2e829e5a-a7ca-4843-81ac-b81dafffade9', '1a5f9118-4b58-4433-becf-f333e5e49880'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:03:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5029619a-723f-4947-b41a-acac154018dd tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:03:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5029619a-723f-4947-b41a-acac154018dd tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:03:04 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5029619a-723f-4947-b41a-acac154018dd tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:03:04 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5029619a-723f-4947-b41a-acac154018dd tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:03:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5029619a-723f-4947-b41a-acac154018dd tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:03:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5029619a-723f-4947-b41a-acac154018dd tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:03:04 devstack sudo[101869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:03:04 devstack sudo[101869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:03:05 devstack sudo[101869]: pam_unix(sudo:session): session closed for user root Sep 04 18:03:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5029619a-723f-4947-b41a-acac154018dd tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.261s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:03:05 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-5029619a-723f-4947-b41a-acac154018dd tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:03:05 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-5029619a-723f-4947-b41a-acac154018dd tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Deleted volume successfully. Sep 04 18:03:05 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5029619a-723f-4947-b41a-acac154018dd tempest-VolumesSnapshotNegativeTestJSON-1760528110 None] Lock "cinder-6b99a920-8d4e-4388-a9f7-7e0c20585066-delete_volume" released by "delete_volume" :: held 1.166s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:03:14 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=85,cinder:INSERT=22,cinder:UPDATE=87,cinder:DELETE=8 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 18:03:15 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=72,cinder:INSERT=30,cinder:UPDATE=78,cinder:DELETE=5 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 18:03:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-6c187146-5f8b-4f37-9e32-9b2d934ad22f req-bb7f3f24-f109-44f4-8e27-4d97486a7f13 tempest-TestInstancesWithCinderVolumes-750005214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:03:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-6c187146-5f8b-4f37-9e32-9b2d934ad22f req-bb7f3f24-f109-44f4-8e27-4d97486a7f13 tempest-TestInstancesWithCinderVolumes-750005214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:03:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-6c187146-5f8b-4f37-9e32-9b2d934ad22f req-bb7f3f24-f109-44f4-8e27-4d97486a7f13 tempest-TestInstancesWithCinderVolumes-750005214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:03:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-6c187146-5f8b-4f37-9e32-9b2d934ad22f req-bb7f3f24-f109-44f4-8e27-4d97486a7f13 tempest-TestInstancesWithCinderVolumes-750005214 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a', 'name': 'volume-9cdef629-a821-4289-ae6a-5873fa3f1c04', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a42f8cd6-8545-41ef-975d-69a4b67161c2', 'enforce_multipath': True} {{(pid=87314) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 18:03:19 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-6c187146-5f8b-4f37-9e32-9b2d934ad22f req-bb7f3f24-f109-44f4-8e27-4d97486a7f13 tempest-TestInstancesWithCinderVolumes-750005214 None] attachment_update completed successfully. Sep 04 18:03:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-a261fabe-479f-4b75-bc9b-7d30764f82d7 req-601644bc-e8e3-49c6-bb8e-7de73fe53752 tempest-TestInstancesWithCinderVolumes-750005214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:03:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-a261fabe-479f-4b75-bc9b-7d30764f82d7 req-601644bc-e8e3-49c6-bb8e-7de73fe53752 tempest-TestInstancesWithCinderVolumes-750005214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:03:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-a261fabe-479f-4b75-bc9b-7d30764f82d7 req-601644bc-e8e3-49c6-bb8e-7de73fe53752 tempest-TestInstancesWithCinderVolumes-750005214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:03:21 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 18:03:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:03:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:03:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:03:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:03:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:03:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:03:21 devstack sudo[101952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:03:21 devstack sudo[101952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:03:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-a261fabe-479f-4b75-bc9b-7d30764f82d7 req-601644bc-e8e3-49c6-bb8e-7de73fe53752 tempest-TestInstancesWithCinderVolumes-750005214 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a', 'name': 'volume-e84a8d40-0d9f-4c25-aede-024c8573e738', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b9ea5640-b82d-4afd-ac4b-d9d520dfb41c', 'enforce_multipath': True} {{(pid=87314) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 18:03:21 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-a261fabe-479f-4b75-bc9b-7d30764f82d7 req-601644bc-e8e3-49c6-bb8e-7de73fe53752 tempest-TestInstancesWithCinderVolumes-750005214 None] attachment_update completed successfully. Sep 04 18:03:21 devstack sudo[101952]: pam_unix(sudo:session): session closed for user root Sep 04 18:03:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.277s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:03:21 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:03:21 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running periodic task VolumeManager._thread_info {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 18:03:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] thread count: 28 {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 18:03:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] thread info: [<_MainThread(MainThread, started 139900377723008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 18:03:26 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-1acbf5a3-bbac-4f75-875e-164717bf5cdc req-46d9a897-0bfb-46bb-bb5d-7b800e414a93 tempest-TestInstancesWithCinderVolumes-750005214 None] Terminate volume connection completed successfully. Sep 04 18:03:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-1acbf5a3-bbac-4f75-875e-164717bf5cdc req-46d9a897-0bfb-46bb-bb5d-7b800e414a93 tempest-TestInstancesWithCinderVolumes-750005214 None] Deleting attachment a42f8cd6-8545-41ef-975d-69a4b67161c2. {{(pid=87314) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 18:03:27 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8b2e9ac2-8b14-49a1-a2d0-9de0d233eb59 tempest-TestInstancesWithCinderVolumes-750005214 None] Acquiring lock "cinder-9cdef629-a821-4289-ae6a-5873fa3f1c04-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:03:27 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8b2e9ac2-8b14-49a1-a2d0-9de0d233eb59 tempest-TestInstancesWithCinderVolumes-750005214 None] Lock "cinder-9cdef629-a821-4289-ae6a-5873fa3f1c04-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:03:27 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8b2e9ac2-8b14-49a1-a2d0-9de0d233eb59 tempest-TestInstancesWithCinderVolumes-750005214 None] Acquiring lock "cinder-quobyte-9cdef629-a821-4289-ae6a-5873fa3f1c04" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:03:27 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8b2e9ac2-8b14-49a1-a2d0-9de0d233eb59 tempest-TestInstancesWithCinderVolumes-750005214 None] Lock "cinder-quobyte-9cdef629-a821-4289-ae6a-5873fa3f1c04" acquired by "delete_volume" :: waited 0.020s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:03:27 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[a775d038-670b-4c49-bab0-4625d7263697]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:03:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8b2e9ac2-8b14-49a1-a2d0-9de0d233eb59 tempest-TestInstancesWithCinderVolumes-750005214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9cdef629-a821-4289-ae6a-5873fa3f1c04 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:03:27 devstack sudo[101995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9cdef629-a821-4289-ae6a-5873fa3f1c04 Sep 04 18:03:27 devstack sudo[101995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:03:27 devstack sudo[101995]: pam_unix(sudo:session): session closed for user root Sep 04 18:03:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8b2e9ac2-8b14-49a1-a2d0-9de0d233eb59 tempest-TestInstancesWithCinderVolumes-750005214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9cdef629-a821-4289-ae6a-5873fa3f1c04" returned: 0 in 0.496s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:03:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8b2e9ac2-8b14-49a1-a2d0-9de0d233eb59 tempest-TestInstancesWithCinderVolumes-750005214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9cdef629-a821-4289-ae6a-5873fa3f1c04 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:03:27 devstack sudo[102000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9cdef629-a821-4289-ae6a-5873fa3f1c04 Sep 04 18:03:27 devstack sudo[102000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:03:28 devstack sudo[102000]: pam_unix(sudo:session): session closed for user root Sep 04 18:03:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8b2e9ac2-8b14-49a1-a2d0-9de0d233eb59 tempest-TestInstancesWithCinderVolumes-750005214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9cdef629-a821-4289-ae6a-5873fa3f1c04" returned: 0 in 0.289s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:03:28 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8b2e9ac2-8b14-49a1-a2d0-9de0d233eb59 tempest-TestInstancesWithCinderVolumes-750005214 None] Lock "cinder-quobyte-9cdef629-a821-4289-ae6a-5873fa3f1c04" released by "delete_volume" :: held 0.853s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:03:28 devstack cinder-volume[87314]: WARNING cinder.quota [None req-8b2e9ac2-8b14-49a1-a2d0-9de0d233eb59 tempest-TestInstancesWithCinderVolumes-750005214 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-417935032-392586200 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-417935032-392586200, it is now deprecated. Please use the default quota class for default quota. Sep 04 18:03:28 devstack cinder-volume[87314]: WARNING cinder.quota [None req-8b2e9ac2-8b14-49a1-a2d0-9de0d233eb59 tempest-TestInstancesWithCinderVolumes-750005214 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-417935032-392586200 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-417935032-392586200, it is now deprecated. Please use the default quota class for default quota. Sep 04 18:03:28 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-8b2e9ac2-8b14-49a1-a2d0-9de0d233eb59 tempest-TestInstancesWithCinderVolumes-750005214 None] Created reservations ['88498cbb-67bc-4b68-a4ee-236be177de76', '9aad89b3-f83f-44c2-922c-6d99a9e56e93', 'd052cfd0-f890-43a0-bd72-f1ebad31d201', '5ed8578e-856d-43b5-b915-3dc5a8c7af2c'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:03:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8b2e9ac2-8b14-49a1-a2d0-9de0d233eb59 tempest-TestInstancesWithCinderVolumes-750005214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:03:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8b2e9ac2-8b14-49a1-a2d0-9de0d233eb59 tempest-TestInstancesWithCinderVolumes-750005214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:03:28 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8b2e9ac2-8b14-49a1-a2d0-9de0d233eb59 tempest-TestInstancesWithCinderVolumes-750005214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:03:28 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8b2e9ac2-8b14-49a1-a2d0-9de0d233eb59 tempest-TestInstancesWithCinderVolumes-750005214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:03:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8b2e9ac2-8b14-49a1-a2d0-9de0d233eb59 tempest-TestInstancesWithCinderVolumes-750005214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:03:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8b2e9ac2-8b14-49a1-a2d0-9de0d233eb59 tempest-TestInstancesWithCinderVolumes-750005214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:03:28 devstack sudo[102003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:03:28 devstack sudo[102003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:03:28 devstack sudo[102003]: pam_unix(sudo:session): session closed for user root Sep 04 18:03:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8b2e9ac2-8b14-49a1-a2d0-9de0d233eb59 tempest-TestInstancesWithCinderVolumes-750005214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.295s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:03:28 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-8b2e9ac2-8b14-49a1-a2d0-9de0d233eb59 tempest-TestInstancesWithCinderVolumes-750005214 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:03:28 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-8b2e9ac2-8b14-49a1-a2d0-9de0d233eb59 tempest-TestInstancesWithCinderVolumes-750005214 None] Deleted volume successfully. Sep 04 18:03:28 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8b2e9ac2-8b14-49a1-a2d0-9de0d233eb59 tempest-TestInstancesWithCinderVolumes-750005214 None] Lock "cinder-9cdef629-a821-4289-ae6a-5873fa3f1c04-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:03:31 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-49e8eccf-6ecb-405e-90a5-cc958024d96e req-c510dbb8-19c7-44c0-9334-ffc49ff8e4c6 tempest-TestInstancesWithCinderVolumes-750005214 None] Terminate volume connection completed successfully. Sep 04 18:03:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-49e8eccf-6ecb-405e-90a5-cc958024d96e req-c510dbb8-19c7-44c0-9334-ffc49ff8e4c6 tempest-TestInstancesWithCinderVolumes-750005214 None] Deleting attachment b9ea5640-b82d-4afd-ac4b-d9d520dfb41c. {{(pid=87314) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 18:03:32 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-13da2cde-71fb-4a8c-9b9d-b2b32f0bea94 tempest-TestInstancesWithCinderVolumes-750005214 None] Acquiring lock "cinder-e84a8d40-0d9f-4c25-aede-024c8573e738-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:03:32 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-13da2cde-71fb-4a8c-9b9d-b2b32f0bea94 tempest-TestInstancesWithCinderVolumes-750005214 None] Lock "cinder-e84a8d40-0d9f-4c25-aede-024c8573e738-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:03:32 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-13da2cde-71fb-4a8c-9b9d-b2b32f0bea94 tempest-TestInstancesWithCinderVolumes-750005214 None] Acquiring lock "cinder-quobyte-e84a8d40-0d9f-4c25-aede-024c8573e738" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:03:32 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-13da2cde-71fb-4a8c-9b9d-b2b32f0bea94 tempest-TestInstancesWithCinderVolumes-750005214 None] Lock "cinder-quobyte-e84a8d40-0d9f-4c25-aede-024c8573e738" acquired by "delete_volume" :: waited 0.028s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:03:32 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[84285730-ee98-47f3-9a09-ec0cd5567e49]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:03:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-13da2cde-71fb-4a8c-9b9d-b2b32f0bea94 tempest-TestInstancesWithCinderVolumes-750005214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-e84a8d40-0d9f-4c25-aede-024c8573e738 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:03:32 devstack sudo[102034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-e84a8d40-0d9f-4c25-aede-024c8573e738 Sep 04 18:03:32 devstack sudo[102034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:03:32 devstack sudo[102034]: pam_unix(sudo:session): session closed for user root Sep 04 18:03:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-13da2cde-71fb-4a8c-9b9d-b2b32f0bea94 tempest-TestInstancesWithCinderVolumes-750005214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-e84a8d40-0d9f-4c25-aede-024c8573e738" returned: 0 in 0.458s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:03:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-13da2cde-71fb-4a8c-9b9d-b2b32f0bea94 tempest-TestInstancesWithCinderVolumes-750005214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-e84a8d40-0d9f-4c25-aede-024c8573e738 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:03:32 devstack sudo[102049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-e84a8d40-0d9f-4c25-aede-024c8573e738 Sep 04 18:03:32 devstack sudo[102049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:03:33 devstack sudo[102049]: pam_unix(sudo:session): session closed for user root Sep 04 18:03:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-13da2cde-71fb-4a8c-9b9d-b2b32f0bea94 tempest-TestInstancesWithCinderVolumes-750005214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-e84a8d40-0d9f-4c25-aede-024c8573e738" returned: 0 in 0.315s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:03:33 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-13da2cde-71fb-4a8c-9b9d-b2b32f0bea94 tempest-TestInstancesWithCinderVolumes-750005214 None] Lock "cinder-quobyte-e84a8d40-0d9f-4c25-aede-024c8573e738" released by "delete_volume" :: held 0.822s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:03:33 devstack cinder-volume[87314]: WARNING cinder.quota [None req-13da2cde-71fb-4a8c-9b9d-b2b32f0bea94 tempest-TestInstancesWithCinderVolumes-750005214 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1316497203-1143179394 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1316497203-1143179394, it is now deprecated. Please use the default quota class for default quota. Sep 04 18:03:33 devstack cinder-volume[87314]: WARNING cinder.quota [None req-13da2cde-71fb-4a8c-9b9d-b2b32f0bea94 tempest-TestInstancesWithCinderVolumes-750005214 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1316497203-1143179394 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1316497203-1143179394, it is now deprecated. Please use the default quota class for default quota. Sep 04 18:03:33 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-13da2cde-71fb-4a8c-9b9d-b2b32f0bea94 tempest-TestInstancesWithCinderVolumes-750005214 None] Created reservations ['b14f3b0a-dad9-494d-8d6f-9e3639fd0e12', '4253b096-ad38-426d-b7d3-c076a7323f9a', '357ed571-22d6-4a9f-af88-177c7d6308d0', 'efe2bf26-2769-4ea7-9df9-cc4ac886e479'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:03:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-13da2cde-71fb-4a8c-9b9d-b2b32f0bea94 tempest-TestInstancesWithCinderVolumes-750005214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:03:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-13da2cde-71fb-4a8c-9b9d-b2b32f0bea94 tempest-TestInstancesWithCinderVolumes-750005214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:03:33 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-13da2cde-71fb-4a8c-9b9d-b2b32f0bea94 tempest-TestInstancesWithCinderVolumes-750005214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:03:33 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-13da2cde-71fb-4a8c-9b9d-b2b32f0bea94 tempest-TestInstancesWithCinderVolumes-750005214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:03:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-13da2cde-71fb-4a8c-9b9d-b2b32f0bea94 tempest-TestInstancesWithCinderVolumes-750005214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:03:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-13da2cde-71fb-4a8c-9b9d-b2b32f0bea94 tempest-TestInstancesWithCinderVolumes-750005214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:03:33 devstack sudo[102057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:03:33 devstack sudo[102057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:03:33 devstack sudo[102057]: pam_unix(sudo:session): session closed for user root Sep 04 18:03:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-13da2cde-71fb-4a8c-9b9d-b2b32f0bea94 tempest-TestInstancesWithCinderVolumes-750005214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.258s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:03:33 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-13da2cde-71fb-4a8c-9b9d-b2b32f0bea94 tempest-TestInstancesWithCinderVolumes-750005214 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:03:33 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-13da2cde-71fb-4a8c-9b9d-b2b32f0bea94 tempest-TestInstancesWithCinderVolumes-750005214 None] Deleted volume successfully. Sep 04 18:03:33 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-13da2cde-71fb-4a8c-9b9d-b2b32f0bea94 tempest-TestInstancesWithCinderVolumes-750005214 None] Lock "cinder-e84a8d40-0d9f-4c25-aede-024c8573e738-delete_volume" released by "delete_volume" :: held 1.350s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:03:37 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-31bb067b-e388-459e-9d80-c4641eb97651 req-82e97b56-401e-4c1e-b06a-8909f8fdf81b tempest-TestInstancesWithCinderVolumes-750005214 None] Terminate volume connection completed successfully. Sep 04 18:03:37 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-31bb067b-e388-459e-9d80-c4641eb97651 req-82e97b56-401e-4c1e-b06a-8909f8fdf81b tempest-TestInstancesWithCinderVolumes-750005214 None] Deleting attachment 8af81807-c7c8-47a6-af3f-d4e9bbd58c0d. {{(pid=87314) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 18:03:39 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c061e58d-d456-4883-b1dd-7227a2fdbcfd tempest-TestInstancesWithCinderVolumes-750005214 None] Acquiring lock "cinder-d144b76d-2a1f-46fc-81ff-153170e27448-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:03:39 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c061e58d-d456-4883-b1dd-7227a2fdbcfd tempest-TestInstancesWithCinderVolumes-750005214 None] Lock "cinder-d144b76d-2a1f-46fc-81ff-153170e27448-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:03:39 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c061e58d-d456-4883-b1dd-7227a2fdbcfd tempest-TestInstancesWithCinderVolumes-750005214 None] Acquiring lock "cinder-quobyte-d144b76d-2a1f-46fc-81ff-153170e27448" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:03:39 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c061e58d-d456-4883-b1dd-7227a2fdbcfd tempest-TestInstancesWithCinderVolumes-750005214 None] Lock "cinder-quobyte-d144b76d-2a1f-46fc-81ff-153170e27448" acquired by "delete_volume" :: waited 0.017s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:03:39 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b23153-0c30-49af-aeec-659cb536ec2c]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:03:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c061e58d-d456-4883-b1dd-7227a2fdbcfd tempest-TestInstancesWithCinderVolumes-750005214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d144b76d-2a1f-46fc-81ff-153170e27448 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:03:39 devstack sudo[102152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d144b76d-2a1f-46fc-81ff-153170e27448 Sep 04 18:03:39 devstack sudo[102152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:03:39 devstack sudo[102152]: pam_unix(sudo:session): session closed for user root Sep 04 18:03:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c061e58d-d456-4883-b1dd-7227a2fdbcfd tempest-TestInstancesWithCinderVolumes-750005214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d144b76d-2a1f-46fc-81ff-153170e27448" returned: 0 in 0.435s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:03:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c061e58d-d456-4883-b1dd-7227a2fdbcfd tempest-TestInstancesWithCinderVolumes-750005214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d144b76d-2a1f-46fc-81ff-153170e27448 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:03:39 devstack sudo[102158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d144b76d-2a1f-46fc-81ff-153170e27448 Sep 04 18:03:39 devstack sudo[102158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:03:39 devstack sudo[102158]: pam_unix(sudo:session): session closed for user root Sep 04 18:03:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c061e58d-d456-4883-b1dd-7227a2fdbcfd tempest-TestInstancesWithCinderVolumes-750005214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d144b76d-2a1f-46fc-81ff-153170e27448" returned: 0 in 0.266s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:03:40 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c061e58d-d456-4883-b1dd-7227a2fdbcfd tempest-TestInstancesWithCinderVolumes-750005214 None] Lock "cinder-quobyte-d144b76d-2a1f-46fc-81ff-153170e27448" released by "delete_volume" :: held 0.763s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:03:40 devstack cinder-volume[87314]: WARNING cinder.quota [None req-c061e58d-d456-4883-b1dd-7227a2fdbcfd tempest-TestInstancesWithCinderVolumes-750005214 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-42625931-748320358 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-42625931-748320358, it is now deprecated. Please use the default quota class for default quota. Sep 04 18:03:40 devstack cinder-volume[87314]: WARNING cinder.quota [None req-c061e58d-d456-4883-b1dd-7227a2fdbcfd tempest-TestInstancesWithCinderVolumes-750005214 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-42625931-748320358 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-42625931-748320358, it is now deprecated. Please use the default quota class for default quota. Sep 04 18:03:40 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-c061e58d-d456-4883-b1dd-7227a2fdbcfd tempest-TestInstancesWithCinderVolumes-750005214 None] Created reservations ['71b4bc72-d785-4e64-987a-b415909b3657', 'aff5c955-fe06-479d-afb4-7359f0f9832f', '5c9f2e1a-0005-4f56-9fbd-c01e7309c30c', 'f26c1523-4d86-4cb1-aac3-24030e90d097'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:03:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c061e58d-d456-4883-b1dd-7227a2fdbcfd tempest-TestInstancesWithCinderVolumes-750005214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:03:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c061e58d-d456-4883-b1dd-7227a2fdbcfd tempest-TestInstancesWithCinderVolumes-750005214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:03:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c061e58d-d456-4883-b1dd-7227a2fdbcfd tempest-TestInstancesWithCinderVolumes-750005214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:03:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c061e58d-d456-4883-b1dd-7227a2fdbcfd tempest-TestInstancesWithCinderVolumes-750005214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:03:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c061e58d-d456-4883-b1dd-7227a2fdbcfd tempest-TestInstancesWithCinderVolumes-750005214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:03:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c061e58d-d456-4883-b1dd-7227a2fdbcfd tempest-TestInstancesWithCinderVolumes-750005214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:03:40 devstack sudo[102162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:03:40 devstack sudo[102162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:03:40 devstack sudo[102162]: pam_unix(sudo:session): session closed for user root Sep 04 18:03:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c061e58d-d456-4883-b1dd-7227a2fdbcfd tempest-TestInstancesWithCinderVolumes-750005214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.281s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:03:40 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-c061e58d-d456-4883-b1dd-7227a2fdbcfd tempest-TestInstancesWithCinderVolumes-750005214 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:03:40 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-c061e58d-d456-4883-b1dd-7227a2fdbcfd tempest-TestInstancesWithCinderVolumes-750005214 None] Deleted volume successfully. Sep 04 18:03:40 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c061e58d-d456-4883-b1dd-7227a2fdbcfd tempest-TestInstancesWithCinderVolumes-750005214 None] Lock "cinder-d144b76d-2a1f-46fc-81ff-153170e27448-delete_volume" released by "delete_volume" :: held 1.275s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:03:50 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=27,cinder:UPDATE=28,cinder:INSERT=7,cinder:DELETE=1 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 18:03:50 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=35,cinder:UPDATE=26,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 18:04:00 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e566d5e-e7f0-4b30-bcff-723c18291743 tempest-TestServerVolumeAttachScenarioOldVersion-731678612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:04:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2e566d5e-e7f0-4b30-bcff-723c18291743 tempest-TestServerVolumeAttachScenarioOldVersion-731678612 None] Flow 'volume_create_manager' (dc3325c9-0ab8-4e20-ad5b-a2e138e13f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:04:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2e566d5e-e7f0-4b30-bcff-723c18291743 tempest-TestServerVolumeAttachScenarioOldVersion-731678612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78ea598b-c850-45f9-8b7e-370327776ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2e566d5e-e7f0-4b30-bcff-723c18291743 tempest-TestServerVolumeAttachScenarioOldVersion-731678612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78ea598b-c850-45f9-8b7e-370327776ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:04:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-635392712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68d099c1-b2aa-48c8-981a-064cd3a96c2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ca4a5f9aeb94a94b9f236c49dd6d45e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:04:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:04:00Z,use_quota=True,user_id='cec5906b2e7849cdb477888c3f41a9a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2e566d5e-e7f0-4b30-bcff-723c18291743 tempest-TestServerVolumeAttachScenarioOldVersion-731678612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bb3cfee-b78e-4775-97db-e8e0bddc1302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2e566d5e-e7f0-4b30-bcff-723c18291743 tempest-TestServerVolumeAttachScenarioOldVersion-731678612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bb3cfee-b78e-4775-97db-e8e0bddc1302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2e566d5e-e7f0-4b30-bcff-723c18291743 tempest-TestServerVolumeAttachScenarioOldVersion-731678612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (371644b2-0c76-4113-a0c1-07556734a9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2e566d5e-e7f0-4b30-bcff-723c18291743 tempest-TestServerVolumeAttachScenarioOldVersion-731678612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (371644b2-0c76-4113-a0c1-07556734a9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68d099c1-b2aa-48c8-981a-064cd3a96c2f', 'volume_name': 'volume-68d099c1-b2aa-48c8-981a-064cd3a96c2f', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2e566d5e-e7f0-4b30-bcff-723c18291743 tempest-TestServerVolumeAttachScenarioOldVersion-731678612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cff8c7bd-f9ba-4614-bd17-09c49c51cbe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2e566d5e-e7f0-4b30-bcff-723c18291743 tempest-TestServerVolumeAttachScenarioOldVersion-731678612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cff8c7bd-f9ba-4614-bd17-09c49c51cbe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2e566d5e-e7f0-4b30-bcff-723c18291743 tempest-TestServerVolumeAttachScenarioOldVersion-731678612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c642e31-e5ef-4116-9c1a-2ab7c1168d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:00 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-2e566d5e-e7f0-4b30-bcff-723c18291743 tempest-TestServerVolumeAttachScenarioOldVersion-731678612 None] Volume 68d099c1-b2aa-48c8-981a-064cd3a96c2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68d099c1-b2aa-48c8-981a-064cd3a96c2f', 'volume_size': 1} Sep 04 18:04:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-2e566d5e-e7f0-4b30-bcff-723c18291743 tempest-TestServerVolumeAttachScenarioOldVersion-731678612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:04:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-2e566d5e-e7f0-4b30-bcff-723c18291743 tempest-TestServerVolumeAttachScenarioOldVersion-731678612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:04:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-2e566d5e-e7f0-4b30-bcff-723c18291743 tempest-TestServerVolumeAttachScenarioOldVersion-731678612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:04:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-635392712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68d099c1-b2aa-48c8-981a-064cd3a96c2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ca4a5f9aeb94a94b9f236c49dd6d45e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:04:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:04:00Z,use_quota=True,user_id='cec5906b2e7849cdb477888c3f41a9a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:04:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-2e566d5e-e7f0-4b30-bcff-723c18291743 tempest-TestServerVolumeAttachScenarioOldVersion-731678612 None] Creating volume 68d099c1-b2aa-48c8-981a-064cd3a96c2f {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:04:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-2e566d5e-e7f0-4b30-bcff-723c18291743 tempest-TestServerVolumeAttachScenarioOldVersion-731678612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:04:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-2e566d5e-e7f0-4b30-bcff-723c18291743 tempest-TestServerVolumeAttachScenarioOldVersion-731678612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:04:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-2e566d5e-e7f0-4b30-bcff-723c18291743 tempest-TestServerVolumeAttachScenarioOldVersion-731678612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:04:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-2e566d5e-e7f0-4b30-bcff-723c18291743 tempest-TestServerVolumeAttachScenarioOldVersion-731678612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:04:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-2e566d5e-e7f0-4b30-bcff-723c18291743 tempest-TestServerVolumeAttachScenarioOldVersion-731678612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:04:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-2e566d5e-e7f0-4b30-bcff-723c18291743 tempest-TestServerVolumeAttachScenarioOldVersion-731678612 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:04:00 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-2e566d5e-e7f0-4b30-bcff-723c18291743 tempest-TestServerVolumeAttachScenarioOldVersion-731678612 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:04:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2e566d5e-e7f0-4b30-bcff-723c18291743 tempest-TestServerVolumeAttachScenarioOldVersion-731678612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-68d099c1-b2aa-48c8-981a-064cd3a96c2f 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:04:00 devstack sudo[102232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-68d099c1-b2aa-48c8-981a-064cd3a96c2f 1073741824 Sep 04 18:04:00 devstack sudo[102232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:04:01 devstack sudo[102232]: pam_unix(sudo:session): session closed for user root Sep 04 18:04:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2e566d5e-e7f0-4b30-bcff-723c18291743 tempest-TestServerVolumeAttachScenarioOldVersion-731678612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-68d099c1-b2aa-48c8-981a-064cd3a96c2f 1073741824" returned: 0 in 0.516s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:04:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2e566d5e-e7f0-4b30-bcff-723c18291743 tempest-TestServerVolumeAttachScenarioOldVersion-731678612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-68d099c1-b2aa-48c8-981a-064cd3a96c2f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:04:01 devstack sudo[102241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-68d099c1-b2aa-48c8-981a-064cd3a96c2f Sep 04 18:04:01 devstack sudo[102241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:04:01 devstack sudo[102241]: pam_unix(sudo:session): session closed for user root Sep 04 18:04:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2e566d5e-e7f0-4b30-bcff-723c18291743 tempest-TestServerVolumeAttachScenarioOldVersion-731678612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-68d099c1-b2aa-48c8-981a-064cd3a96c2f" returned: 0 in 0.281s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:04:01 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-2e566d5e-e7f0-4b30-bcff-723c18291743 tempest-TestServerVolumeAttachScenarioOldVersion-731678612 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:04:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-2e566d5e-e7f0-4b30-bcff-723c18291743 tempest-TestServerVolumeAttachScenarioOldVersion-731678612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:04:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2e566d5e-e7f0-4b30-bcff-723c18291743 tempest-TestServerVolumeAttachScenarioOldVersion-731678612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c642e31-e5ef-4116-9c1a-2ab7c1168d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68d099c1-b2aa-48c8-981a-064cd3a96c2f', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2e566d5e-e7f0-4b30-bcff-723c18291743 tempest-TestServerVolumeAttachScenarioOldVersion-731678612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (302d1580-2b0b-4fd5-9aa1-fb15df04b39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:01 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-2e566d5e-e7f0-4b30-bcff-723c18291743 tempest-TestServerVolumeAttachScenarioOldVersion-731678612 None] Volume volume-68d099c1-b2aa-48c8-981a-064cd3a96c2f (68d099c1-b2aa-48c8-981a-064cd3a96c2f): created successfully Sep 04 18:04:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2e566d5e-e7f0-4b30-bcff-723c18291743 tempest-TestServerVolumeAttachScenarioOldVersion-731678612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (302d1580-2b0b-4fd5-9aa1-fb15df04b39d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2e566d5e-e7f0-4b30-bcff-723c18291743 tempest-TestServerVolumeAttachScenarioOldVersion-731678612 None] Flow 'volume_create_manager' (dc3325c9-0ab8-4e20-ad5b-a2e138e13f8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:04:01 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-2e566d5e-e7f0-4b30-bcff-723c18291743 tempest-TestServerVolumeAttachScenarioOldVersion-731678612 None] Created volume successfully. Sep 04 18:04:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-75cddbe4-43b2-44c7-a45b-547a261d37d8 req-365d2082-5cbb-4f55-a7fe-815a8005efd3 tempest-TestServerVolumeAttachScenarioOldVersion-731678612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:04:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-75cddbe4-43b2-44c7-a45b-547a261d37d8 req-365d2082-5cbb-4f55-a7fe-815a8005efd3 tempest-TestServerVolumeAttachScenarioOldVersion-731678612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:04:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-75cddbe4-43b2-44c7-a45b-547a261d37d8 req-365d2082-5cbb-4f55-a7fe-815a8005efd3 tempest-TestServerVolumeAttachScenarioOldVersion-731678612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:04:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-75cddbe4-43b2-44c7-a45b-547a261d37d8 req-365d2082-5cbb-4f55-a7fe-815a8005efd3 tempest-TestServerVolumeAttachScenarioOldVersion-731678612 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a', 'name': 'volume-68d099c1-b2aa-48c8-981a-064cd3a96c2f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c348ac16-9930-4ef9-a9f7-e21ebad2abf6', 'enforce_multipath': True} {{(pid=87314) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 18:04:03 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-75cddbe4-43b2-44c7-a45b-547a261d37d8 req-365d2082-5cbb-4f55-a7fe-815a8005efd3 tempest-TestServerVolumeAttachScenarioOldVersion-731678612 None] attachment_update completed successfully. Sep 04 18:04:07 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-b64f99cc-d258-401e-89e2-d5ec37c0a39a req-953f6a49-f2c0-4ae2-8aff-e7486fcb2858 tempest-TestServerVolumeAttachScenarioOldVersion-731678612 None] Terminate volume connection completed successfully. Sep 04 18:04:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-b64f99cc-d258-401e-89e2-d5ec37c0a39a req-953f6a49-f2c0-4ae2-8aff-e7486fcb2858 tempest-TestServerVolumeAttachScenarioOldVersion-731678612 None] Deleting attachment c348ac16-9930-4ef9-a9f7-e21ebad2abf6. {{(pid=87314) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 18:04:08 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6356c32f-10f7-4ee2-9a66-7a63a133ced7 tempest-TestServerVolumeAttachScenarioOldVersion-731678612 None] Acquiring lock "cinder-68d099c1-b2aa-48c8-981a-064cd3a96c2f-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:04:08 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6356c32f-10f7-4ee2-9a66-7a63a133ced7 tempest-TestServerVolumeAttachScenarioOldVersion-731678612 None] Lock "cinder-68d099c1-b2aa-48c8-981a-064cd3a96c2f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:04:08 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6356c32f-10f7-4ee2-9a66-7a63a133ced7 tempest-TestServerVolumeAttachScenarioOldVersion-731678612 None] Acquiring lock "cinder-quobyte-68d099c1-b2aa-48c8-981a-064cd3a96c2f" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:04:08 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6356c32f-10f7-4ee2-9a66-7a63a133ced7 tempest-TestServerVolumeAttachScenarioOldVersion-731678612 None] Lock "cinder-quobyte-68d099c1-b2aa-48c8-981a-064cd3a96c2f" acquired by "delete_volume" :: waited 0.017s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:04:08 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[5511f21c-70d5-44a6-9eea-ce7ef61d263a]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:04:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6356c32f-10f7-4ee2-9a66-7a63a133ced7 tempest-TestServerVolumeAttachScenarioOldVersion-731678612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-68d099c1-b2aa-48c8-981a-064cd3a96c2f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:04:08 devstack sudo[102667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-68d099c1-b2aa-48c8-981a-064cd3a96c2f Sep 04 18:04:08 devstack sudo[102667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:04:08 devstack sudo[102667]: pam_unix(sudo:session): session closed for user root Sep 04 18:04:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6356c32f-10f7-4ee2-9a66-7a63a133ced7 tempest-TestServerVolumeAttachScenarioOldVersion-731678612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-68d099c1-b2aa-48c8-981a-064cd3a96c2f" returned: 0 in 0.407s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:04:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6356c32f-10f7-4ee2-9a66-7a63a133ced7 tempest-TestServerVolumeAttachScenarioOldVersion-731678612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-68d099c1-b2aa-48c8-981a-064cd3a96c2f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:04:08 devstack sudo[102673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-68d099c1-b2aa-48c8-981a-064cd3a96c2f Sep 04 18:04:08 devstack sudo[102673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:04:08 devstack sudo[102673]: pam_unix(sudo:session): session closed for user root Sep 04 18:04:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6356c32f-10f7-4ee2-9a66-7a63a133ced7 tempest-TestServerVolumeAttachScenarioOldVersion-731678612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-68d099c1-b2aa-48c8-981a-064cd3a96c2f" returned: 0 in 0.298s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:04:08 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6356c32f-10f7-4ee2-9a66-7a63a133ced7 tempest-TestServerVolumeAttachScenarioOldVersion-731678612 None] Lock "cinder-quobyte-68d099c1-b2aa-48c8-981a-064cd3a96c2f" released by "delete_volume" :: held 0.761s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:04:08 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-6356c32f-10f7-4ee2-9a66-7a63a133ced7 tempest-TestServerVolumeAttachScenarioOldVersion-731678612 None] Created reservations ['cbb3fc85-1c9f-45a7-bf1c-6ac46498b2f6', 'd4ee872d-e476-4b20-abc9-a6b91e0d336b', 'a6280371-d1cf-4b55-9d55-63dba46fa852', '95dab598-9626-41ee-9f1c-ca397d0d89e5'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:04:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6356c32f-10f7-4ee2-9a66-7a63a133ced7 tempest-TestServerVolumeAttachScenarioOldVersion-731678612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:04:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6356c32f-10f7-4ee2-9a66-7a63a133ced7 tempest-TestServerVolumeAttachScenarioOldVersion-731678612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:04:09 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-6356c32f-10f7-4ee2-9a66-7a63a133ced7 tempest-TestServerVolumeAttachScenarioOldVersion-731678612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:04:09 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-6356c32f-10f7-4ee2-9a66-7a63a133ced7 tempest-TestServerVolumeAttachScenarioOldVersion-731678612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:04:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6356c32f-10f7-4ee2-9a66-7a63a133ced7 tempest-TestServerVolumeAttachScenarioOldVersion-731678612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:04:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6356c32f-10f7-4ee2-9a66-7a63a133ced7 tempest-TestServerVolumeAttachScenarioOldVersion-731678612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:04:09 devstack sudo[102676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:04:09 devstack sudo[102676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:04:09 devstack sudo[102676]: pam_unix(sudo:session): session closed for user root Sep 04 18:04:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6356c32f-10f7-4ee2-9a66-7a63a133ced7 tempest-TestServerVolumeAttachScenarioOldVersion-731678612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.309s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:04:09 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-6356c32f-10f7-4ee2-9a66-7a63a133ced7 tempest-TestServerVolumeAttachScenarioOldVersion-731678612 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:04:09 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-6356c32f-10f7-4ee2-9a66-7a63a133ced7 tempest-TestServerVolumeAttachScenarioOldVersion-731678612 None] Deleted volume successfully. Sep 04 18:04:09 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6356c32f-10f7-4ee2-9a66-7a63a133ced7 tempest-TestServerVolumeAttachScenarioOldVersion-731678612 None] Lock "cinder-68d099c1-b2aa-48c8-981a-064cd3a96c2f-delete_volume" released by "delete_volume" :: held 1.321s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:04:13 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb7504e3-1008-4211-8677-5d1309da36ec tempest-TestServerVolumeAttachmentScenario-1350945788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:04:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-eb7504e3-1008-4211-8677-5d1309da36ec tempest-TestServerVolumeAttachmentScenario-1350945788 None] Flow 'volume_create_manager' (bb538bbc-7cb5-4b9a-abc9-cbe8d5f55938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:04:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-eb7504e3-1008-4211-8677-5d1309da36ec tempest-TestServerVolumeAttachmentScenario-1350945788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98241b2c-8da6-40c4-9664-2067d45471c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-eb7504e3-1008-4211-8677-5d1309da36ec tempest-TestServerVolumeAttachmentScenario-1350945788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98241b2c-8da6-40c4-9664-2067d45471c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:04:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1425458824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27e9a55e-6b50-4076-a782-2ee6e103f7b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac9c941be6ba44848c90d3cdc7c2df63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:04:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:04:14Z,use_quota=True,user_id='14719902baf84dc8aff303f909287274',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-eb7504e3-1008-4211-8677-5d1309da36ec tempest-TestServerVolumeAttachmentScenario-1350945788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (708e4433-6ac9-4e4f-b867-7e7134a4bfdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-eb7504e3-1008-4211-8677-5d1309da36ec tempest-TestServerVolumeAttachmentScenario-1350945788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (708e4433-6ac9-4e4f-b867-7e7134a4bfdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-eb7504e3-1008-4211-8677-5d1309da36ec tempest-TestServerVolumeAttachmentScenario-1350945788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ba54a7f-3d10-4b33-9281-7efcacd7f905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-eb7504e3-1008-4211-8677-5d1309da36ec tempest-TestServerVolumeAttachmentScenario-1350945788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ba54a7f-3d10-4b33-9281-7efcacd7f905) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27e9a55e-6b50-4076-a782-2ee6e103f7b6', 'volume_name': 'volume-27e9a55e-6b50-4076-a782-2ee6e103f7b6', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-eb7504e3-1008-4211-8677-5d1309da36ec tempest-TestServerVolumeAttachmentScenario-1350945788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98fdfd49-370a-42a9-98ab-b513fa8f2854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-eb7504e3-1008-4211-8677-5d1309da36ec tempest-TestServerVolumeAttachmentScenario-1350945788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98fdfd49-370a-42a9-98ab-b513fa8f2854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:13 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-eb7504e3-1008-4211-8677-5d1309da36ec tempest-TestServerVolumeAttachmentScenario-1350945788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0838d1ca-402d-4407-8bb5-90fac45df3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:13 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-eb7504e3-1008-4211-8677-5d1309da36ec tempest-TestServerVolumeAttachmentScenario-1350945788 None] Volume 27e9a55e-6b50-4076-a782-2ee6e103f7b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27e9a55e-6b50-4076-a782-2ee6e103f7b6', 'volume_size': 1} Sep 04 18:04:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-eb7504e3-1008-4211-8677-5d1309da36ec tempest-TestServerVolumeAttachmentScenario-1350945788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:04:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-eb7504e3-1008-4211-8677-5d1309da36ec tempest-TestServerVolumeAttachmentScenario-1350945788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:04:13 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-eb7504e3-1008-4211-8677-5d1309da36ec tempest-TestServerVolumeAttachmentScenario-1350945788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:04:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1425458824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27e9a55e-6b50-4076-a782-2ee6e103f7b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac9c941be6ba44848c90d3cdc7c2df63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:04:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:04:14Z,use_quota=True,user_id='14719902baf84dc8aff303f909287274',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:04:13 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-eb7504e3-1008-4211-8677-5d1309da36ec tempest-TestServerVolumeAttachmentScenario-1350945788 None] Creating volume 27e9a55e-6b50-4076-a782-2ee6e103f7b6 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:04:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-eb7504e3-1008-4211-8677-5d1309da36ec tempest-TestServerVolumeAttachmentScenario-1350945788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:04:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-eb7504e3-1008-4211-8677-5d1309da36ec tempest-TestServerVolumeAttachmentScenario-1350945788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:04:13 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-eb7504e3-1008-4211-8677-5d1309da36ec tempest-TestServerVolumeAttachmentScenario-1350945788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:04:13 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-eb7504e3-1008-4211-8677-5d1309da36ec tempest-TestServerVolumeAttachmentScenario-1350945788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:04:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-eb7504e3-1008-4211-8677-5d1309da36ec tempest-TestServerVolumeAttachmentScenario-1350945788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:04:13 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-eb7504e3-1008-4211-8677-5d1309da36ec tempest-TestServerVolumeAttachmentScenario-1350945788 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:04:13 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-eb7504e3-1008-4211-8677-5d1309da36ec tempest-TestServerVolumeAttachmentScenario-1350945788 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:04:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-eb7504e3-1008-4211-8677-5d1309da36ec tempest-TestServerVolumeAttachmentScenario-1350945788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-27e9a55e-6b50-4076-a782-2ee6e103f7b6 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:04:13 devstack sudo[102705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-27e9a55e-6b50-4076-a782-2ee6e103f7b6 1073741824 Sep 04 18:04:13 devstack sudo[102705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:04:14 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-07f694dc-60bb-49d6-afa1-58effc0eff98 tempest-TestServerVolumeAttachmentScenario-1350945788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:04:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-07f694dc-60bb-49d6-afa1-58effc0eff98 tempest-TestServerVolumeAttachmentScenario-1350945788 None] Flow 'volume_create_manager' (41d9e031-55f7-49f7-a370-c13efc8f43d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:04:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-07f694dc-60bb-49d6-afa1-58effc0eff98 tempest-TestServerVolumeAttachmentScenario-1350945788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1f20d13-588e-4990-b772-f94438cb7e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-07f694dc-60bb-49d6-afa1-58effc0eff98 tempest-TestServerVolumeAttachmentScenario-1350945788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1f20d13-588e-4990-b772-f94438cb7e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1858173137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=016d0503-b59b-49d0-8e25-204e76541a41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac9c941be6ba44848c90d3cdc7c2df63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:04:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:04:14Z,use_quota=True,user_id='14719902baf84dc8aff303f909287274',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-07f694dc-60bb-49d6-afa1-58effc0eff98 tempest-TestServerVolumeAttachmentScenario-1350945788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (029a3c80-a634-46b5-942f-5cf684ad0e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-07f694dc-60bb-49d6-afa1-58effc0eff98 tempest-TestServerVolumeAttachmentScenario-1350945788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (029a3c80-a634-46b5-942f-5cf684ad0e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-07f694dc-60bb-49d6-afa1-58effc0eff98 tempest-TestServerVolumeAttachmentScenario-1350945788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1761b4a-715b-4d8e-b67d-c6f1422fa633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-07f694dc-60bb-49d6-afa1-58effc0eff98 tempest-TestServerVolumeAttachmentScenario-1350945788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1761b4a-715b-4d8e-b67d-c6f1422fa633) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '016d0503-b59b-49d0-8e25-204e76541a41', 'volume_name': 'volume-016d0503-b59b-49d0-8e25-204e76541a41', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-07f694dc-60bb-49d6-afa1-58effc0eff98 tempest-TestServerVolumeAttachmentScenario-1350945788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee1c6936-1f47-4a8c-abcf-7c076166aa2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-07f694dc-60bb-49d6-afa1-58effc0eff98 tempest-TestServerVolumeAttachmentScenario-1350945788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee1c6936-1f47-4a8c-abcf-7c076166aa2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-07f694dc-60bb-49d6-afa1-58effc0eff98 tempest-TestServerVolumeAttachmentScenario-1350945788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3ad16bf-0c6c-4890-8dc5-d6ceaa1c8ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:14 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-07f694dc-60bb-49d6-afa1-58effc0eff98 tempest-TestServerVolumeAttachmentScenario-1350945788 None] Volume 016d0503-b59b-49d0-8e25-204e76541a41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-016d0503-b59b-49d0-8e25-204e76541a41', 'volume_size': 1} Sep 04 18:04:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-07f694dc-60bb-49d6-afa1-58effc0eff98 tempest-TestServerVolumeAttachmentScenario-1350945788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:04:14 devstack sudo[102705]: pam_unix(sudo:session): session closed for user root Sep 04 18:04:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-eb7504e3-1008-4211-8677-5d1309da36ec tempest-TestServerVolumeAttachmentScenario-1350945788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-27e9a55e-6b50-4076-a782-2ee6e103f7b6 1073741824" returned: 0 in 0.573s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:04:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-eb7504e3-1008-4211-8677-5d1309da36ec tempest-TestServerVolumeAttachmentScenario-1350945788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-27e9a55e-6b50-4076-a782-2ee6e103f7b6 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:04:14 devstack sudo[102710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-27e9a55e-6b50-4076-a782-2ee6e103f7b6 Sep 04 18:04:14 devstack sudo[102710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:04:14 devstack sudo[102710]: pam_unix(sudo:session): session closed for user root Sep 04 18:04:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-eb7504e3-1008-4211-8677-5d1309da36ec tempest-TestServerVolumeAttachmentScenario-1350945788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-27e9a55e-6b50-4076-a782-2ee6e103f7b6" returned: 0 in 0.265s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:04:14 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-eb7504e3-1008-4211-8677-5d1309da36ec tempest-TestServerVolumeAttachmentScenario-1350945788 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:04:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-eb7504e3-1008-4211-8677-5d1309da36ec tempest-TestServerVolumeAttachmentScenario-1350945788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:04:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-07f694dc-60bb-49d6-afa1-58effc0eff98 tempest-TestServerVolumeAttachmentScenario-1350945788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.457s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:04:14 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-07f694dc-60bb-49d6-afa1-58effc0eff98 tempest-TestServerVolumeAttachmentScenario-1350945788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1858173137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=016d0503-b59b-49d0-8e25-204e76541a41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac9c941be6ba44848c90d3cdc7c2df63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:04:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:04:14Z,use_quota=True,user_id='14719902baf84dc8aff303f909287274',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:04:14 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-07f694dc-60bb-49d6-afa1-58effc0eff98 tempest-TestServerVolumeAttachmentScenario-1350945788 None] Creating volume 016d0503-b59b-49d0-8e25-204e76541a41 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:04:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-07f694dc-60bb-49d6-afa1-58effc0eff98 tempest-TestServerVolumeAttachmentScenario-1350945788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:04:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-07f694dc-60bb-49d6-afa1-58effc0eff98 tempest-TestServerVolumeAttachmentScenario-1350945788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:04:14 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-07f694dc-60bb-49d6-afa1-58effc0eff98 tempest-TestServerVolumeAttachmentScenario-1350945788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:04:14 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-07f694dc-60bb-49d6-afa1-58effc0eff98 tempest-TestServerVolumeAttachmentScenario-1350945788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:04:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-07f694dc-60bb-49d6-afa1-58effc0eff98 tempest-TestServerVolumeAttachmentScenario-1350945788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:04:14 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-07f694dc-60bb-49d6-afa1-58effc0eff98 tempest-TestServerVolumeAttachmentScenario-1350945788 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:04:14 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-07f694dc-60bb-49d6-afa1-58effc0eff98 tempest-TestServerVolumeAttachmentScenario-1350945788 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:04:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-07f694dc-60bb-49d6-afa1-58effc0eff98 tempest-TestServerVolumeAttachmentScenario-1350945788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-016d0503-b59b-49d0-8e25-204e76541a41 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:04:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-eb7504e3-1008-4211-8677-5d1309da36ec tempest-TestServerVolumeAttachmentScenario-1350945788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0838d1ca-402d-4407-8bb5-90fac45df3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27e9a55e-6b50-4076-a782-2ee6e103f7b6', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-eb7504e3-1008-4211-8677-5d1309da36ec tempest-TestServerVolumeAttachmentScenario-1350945788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2482e9b1-b76b-4903-b75d-53ce4833cb5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:14 devstack sudo[102713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-016d0503-b59b-49d0-8e25-204e76541a41 1073741824 Sep 04 18:04:14 devstack sudo[102713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:04:14 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-eb7504e3-1008-4211-8677-5d1309da36ec tempest-TestServerVolumeAttachmentScenario-1350945788 None] Volume volume-27e9a55e-6b50-4076-a782-2ee6e103f7b6 (27e9a55e-6b50-4076-a782-2ee6e103f7b6): created successfully Sep 04 18:04:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-eb7504e3-1008-4211-8677-5d1309da36ec tempest-TestServerVolumeAttachmentScenario-1350945788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2482e9b1-b76b-4903-b75d-53ce4833cb5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-eb7504e3-1008-4211-8677-5d1309da36ec tempest-TestServerVolumeAttachmentScenario-1350945788 None] Flow 'volume_create_manager' (bb538bbc-7cb5-4b9a-abc9-cbe8d5f55938) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:04:14 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-eb7504e3-1008-4211-8677-5d1309da36ec tempest-TestServerVolumeAttachmentScenario-1350945788 None] Created volume successfully. Sep 04 18:04:15 devstack sudo[102713]: pam_unix(sudo:session): session closed for user root Sep 04 18:04:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-07f694dc-60bb-49d6-afa1-58effc0eff98 tempest-TestServerVolumeAttachmentScenario-1350945788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-016d0503-b59b-49d0-8e25-204e76541a41 1073741824" returned: 0 in 0.547s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:04:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-07f694dc-60bb-49d6-afa1-58effc0eff98 tempest-TestServerVolumeAttachmentScenario-1350945788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-016d0503-b59b-49d0-8e25-204e76541a41 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:04:15 devstack sudo[102719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-016d0503-b59b-49d0-8e25-204e76541a41 Sep 04 18:04:15 devstack sudo[102719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:04:15 devstack sudo[102719]: pam_unix(sudo:session): session closed for user root Sep 04 18:04:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-07f694dc-60bb-49d6-afa1-58effc0eff98 tempest-TestServerVolumeAttachmentScenario-1350945788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-016d0503-b59b-49d0-8e25-204e76541a41" returned: 0 in 0.247s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:04:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-07f694dc-60bb-49d6-afa1-58effc0eff98 tempest-TestServerVolumeAttachmentScenario-1350945788 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:04:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-07f694dc-60bb-49d6-afa1-58effc0eff98 tempest-TestServerVolumeAttachmentScenario-1350945788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:04:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-07f694dc-60bb-49d6-afa1-58effc0eff98 tempest-TestServerVolumeAttachmentScenario-1350945788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3ad16bf-0c6c-4890-8dc5-d6ceaa1c8ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-016d0503-b59b-49d0-8e25-204e76541a41', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-07f694dc-60bb-49d6-afa1-58effc0eff98 tempest-TestServerVolumeAttachmentScenario-1350945788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4ebec7f-d870-40f3-8d5a-008dbc83765b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:15 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-07f694dc-60bb-49d6-afa1-58effc0eff98 tempest-TestServerVolumeAttachmentScenario-1350945788 None] Volume volume-016d0503-b59b-49d0-8e25-204e76541a41 (016d0503-b59b-49d0-8e25-204e76541a41): created successfully Sep 04 18:04:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-07f694dc-60bb-49d6-afa1-58effc0eff98 tempest-TestServerVolumeAttachmentScenario-1350945788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4ebec7f-d870-40f3-8d5a-008dbc83765b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-07f694dc-60bb-49d6-afa1-58effc0eff98 tempest-TestServerVolumeAttachmentScenario-1350945788 None] Flow 'volume_create_manager' (41d9e031-55f7-49f7-a370-c13efc8f43d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:04:15 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-07f694dc-60bb-49d6-afa1-58effc0eff98 tempest-TestServerVolumeAttachmentScenario-1350945788 None] Created volume successfully. Sep 04 18:04:21 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 18:04:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:04:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:04:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:04:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:04:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:04:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:04:21 devstack sudo[102792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:04:21 devstack sudo[102792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:04:21 devstack sudo[102792]: pam_unix(sudo:session): session closed for user root Sep 04 18:04:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.428s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:04:21 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:04:21 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running periodic task VolumeManager._thread_info {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 18:04:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] thread count: 28 {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 18:04:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] thread info: [<_MainThread(MainThread, started 139900377723008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 18:04:25 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=21,cinder:UPDATE=19,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 18:04:25 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:UPDATE=19,cinder:SELECT=17,cinder:INSERT=4,cinder:DELETE=3 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 18:04:28 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-9406ba67-d4b0-4079-b6af-4b0b47da6e87 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:04:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9406ba67-d4b0-4079-b6af-4b0b47da6e87 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Flow 'volume_create_manager' (fdb715a7-e0b1-4b02-ac25-bb6095348146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:04:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9406ba67-d4b0-4079-b6af-4b0b47da6e87 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34629445-852b-4f8b-ae70-97cf6fc3c75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9406ba67-d4b0-4079-b6af-4b0b47da6e87 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34629445-852b-4f8b-ae70-97cf6fc3c75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:04:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-227496537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a19ef53-a24b-42b0-bb39-04a1d17ffcc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed97e809b9194905ba7f4fd51adc550c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:04:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:04:28Z,use_quota=True,user_id='3dc3ea6d23f64ae399a7981eb65bbe12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9406ba67-d4b0-4079-b6af-4b0b47da6e87 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebd06a92-0603-49db-8b71-aa7ce5368d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9406ba67-d4b0-4079-b6af-4b0b47da6e87 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebd06a92-0603-49db-8b71-aa7ce5368d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9406ba67-d4b0-4079-b6af-4b0b47da6e87 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dae04ec1-ff3b-4599-92a7-0b2e22d436dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9406ba67-d4b0-4079-b6af-4b0b47da6e87 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dae04ec1-ff3b-4599-92a7-0b2e22d436dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a19ef53-a24b-42b0-bb39-04a1d17ffcc2', 'volume_name': 'volume-0a19ef53-a24b-42b0-bb39-04a1d17ffcc2', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9406ba67-d4b0-4079-b6af-4b0b47da6e87 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b74d94c-3385-4a68-9813-ba60f53c1551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9406ba67-d4b0-4079-b6af-4b0b47da6e87 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b74d94c-3385-4a68-9813-ba60f53c1551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9406ba67-d4b0-4079-b6af-4b0b47da6e87 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e50e071b-91e4-4a35-9e72-c13f02c390b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:28 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-9406ba67-d4b0-4079-b6af-4b0b47da6e87 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Volume 0a19ef53-a24b-42b0-bb39-04a1d17ffcc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a19ef53-a24b-42b0-bb39-04a1d17ffcc2', 'volume_size': 1} Sep 04 18:04:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9406ba67-d4b0-4079-b6af-4b0b47da6e87 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:04:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9406ba67-d4b0-4079-b6af-4b0b47da6e87 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:04:28 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9406ba67-d4b0-4079-b6af-4b0b47da6e87 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:04:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-227496537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a19ef53-a24b-42b0-bb39-04a1d17ffcc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed97e809b9194905ba7f4fd51adc550c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:04:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:04:28Z,use_quota=True,user_id='3dc3ea6d23f64ae399a7981eb65bbe12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:04:28 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-9406ba67-d4b0-4079-b6af-4b0b47da6e87 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Creating volume 0a19ef53-a24b-42b0-bb39-04a1d17ffcc2 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:04:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9406ba67-d4b0-4079-b6af-4b0b47da6e87 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:04:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9406ba67-d4b0-4079-b6af-4b0b47da6e87 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:04:28 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9406ba67-d4b0-4079-b6af-4b0b47da6e87 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:04:28 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9406ba67-d4b0-4079-b6af-4b0b47da6e87 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:04:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9406ba67-d4b0-4079-b6af-4b0b47da6e87 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:04:28 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9406ba67-d4b0-4079-b6af-4b0b47da6e87 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:04:28 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-9406ba67-d4b0-4079-b6af-4b0b47da6e87 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:04:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9406ba67-d4b0-4079-b6af-4b0b47da6e87 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0a19ef53-a24b-42b0-bb39-04a1d17ffcc2 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:04:28 devstack sudo[102820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0a19ef53-a24b-42b0-bb39-04a1d17ffcc2 1073741824 Sep 04 18:04:28 devstack sudo[102820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:04:29 devstack sudo[102820]: pam_unix(sudo:session): session closed for user root Sep 04 18:04:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9406ba67-d4b0-4079-b6af-4b0b47da6e87 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0a19ef53-a24b-42b0-bb39-04a1d17ffcc2 1073741824" returned: 0 in 0.431s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:04:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9406ba67-d4b0-4079-b6af-4b0b47da6e87 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0a19ef53-a24b-42b0-bb39-04a1d17ffcc2 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:04:29 devstack sudo[102825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0a19ef53-a24b-42b0-bb39-04a1d17ffcc2 Sep 04 18:04:29 devstack sudo[102825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:04:29 devstack sudo[102825]: pam_unix(sudo:session): session closed for user root Sep 04 18:04:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9406ba67-d4b0-4079-b6af-4b0b47da6e87 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0a19ef53-a24b-42b0-bb39-04a1d17ffcc2" returned: 0 in 0.260s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:04:29 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9406ba67-d4b0-4079-b6af-4b0b47da6e87 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:04:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9406ba67-d4b0-4079-b6af-4b0b47da6e87 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:04:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9406ba67-d4b0-4079-b6af-4b0b47da6e87 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e50e071b-91e4-4a35-9e72-c13f02c390b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a19ef53-a24b-42b0-bb39-04a1d17ffcc2', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9406ba67-d4b0-4079-b6af-4b0b47da6e87 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (013408a0-88c7-469a-8016-30e2a3710ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:29 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-9406ba67-d4b0-4079-b6af-4b0b47da6e87 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Volume volume-0a19ef53-a24b-42b0-bb39-04a1d17ffcc2 (0a19ef53-a24b-42b0-bb39-04a1d17ffcc2): created successfully Sep 04 18:04:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9406ba67-d4b0-4079-b6af-4b0b47da6e87 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (013408a0-88c7-469a-8016-30e2a3710ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9406ba67-d4b0-4079-b6af-4b0b47da6e87 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Flow 'volume_create_manager' (fdb715a7-e0b1-4b02-ac25-bb6095348146) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:04:29 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-9406ba67-d4b0-4079-b6af-4b0b47da6e87 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Created volume successfully. Sep 04 18:04:30 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-a393e87d-d3cb-434e-b2a6-37029eead635 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:04:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a393e87d-d3cb-434e-b2a6-37029eead635 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Flow 'volume_create_manager' (f16b648f-ae14-4ff0-bb04-90a8b9edee1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:04:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a393e87d-d3cb-434e-b2a6-37029eead635 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c81e9edb-09e8-4748-90bf-babfda8cf772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a393e87d-d3cb-434e-b2a6-37029eead635 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c81e9edb-09e8-4748-90bf-babfda8cf772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:04:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1369400113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=707f017c-9968-4d95-8c9f-bf3234293407,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed97e809b9194905ba7f4fd51adc550c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:04:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:04:30Z,use_quota=True,user_id='3dc3ea6d23f64ae399a7981eb65bbe12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a393e87d-d3cb-434e-b2a6-37029eead635 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9131d93f-5fa0-4c67-9cb2-a1b039992459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a393e87d-d3cb-434e-b2a6-37029eead635 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9131d93f-5fa0-4c67-9cb2-a1b039992459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a393e87d-d3cb-434e-b2a6-37029eead635 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aef5a154-ebd2-43c2-87c4-414e0e83db95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a393e87d-d3cb-434e-b2a6-37029eead635 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aef5a154-ebd2-43c2-87c4-414e0e83db95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '707f017c-9968-4d95-8c9f-bf3234293407', 'volume_name': 'volume-707f017c-9968-4d95-8c9f-bf3234293407', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a393e87d-d3cb-434e-b2a6-37029eead635 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efad74b8-55d3-478b-89da-f4b970a618a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a393e87d-d3cb-434e-b2a6-37029eead635 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efad74b8-55d3-478b-89da-f4b970a618a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a393e87d-d3cb-434e-b2a6-37029eead635 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9135812-be63-4e26-b6ca-c911a692ec7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:30 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-a393e87d-d3cb-434e-b2a6-37029eead635 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Volume 707f017c-9968-4d95-8c9f-bf3234293407: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-707f017c-9968-4d95-8c9f-bf3234293407', 'volume_size': 1} Sep 04 18:04:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a393e87d-d3cb-434e-b2a6-37029eead635 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:04:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a393e87d-d3cb-434e-b2a6-37029eead635 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:04:30 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a393e87d-d3cb-434e-b2a6-37029eead635 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:04:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1369400113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=707f017c-9968-4d95-8c9f-bf3234293407,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed97e809b9194905ba7f4fd51adc550c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:04:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:04:30Z,use_quota=True,user_id='3dc3ea6d23f64ae399a7981eb65bbe12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:04:30 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-a393e87d-d3cb-434e-b2a6-37029eead635 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Creating volume 707f017c-9968-4d95-8c9f-bf3234293407 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:04:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a393e87d-d3cb-434e-b2a6-37029eead635 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:04:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a393e87d-d3cb-434e-b2a6-37029eead635 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:04:30 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a393e87d-d3cb-434e-b2a6-37029eead635 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:04:30 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a393e87d-d3cb-434e-b2a6-37029eead635 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:04:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a393e87d-d3cb-434e-b2a6-37029eead635 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:04:30 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a393e87d-d3cb-434e-b2a6-37029eead635 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:04:30 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-a393e87d-d3cb-434e-b2a6-37029eead635 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:04:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a393e87d-d3cb-434e-b2a6-37029eead635 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-707f017c-9968-4d95-8c9f-bf3234293407 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:04:30 devstack sudo[102828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-707f017c-9968-4d95-8c9f-bf3234293407 1073741824 Sep 04 18:04:30 devstack sudo[102828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:04:30 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-aeda3ee9-4d55-4fc2-bd95-9b2a57325913 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:04:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aeda3ee9-4d55-4fc2-bd95-9b2a57325913 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Flow 'volume_create_manager' (20c614d7-14c0-4e75-965d-7139b556f79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:04:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aeda3ee9-4d55-4fc2-bd95-9b2a57325913 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49c4b8e6-1cd4-44c9-966f-1fe79fbad413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aeda3ee9-4d55-4fc2-bd95-9b2a57325913 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49c4b8e6-1cd4-44c9-966f-1fe79fbad413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:04:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1682596222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=885158e1-62ce-4e9c-93ee-56a54ff7408e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed97e809b9194905ba7f4fd51adc550c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:04:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:04:30Z,use_quota=True,user_id='3dc3ea6d23f64ae399a7981eb65bbe12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aeda3ee9-4d55-4fc2-bd95-9b2a57325913 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a8eaa50-501c-454b-941f-71463d213870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aeda3ee9-4d55-4fc2-bd95-9b2a57325913 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a8eaa50-501c-454b-941f-71463d213870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aeda3ee9-4d55-4fc2-bd95-9b2a57325913 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bff46842-cc8f-499c-981f-0694de103999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aeda3ee9-4d55-4fc2-bd95-9b2a57325913 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bff46842-cc8f-499c-981f-0694de103999) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '885158e1-62ce-4e9c-93ee-56a54ff7408e', 'volume_name': 'volume-885158e1-62ce-4e9c-93ee-56a54ff7408e', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aeda3ee9-4d55-4fc2-bd95-9b2a57325913 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e07c10e-f312-48d5-a8fc-090c0088cde9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aeda3ee9-4d55-4fc2-bd95-9b2a57325913 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e07c10e-f312-48d5-a8fc-090c0088cde9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aeda3ee9-4d55-4fc2-bd95-9b2a57325913 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40e45583-0063-43b3-8e22-93f21b132c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:30 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-aeda3ee9-4d55-4fc2-bd95-9b2a57325913 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Volume 885158e1-62ce-4e9c-93ee-56a54ff7408e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-885158e1-62ce-4e9c-93ee-56a54ff7408e', 'volume_size': 1} Sep 04 18:04:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-aeda3ee9-4d55-4fc2-bd95-9b2a57325913 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:04:30 devstack sudo[102828]: pam_unix(sudo:session): session closed for user root Sep 04 18:04:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a393e87d-d3cb-434e-b2a6-37029eead635 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-707f017c-9968-4d95-8c9f-bf3234293407 1073741824" returned: 0 in 0.585s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:04:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a393e87d-d3cb-434e-b2a6-37029eead635 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-707f017c-9968-4d95-8c9f-bf3234293407 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:04:30 devstack sudo[102834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-707f017c-9968-4d95-8c9f-bf3234293407 Sep 04 18:04:30 devstack sudo[102834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:04:30 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-3433dd96-f4e5-4ebf-a091-1ab18723b2d9 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:04:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3433dd96-f4e5-4ebf-a091-1ab18723b2d9 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Flow 'volume_create_manager' (d9a678d7-9db7-4109-91c2-09fc4ecf10b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:04:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3433dd96-f4e5-4ebf-a091-1ab18723b2d9 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5473ed66-ea51-4758-950a-db4a306acfb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3433dd96-f4e5-4ebf-a091-1ab18723b2d9 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5473ed66-ea51-4758-950a-db4a306acfb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1490625970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80bee360-fc9c-476f-9c09-638a93789e1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed97e809b9194905ba7f4fd51adc550c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:04:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:04:31Z,use_quota=True,user_id='3dc3ea6d23f64ae399a7981eb65bbe12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3433dd96-f4e5-4ebf-a091-1ab18723b2d9 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86d0a838-a990-4f5a-83ed-db806d8adb84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3433dd96-f4e5-4ebf-a091-1ab18723b2d9 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86d0a838-a990-4f5a-83ed-db806d8adb84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3433dd96-f4e5-4ebf-a091-1ab18723b2d9 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc0e17fb-3e6e-4828-a77f-e57406edfaac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3433dd96-f4e5-4ebf-a091-1ab18723b2d9 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc0e17fb-3e6e-4828-a77f-e57406edfaac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80bee360-fc9c-476f-9c09-638a93789e1d', 'volume_name': 'volume-80bee360-fc9c-476f-9c09-638a93789e1d', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3433dd96-f4e5-4ebf-a091-1ab18723b2d9 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b368ce4-49da-4f10-9862-de8fb767a27a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3433dd96-f4e5-4ebf-a091-1ab18723b2d9 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b368ce4-49da-4f10-9862-de8fb767a27a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3433dd96-f4e5-4ebf-a091-1ab18723b2d9 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ec44f99-73c4-4341-a850-7040728dbe87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:31 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-3433dd96-f4e5-4ebf-a091-1ab18723b2d9 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Volume 80bee360-fc9c-476f-9c09-638a93789e1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80bee360-fc9c-476f-9c09-638a93789e1d', 'volume_size': 1} Sep 04 18:04:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3433dd96-f4e5-4ebf-a091-1ab18723b2d9 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:04:31 devstack sudo[102834]: pam_unix(sudo:session): session closed for user root Sep 04 18:04:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a393e87d-d3cb-434e-b2a6-37029eead635 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-707f017c-9968-4d95-8c9f-bf3234293407" returned: 0 in 0.296s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:04:31 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a393e87d-d3cb-434e-b2a6-37029eead635 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:04:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a393e87d-d3cb-434e-b2a6-37029eead635 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:04:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-aeda3ee9-4d55-4fc2-bd95-9b2a57325913 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.510s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:04:31 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-aeda3ee9-4d55-4fc2-bd95-9b2a57325913 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:04:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1682596222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=885158e1-62ce-4e9c-93ee-56a54ff7408e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed97e809b9194905ba7f4fd51adc550c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:04:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:04:30Z,use_quota=True,user_id='3dc3ea6d23f64ae399a7981eb65bbe12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:04:31 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-aeda3ee9-4d55-4fc2-bd95-9b2a57325913 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Creating volume 885158e1-62ce-4e9c-93ee-56a54ff7408e {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:04:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-aeda3ee9-4d55-4fc2-bd95-9b2a57325913 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:04:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-aeda3ee9-4d55-4fc2-bd95-9b2a57325913 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:04:31 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-aeda3ee9-4d55-4fc2-bd95-9b2a57325913 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:04:31 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-aeda3ee9-4d55-4fc2-bd95-9b2a57325913 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:04:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-aeda3ee9-4d55-4fc2-bd95-9b2a57325913 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:04:31 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-aeda3ee9-4d55-4fc2-bd95-9b2a57325913 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:04:31 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-aeda3ee9-4d55-4fc2-bd95-9b2a57325913 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:04:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-aeda3ee9-4d55-4fc2-bd95-9b2a57325913 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-885158e1-62ce-4e9c-93ee-56a54ff7408e 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:04:31 devstack sudo[102837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-885158e1-62ce-4e9c-93ee-56a54ff7408e 1073741824 Sep 04 18:04:31 devstack sudo[102837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:04:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a393e87d-d3cb-434e-b2a6-37029eead635 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9135812-be63-4e26-b6ca-c911a692ec7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-707f017c-9968-4d95-8c9f-bf3234293407', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a393e87d-d3cb-434e-b2a6-37029eead635 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dd96f92-9ee5-4216-b4eb-8a358ab0c6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:31 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-a393e87d-d3cb-434e-b2a6-37029eead635 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Volume volume-707f017c-9968-4d95-8c9f-bf3234293407 (707f017c-9968-4d95-8c9f-bf3234293407): created successfully Sep 04 18:04:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a393e87d-d3cb-434e-b2a6-37029eead635 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dd96f92-9ee5-4216-b4eb-8a358ab0c6d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a393e87d-d3cb-434e-b2a6-37029eead635 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Flow 'volume_create_manager' (f16b648f-ae14-4ff0-bb04-90a8b9edee1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:04:31 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-a393e87d-d3cb-434e-b2a6-37029eead635 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Created volume successfully. Sep 04 18:04:31 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dc5848a-e1c6-4730-b327-1efdfdc959fb tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:04:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0dc5848a-e1c6-4730-b327-1efdfdc959fb tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Flow 'volume_create_manager' (7da71335-4d9a-47f0-ba36-523c96e3ebbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:04:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0dc5848a-e1c6-4730-b327-1efdfdc959fb tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69e6c202-fba5-4087-84e3-e1e9cc124bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0dc5848a-e1c6-4730-b327-1efdfdc959fb tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69e6c202-fba5-4087-84e3-e1e9cc124bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-43319051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba30ba98-aee6-43ab-b119-cc5a4910bf86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed97e809b9194905ba7f4fd51adc550c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:04:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:04:31Z,use_quota=True,user_id='3dc3ea6d23f64ae399a7981eb65bbe12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0dc5848a-e1c6-4730-b327-1efdfdc959fb tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (468bc7fc-d6c6-46f3-80c9-8aa29d3f3310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0dc5848a-e1c6-4730-b327-1efdfdc959fb tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (468bc7fc-d6c6-46f3-80c9-8aa29d3f3310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0dc5848a-e1c6-4730-b327-1efdfdc959fb tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (423399e2-727a-4a0a-9aad-f67794c17548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0dc5848a-e1c6-4730-b327-1efdfdc959fb tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (423399e2-727a-4a0a-9aad-f67794c17548) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba30ba98-aee6-43ab-b119-cc5a4910bf86', 'volume_name': 'volume-ba30ba98-aee6-43ab-b119-cc5a4910bf86', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0dc5848a-e1c6-4730-b327-1efdfdc959fb tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ab5167b-1afc-430b-8fd2-e736fd8306e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0dc5848a-e1c6-4730-b327-1efdfdc959fb tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ab5167b-1afc-430b-8fd2-e736fd8306e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0dc5848a-e1c6-4730-b327-1efdfdc959fb tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9f27b3d-1ab4-4861-908a-c58742109d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:31 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-0dc5848a-e1c6-4730-b327-1efdfdc959fb tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Volume ba30ba98-aee6-43ab-b119-cc5a4910bf86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba30ba98-aee6-43ab-b119-cc5a4910bf86', 'volume_size': 1} Sep 04 18:04:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0dc5848a-e1c6-4730-b327-1efdfdc959fb tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:04:31 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-15ead41d-0f71-4705-aa88-514da325f5f5 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:04:31 devstack sudo[102837]: pam_unix(sudo:session): session closed for user root Sep 04 18:04:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-15ead41d-0f71-4705-aa88-514da325f5f5 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Flow 'volume_create_manager' (cf1bd47a-58fd-486b-9cad-15c6c6699987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:04:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-15ead41d-0f71-4705-aa88-514da325f5f5 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (282aeaf2-55a3-473d-a6c5-82b9b9fab43a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-aeda3ee9-4d55-4fc2-bd95-9b2a57325913 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-885158e1-62ce-4e9c-93ee-56a54ff7408e 1073741824" returned: 0 in 0.704s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:04:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-15ead41d-0f71-4705-aa88-514da325f5f5 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (282aeaf2-55a3-473d-a6c5-82b9b9fab43a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2076662288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e95c270-8d44-4e0b-9532-688afa18ded5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed97e809b9194905ba7f4fd51adc550c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:04:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:04:32Z,use_quota=True,user_id='3dc3ea6d23f64ae399a7981eb65bbe12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-15ead41d-0f71-4705-aa88-514da325f5f5 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fafe788e-3a2a-4cdf-936c-aaebd2f378ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-15ead41d-0f71-4705-aa88-514da325f5f5 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fafe788e-3a2a-4cdf-936c-aaebd2f378ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-15ead41d-0f71-4705-aa88-514da325f5f5 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c37801e4-28ab-4824-88cc-06e758523972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-15ead41d-0f71-4705-aa88-514da325f5f5 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c37801e4-28ab-4824-88cc-06e758523972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e95c270-8d44-4e0b-9532-688afa18ded5', 'volume_name': 'volume-2e95c270-8d44-4e0b-9532-688afa18ded5', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-15ead41d-0f71-4705-aa88-514da325f5f5 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (551ac991-febb-470e-a76e-6789322f9600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-15ead41d-0f71-4705-aa88-514da325f5f5 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (551ac991-febb-470e-a76e-6789322f9600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:31 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-15ead41d-0f71-4705-aa88-514da325f5f5 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69ad4f5a-b37e-4b02-a57e-de97a010a62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:31 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-15ead41d-0f71-4705-aa88-514da325f5f5 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Volume 2e95c270-8d44-4e0b-9532-688afa18ded5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e95c270-8d44-4e0b-9532-688afa18ded5', 'volume_size': 1} Sep 04 18:04:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-15ead41d-0f71-4705-aa88-514da325f5f5 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:04:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-aeda3ee9-4d55-4fc2-bd95-9b2a57325913 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-885158e1-62ce-4e9c-93ee-56a54ff7408e {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:04:31 devstack sudo[102842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-885158e1-62ce-4e9c-93ee-56a54ff7408e Sep 04 18:04:31 devstack sudo[102842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:04:32 devstack sudo[102842]: pam_unix(sudo:session): session closed for user root Sep 04 18:04:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-aeda3ee9-4d55-4fc2-bd95-9b2a57325913 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-885158e1-62ce-4e9c-93ee-56a54ff7408e" returned: 0 in 0.257s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:04:32 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-aeda3ee9-4d55-4fc2-bd95-9b2a57325913 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:04:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-aeda3ee9-4d55-4fc2-bd95-9b2a57325913 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:04:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3433dd96-f4e5-4ebf-a091-1ab18723b2d9 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.099s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:04:32 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-3433dd96-f4e5-4ebf-a091-1ab18723b2d9 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1490625970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80bee360-fc9c-476f-9c09-638a93789e1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed97e809b9194905ba7f4fd51adc550c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:04:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:04:31Z,use_quota=True,user_id='3dc3ea6d23f64ae399a7981eb65bbe12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:04:32 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-3433dd96-f4e5-4ebf-a091-1ab18723b2d9 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Creating volume 80bee360-fc9c-476f-9c09-638a93789e1d {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:04:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3433dd96-f4e5-4ebf-a091-1ab18723b2d9 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:04:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3433dd96-f4e5-4ebf-a091-1ab18723b2d9 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:04:32 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-3433dd96-f4e5-4ebf-a091-1ab18723b2d9 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:04:32 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-3433dd96-f4e5-4ebf-a091-1ab18723b2d9 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:04:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3433dd96-f4e5-4ebf-a091-1ab18723b2d9 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.051s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:04:32 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-3433dd96-f4e5-4ebf-a091-1ab18723b2d9 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:04:32 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-3433dd96-f4e5-4ebf-a091-1ab18723b2d9 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:04:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3433dd96-f4e5-4ebf-a091-1ab18723b2d9 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-80bee360-fc9c-476f-9c09-638a93789e1d 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:04:32 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aeda3ee9-4d55-4fc2-bd95-9b2a57325913 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40e45583-0063-43b3-8e22-93f21b132c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-885158e1-62ce-4e9c-93ee-56a54ff7408e', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:32 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aeda3ee9-4d55-4fc2-bd95-9b2a57325913 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eef4caee-e96f-4301-b15d-06b105851ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:32 devstack sudo[102845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-80bee360-fc9c-476f-9c09-638a93789e1d 1073741824 Sep 04 18:04:32 devstack sudo[102845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:04:32 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-aeda3ee9-4d55-4fc2-bd95-9b2a57325913 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Volume volume-885158e1-62ce-4e9c-93ee-56a54ff7408e (885158e1-62ce-4e9c-93ee-56a54ff7408e): created successfully Sep 04 18:04:32 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aeda3ee9-4d55-4fc2-bd95-9b2a57325913 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eef4caee-e96f-4301-b15d-06b105851ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:32 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aeda3ee9-4d55-4fc2-bd95-9b2a57325913 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Flow 'volume_create_manager' (20c614d7-14c0-4e75-965d-7139b556f79d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:04:32 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-aeda3ee9-4d55-4fc2-bd95-9b2a57325913 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Created volume successfully. Sep 04 18:04:32 devstack sudo[102845]: pam_unix(sudo:session): session closed for user root Sep 04 18:04:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3433dd96-f4e5-4ebf-a091-1ab18723b2d9 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-80bee360-fc9c-476f-9c09-638a93789e1d 1073741824" returned: 0 in 0.433s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:04:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3433dd96-f4e5-4ebf-a091-1ab18723b2d9 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-80bee360-fc9c-476f-9c09-638a93789e1d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:04:32 devstack sudo[102850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-80bee360-fc9c-476f-9c09-638a93789e1d Sep 04 18:04:32 devstack sudo[102850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:04:33 devstack sudo[102850]: pam_unix(sudo:session): session closed for user root Sep 04 18:04:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3433dd96-f4e5-4ebf-a091-1ab18723b2d9 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-80bee360-fc9c-476f-9c09-638a93789e1d" returned: 0 in 0.294s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:04:33 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-3433dd96-f4e5-4ebf-a091-1ab18723b2d9 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:04:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3433dd96-f4e5-4ebf-a091-1ab18723b2d9 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:04:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0dc5848a-e1c6-4730-b327-1efdfdc959fb tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.594s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:04:33 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0dc5848a-e1c6-4730-b327-1efdfdc959fb tempest-CreateVolumesFromSourceVolumeTest-543632683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-43319051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba30ba98-aee6-43ab-b119-cc5a4910bf86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed97e809b9194905ba7f4fd51adc550c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:04:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:04:31Z,use_quota=True,user_id='3dc3ea6d23f64ae399a7981eb65bbe12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:04:33 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-0dc5848a-e1c6-4730-b327-1efdfdc959fb tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Creating volume ba30ba98-aee6-43ab-b119-cc5a4910bf86 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:04:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0dc5848a-e1c6-4730-b327-1efdfdc959fb tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:04:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0dc5848a-e1c6-4730-b327-1efdfdc959fb tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:04:33 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0dc5848a-e1c6-4730-b327-1efdfdc959fb tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:04:33 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0dc5848a-e1c6-4730-b327-1efdfdc959fb tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:04:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0dc5848a-e1c6-4730-b327-1efdfdc959fb tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:04:33 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0dc5848a-e1c6-4730-b327-1efdfdc959fb tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:04:33 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-0dc5848a-e1c6-4730-b327-1efdfdc959fb tempest-CreateVolumesFromSourceVolumeTest-543632683 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:04:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0dc5848a-e1c6-4730-b327-1efdfdc959fb tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ba30ba98-aee6-43ab-b119-cc5a4910bf86 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:04:33 devstack sudo[102853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ba30ba98-aee6-43ab-b119-cc5a4910bf86 1073741824 Sep 04 18:04:33 devstack sudo[102853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:04:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3433dd96-f4e5-4ebf-a091-1ab18723b2d9 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ec44f99-73c4-4341-a850-7040728dbe87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80bee360-fc9c-476f-9c09-638a93789e1d', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3433dd96-f4e5-4ebf-a091-1ab18723b2d9 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2382e28-266c-4cec-bd30-2cfa7320e652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:33 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-3433dd96-f4e5-4ebf-a091-1ab18723b2d9 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Volume volume-80bee360-fc9c-476f-9c09-638a93789e1d (80bee360-fc9c-476f-9c09-638a93789e1d): created successfully Sep 04 18:04:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3433dd96-f4e5-4ebf-a091-1ab18723b2d9 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2382e28-266c-4cec-bd30-2cfa7320e652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-3433dd96-f4e5-4ebf-a091-1ab18723b2d9 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Flow 'volume_create_manager' (d9a678d7-9db7-4109-91c2-09fc4ecf10b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:04:33 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-3433dd96-f4e5-4ebf-a091-1ab18723b2d9 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Created volume successfully. Sep 04 18:04:33 devstack sudo[102853]: pam_unix(sudo:session): session closed for user root Sep 04 18:04:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0dc5848a-e1c6-4730-b327-1efdfdc959fb tempest-CreateVolumesFromSourceVolumeTest-543632683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ba30ba98-aee6-43ab-b119-cc5a4910bf86 1073741824" returned: 0 in 0.419s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:04:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0dc5848a-e1c6-4730-b327-1efdfdc959fb tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ba30ba98-aee6-43ab-b119-cc5a4910bf86 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:04:33 devstack sudo[102858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ba30ba98-aee6-43ab-b119-cc5a4910bf86 Sep 04 18:04:33 devstack sudo[102858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:04:33 devstack sudo[102858]: pam_unix(sudo:session): session closed for user root Sep 04 18:04:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0dc5848a-e1c6-4730-b327-1efdfdc959fb tempest-CreateVolumesFromSourceVolumeTest-543632683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ba30ba98-aee6-43ab-b119-cc5a4910bf86" returned: 0 in 0.265s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:04:33 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0dc5848a-e1c6-4730-b327-1efdfdc959fb tempest-CreateVolumesFromSourceVolumeTest-543632683 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:04:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0dc5848a-e1c6-4730-b327-1efdfdc959fb tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:04:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-15ead41d-0f71-4705-aa88-514da325f5f5 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.875s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:04:33 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-15ead41d-0f71-4705-aa88-514da325f5f5 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2076662288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e95c270-8d44-4e0b-9532-688afa18ded5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed97e809b9194905ba7f4fd51adc550c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:04:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:04:32Z,use_quota=True,user_id='3dc3ea6d23f64ae399a7981eb65bbe12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:04:33 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-15ead41d-0f71-4705-aa88-514da325f5f5 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Creating volume 2e95c270-8d44-4e0b-9532-688afa18ded5 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:04:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-15ead41d-0f71-4705-aa88-514da325f5f5 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:04:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-15ead41d-0f71-4705-aa88-514da325f5f5 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:04:33 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-15ead41d-0f71-4705-aa88-514da325f5f5 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:04:33 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-15ead41d-0f71-4705-aa88-514da325f5f5 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:04:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-15ead41d-0f71-4705-aa88-514da325f5f5 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:04:33 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-15ead41d-0f71-4705-aa88-514da325f5f5 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:04:33 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-15ead41d-0f71-4705-aa88-514da325f5f5 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:04:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-15ead41d-0f71-4705-aa88-514da325f5f5 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2e95c270-8d44-4e0b-9532-688afa18ded5 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:04:33 devstack sudo[102862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2e95c270-8d44-4e0b-9532-688afa18ded5 1073741824 Sep 04 18:04:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0dc5848a-e1c6-4730-b327-1efdfdc959fb tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9f27b3d-1ab4-4861-908a-c58742109d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba30ba98-aee6-43ab-b119-cc5a4910bf86', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:33 devstack sudo[102862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:04:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0dc5848a-e1c6-4730-b327-1efdfdc959fb tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32bdcf5d-e02c-472e-821e-47b874e502fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:33 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-0dc5848a-e1c6-4730-b327-1efdfdc959fb tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Volume volume-ba30ba98-aee6-43ab-b119-cc5a4910bf86 (ba30ba98-aee6-43ab-b119-cc5a4910bf86): created successfully Sep 04 18:04:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0dc5848a-e1c6-4730-b327-1efdfdc959fb tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32bdcf5d-e02c-472e-821e-47b874e502fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0dc5848a-e1c6-4730-b327-1efdfdc959fb tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Flow 'volume_create_manager' (7da71335-4d9a-47f0-ba36-523c96e3ebbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:04:33 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-0dc5848a-e1c6-4730-b327-1efdfdc959fb tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Created volume successfully. Sep 04 18:04:34 devstack sudo[102862]: pam_unix(sudo:session): session closed for user root Sep 04 18:04:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-15ead41d-0f71-4705-aa88-514da325f5f5 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2e95c270-8d44-4e0b-9532-688afa18ded5 1073741824" returned: 0 in 0.438s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:04:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-15ead41d-0f71-4705-aa88-514da325f5f5 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2e95c270-8d44-4e0b-9532-688afa18ded5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:04:34 devstack sudo[102879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2e95c270-8d44-4e0b-9532-688afa18ded5 Sep 04 18:04:34 devstack sudo[102879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:04:34 devstack sudo[102879]: pam_unix(sudo:session): session closed for user root Sep 04 18:04:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-15ead41d-0f71-4705-aa88-514da325f5f5 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2e95c270-8d44-4e0b-9532-688afa18ded5" returned: 0 in 0.258s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:04:34 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-15ead41d-0f71-4705-aa88-514da325f5f5 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:04:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-15ead41d-0f71-4705-aa88-514da325f5f5 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:04:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-15ead41d-0f71-4705-aa88-514da325f5f5 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69ad4f5a-b37e-4b02-a57e-de97a010a62c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e95c270-8d44-4e0b-9532-688afa18ded5', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-15ead41d-0f71-4705-aa88-514da325f5f5 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (162644e0-2d70-4ce7-a99b-39602fc657a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:34 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-15ead41d-0f71-4705-aa88-514da325f5f5 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Volume volume-2e95c270-8d44-4e0b-9532-688afa18ded5 (2e95c270-8d44-4e0b-9532-688afa18ded5): created successfully Sep 04 18:04:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-15ead41d-0f71-4705-aa88-514da325f5f5 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (162644e0-2d70-4ce7-a99b-39602fc657a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:34 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-15ead41d-0f71-4705-aa88-514da325f5f5 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Flow 'volume_create_manager' (cf1bd47a-58fd-486b-9cad-15c6c6699987) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:04:34 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-15ead41d-0f71-4705-aa88-514da325f5f5 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Created volume successfully. Sep 04 18:04:35 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-77ef4529-01f4-4826-9d17-09db6914bc05 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Acquiring lock "cinder-2e95c270-8d44-4e0b-9532-688afa18ded5-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:04:35 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-77ef4529-01f4-4826-9d17-09db6914bc05 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Lock "cinder-2e95c270-8d44-4e0b-9532-688afa18ded5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:04:35 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-77ef4529-01f4-4826-9d17-09db6914bc05 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Acquiring lock "cinder-quobyte-2e95c270-8d44-4e0b-9532-688afa18ded5" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:04:35 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-77ef4529-01f4-4826-9d17-09db6914bc05 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Lock "cinder-quobyte-2e95c270-8d44-4e0b-9532-688afa18ded5" acquired by "delete_volume" :: waited 0.015s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:04:35 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c8d426-9652-4048-a61e-df9220ade639]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:04:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-77ef4529-01f4-4826-9d17-09db6914bc05 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2e95c270-8d44-4e0b-9532-688afa18ded5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:04:35 devstack sudo[102892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2e95c270-8d44-4e0b-9532-688afa18ded5 Sep 04 18:04:35 devstack sudo[102892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:04:35 devstack sudo[102892]: pam_unix(sudo:session): session closed for user root Sep 04 18:04:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-77ef4529-01f4-4826-9d17-09db6914bc05 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2e95c270-8d44-4e0b-9532-688afa18ded5" returned: 0 in 0.368s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:04:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-77ef4529-01f4-4826-9d17-09db6914bc05 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2e95c270-8d44-4e0b-9532-688afa18ded5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:04:35 devstack sudo[102897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2e95c270-8d44-4e0b-9532-688afa18ded5 Sep 04 18:04:35 devstack sudo[102897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:04:35 devstack sudo[102897]: pam_unix(sudo:session): session closed for user root Sep 04 18:04:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-77ef4529-01f4-4826-9d17-09db6914bc05 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2e95c270-8d44-4e0b-9532-688afa18ded5" returned: 0 in 0.266s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:04:35 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-77ef4529-01f4-4826-9d17-09db6914bc05 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Lock "cinder-quobyte-2e95c270-8d44-4e0b-9532-688afa18ded5" released by "delete_volume" :: held 0.677s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:04:35 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-77ef4529-01f4-4826-9d17-09db6914bc05 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Created reservations ['1e8e4848-b3f3-4d64-bf68-4b751cb8c6ac', 'a5b209d3-2c54-45a3-957f-1779f44608d5', 'f906d016-f48e-4802-af0e-066beea30bdb', 'fa15b2f2-4250-4f20-bfb3-568eda971f94'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:04:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-77ef4529-01f4-4826-9d17-09db6914bc05 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:04:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-77ef4529-01f4-4826-9d17-09db6914bc05 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:04:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-77ef4529-01f4-4826-9d17-09db6914bc05 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:04:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-77ef4529-01f4-4826-9d17-09db6914bc05 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:04:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-77ef4529-01f4-4826-9d17-09db6914bc05 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:04:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-77ef4529-01f4-4826-9d17-09db6914bc05 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:04:36 devstack sudo[102900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:04:36 devstack sudo[102900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:04:36 devstack sudo[102900]: pam_unix(sudo:session): session closed for user root Sep 04 18:04:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-77ef4529-01f4-4826-9d17-09db6914bc05 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.247s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:04:36 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-77ef4529-01f4-4826-9d17-09db6914bc05 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:04:36 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-77ef4529-01f4-4826-9d17-09db6914bc05 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Deleted volume successfully. Sep 04 18:04:36 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-77ef4529-01f4-4826-9d17-09db6914bc05 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Lock "cinder-2e95c270-8d44-4e0b-9532-688afa18ded5-delete_volume" released by "delete_volume" :: held 1.107s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:04:36 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4df592f9-20cf-47b4-ab21-16fb6768b87e tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Acquiring lock "cinder-ba30ba98-aee6-43ab-b119-cc5a4910bf86-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:04:36 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4df592f9-20cf-47b4-ab21-16fb6768b87e tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Lock "cinder-ba30ba98-aee6-43ab-b119-cc5a4910bf86-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:04:36 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4df592f9-20cf-47b4-ab21-16fb6768b87e tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Acquiring lock "cinder-quobyte-ba30ba98-aee6-43ab-b119-cc5a4910bf86" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:04:36 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4df592f9-20cf-47b4-ab21-16fb6768b87e tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Lock "cinder-quobyte-ba30ba98-aee6-43ab-b119-cc5a4910bf86" acquired by "delete_volume" :: waited 0.013s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:04:36 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[3afb1580-ca37-4de9-a3a3-00cf8b19a63d]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:04:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4df592f9-20cf-47b4-ab21-16fb6768b87e tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ba30ba98-aee6-43ab-b119-cc5a4910bf86 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:04:36 devstack sudo[102903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ba30ba98-aee6-43ab-b119-cc5a4910bf86 Sep 04 18:04:36 devstack sudo[102903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:04:36 devstack sudo[102903]: pam_unix(sudo:session): session closed for user root Sep 04 18:04:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4df592f9-20cf-47b4-ab21-16fb6768b87e tempest-CreateVolumesFromSourceVolumeTest-543632683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ba30ba98-aee6-43ab-b119-cc5a4910bf86" returned: 0 in 0.361s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:04:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4df592f9-20cf-47b4-ab21-16fb6768b87e tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ba30ba98-aee6-43ab-b119-cc5a4910bf86 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:04:36 devstack sudo[102908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ba30ba98-aee6-43ab-b119-cc5a4910bf86 Sep 04 18:04:36 devstack sudo[102908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:04:37 devstack sudo[102908]: pam_unix(sudo:session): session closed for user root Sep 04 18:04:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4df592f9-20cf-47b4-ab21-16fb6768b87e tempest-CreateVolumesFromSourceVolumeTest-543632683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ba30ba98-aee6-43ab-b119-cc5a4910bf86" returned: 0 in 0.243s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:04:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4df592f9-20cf-47b4-ab21-16fb6768b87e tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Lock "cinder-quobyte-ba30ba98-aee6-43ab-b119-cc5a4910bf86" released by "delete_volume" :: held 0.639s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:04:37 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-4df592f9-20cf-47b4-ab21-16fb6768b87e tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Created reservations ['dcb5dbf7-8eec-4c74-93fc-c8a62b4326d1', '9c01dfab-2942-403d-b559-9154595345e5', '241ecc86-05a0-45bb-b250-1f32c16aa1f3', '4f4c110b-6aa6-46df-9d3a-20f784d030ae'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:04:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4df592f9-20cf-47b4-ab21-16fb6768b87e tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:04:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4df592f9-20cf-47b4-ab21-16fb6768b87e tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:04:37 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4df592f9-20cf-47b4-ab21-16fb6768b87e tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:04:37 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4df592f9-20cf-47b4-ab21-16fb6768b87e tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:04:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4df592f9-20cf-47b4-ab21-16fb6768b87e tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:04:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4df592f9-20cf-47b4-ab21-16fb6768b87e tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:04:37 devstack sudo[102911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:04:37 devstack sudo[102911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:04:37 devstack sudo[102911]: pam_unix(sudo:session): session closed for user root Sep 04 18:04:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4df592f9-20cf-47b4-ab21-16fb6768b87e tempest-CreateVolumesFromSourceVolumeTest-543632683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.232s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:04:37 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-4df592f9-20cf-47b4-ab21-16fb6768b87e tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:04:37 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-4df592f9-20cf-47b4-ab21-16fb6768b87e tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Deleted volume successfully. Sep 04 18:04:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4df592f9-20cf-47b4-ab21-16fb6768b87e tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Lock "cinder-ba30ba98-aee6-43ab-b119-cc5a4910bf86-delete_volume" released by "delete_volume" :: held 1.061s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:04:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-86b1f6b1-cd5c-4b80-9d38-3c26865a8a18 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Acquiring lock "cinder-80bee360-fc9c-476f-9c09-638a93789e1d-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:04:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-86b1f6b1-cd5c-4b80-9d38-3c26865a8a18 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Lock "cinder-80bee360-fc9c-476f-9c09-638a93789e1d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:04:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-86b1f6b1-cd5c-4b80-9d38-3c26865a8a18 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Acquiring lock "cinder-quobyte-80bee360-fc9c-476f-9c09-638a93789e1d" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:04:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-86b1f6b1-cd5c-4b80-9d38-3c26865a8a18 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Lock "cinder-quobyte-80bee360-fc9c-476f-9c09-638a93789e1d" acquired by "delete_volume" :: waited 0.015s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:04:37 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce479eaf-036a-427e-9e6f-3e20574fbff7]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:04:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-86b1f6b1-cd5c-4b80-9d38-3c26865a8a18 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-80bee360-fc9c-476f-9c09-638a93789e1d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:04:37 devstack sudo[102914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-80bee360-fc9c-476f-9c09-638a93789e1d Sep 04 18:04:37 devstack sudo[102914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:04:37 devstack sudo[102914]: pam_unix(sudo:session): session closed for user root Sep 04 18:04:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-86b1f6b1-cd5c-4b80-9d38-3c26865a8a18 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-80bee360-fc9c-476f-9c09-638a93789e1d" returned: 0 in 0.359s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:04:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-86b1f6b1-cd5c-4b80-9d38-3c26865a8a18 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-80bee360-fc9c-476f-9c09-638a93789e1d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:04:37 devstack sudo[102920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-80bee360-fc9c-476f-9c09-638a93789e1d Sep 04 18:04:37 devstack sudo[102920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:04:38 devstack sudo[102920]: pam_unix(sudo:session): session closed for user root Sep 04 18:04:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-86b1f6b1-cd5c-4b80-9d38-3c26865a8a18 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-80bee360-fc9c-476f-9c09-638a93789e1d" returned: 0 in 0.242s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:04:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-86b1f6b1-cd5c-4b80-9d38-3c26865a8a18 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Lock "cinder-quobyte-80bee360-fc9c-476f-9c09-638a93789e1d" released by "delete_volume" :: held 0.638s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:04:38 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-86b1f6b1-cd5c-4b80-9d38-3c26865a8a18 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Created reservations ['66a82b95-66ce-4b10-a9f3-e592211661d5', '4c714ea6-4ae9-43ae-8efe-0d1d11598a49', '116b37ee-57c2-43da-bb72-e27dd5b0230c', 'e762108e-2992-46f5-8d66-48a0c30da242'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:04:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-86b1f6b1-cd5c-4b80-9d38-3c26865a8a18 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:04:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-86b1f6b1-cd5c-4b80-9d38-3c26865a8a18 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:04:38 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-86b1f6b1-cd5c-4b80-9d38-3c26865a8a18 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:04:38 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-86b1f6b1-cd5c-4b80-9d38-3c26865a8a18 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:04:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-86b1f6b1-cd5c-4b80-9d38-3c26865a8a18 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:04:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-86b1f6b1-cd5c-4b80-9d38-3c26865a8a18 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:04:38 devstack sudo[102923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:04:38 devstack sudo[102923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:04:38 devstack sudo[102923]: pam_unix(sudo:session): session closed for user root Sep 04 18:04:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-86b1f6b1-cd5c-4b80-9d38-3c26865a8a18 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.266s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:04:38 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-86b1f6b1-cd5c-4b80-9d38-3c26865a8a18 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:04:38 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-86b1f6b1-cd5c-4b80-9d38-3c26865a8a18 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Deleted volume successfully. Sep 04 18:04:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-86b1f6b1-cd5c-4b80-9d38-3c26865a8a18 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Lock "cinder-80bee360-fc9c-476f-9c09-638a93789e1d-delete_volume" released by "delete_volume" :: held 1.098s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:04:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-492dc750-6241-496c-9a9c-2cf009c766c5 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Acquiring lock "cinder-885158e1-62ce-4e9c-93ee-56a54ff7408e-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:04:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-492dc750-6241-496c-9a9c-2cf009c766c5 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Lock "cinder-885158e1-62ce-4e9c-93ee-56a54ff7408e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:04:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-492dc750-6241-496c-9a9c-2cf009c766c5 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Acquiring lock "cinder-quobyte-885158e1-62ce-4e9c-93ee-56a54ff7408e" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:04:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-492dc750-6241-496c-9a9c-2cf009c766c5 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Lock "cinder-quobyte-885158e1-62ce-4e9c-93ee-56a54ff7408e" acquired by "delete_volume" :: waited 0.013s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:04:38 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b1968a-bb83-46c5-9dc6-b2fa89c7f926]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:04:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-492dc750-6241-496c-9a9c-2cf009c766c5 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-885158e1-62ce-4e9c-93ee-56a54ff7408e {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:04:38 devstack sudo[102926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-885158e1-62ce-4e9c-93ee-56a54ff7408e Sep 04 18:04:38 devstack sudo[102926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:04:39 devstack sudo[102926]: pam_unix(sudo:session): session closed for user root Sep 04 18:04:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-492dc750-6241-496c-9a9c-2cf009c766c5 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-885158e1-62ce-4e9c-93ee-56a54ff7408e" returned: 0 in 0.342s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:04:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-492dc750-6241-496c-9a9c-2cf009c766c5 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-885158e1-62ce-4e9c-93ee-56a54ff7408e {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:04:39 devstack sudo[102931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-885158e1-62ce-4e9c-93ee-56a54ff7408e Sep 04 18:04:39 devstack sudo[102931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:04:39 devstack sudo[102931]: pam_unix(sudo:session): session closed for user root Sep 04 18:04:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-492dc750-6241-496c-9a9c-2cf009c766c5 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-885158e1-62ce-4e9c-93ee-56a54ff7408e" returned: 0 in 0.233s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:04:39 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-492dc750-6241-496c-9a9c-2cf009c766c5 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Lock "cinder-quobyte-885158e1-62ce-4e9c-93ee-56a54ff7408e" released by "delete_volume" :: held 0.615s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:04:39 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-492dc750-6241-496c-9a9c-2cf009c766c5 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Created reservations ['90ac3caa-e95f-4e03-9f71-d2f55ee930de', '9f155d2f-0ca5-4a0f-9d83-ab797f1736c5', '0508bdbe-1e02-40ff-96c7-6dc7bf8f0784', '6736fc9b-dea2-451b-a82b-cb75a9295c73'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:04:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-492dc750-6241-496c-9a9c-2cf009c766c5 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:04:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-492dc750-6241-496c-9a9c-2cf009c766c5 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:04:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-492dc750-6241-496c-9a9c-2cf009c766c5 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:04:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-492dc750-6241-496c-9a9c-2cf009c766c5 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:04:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-492dc750-6241-496c-9a9c-2cf009c766c5 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:04:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-492dc750-6241-496c-9a9c-2cf009c766c5 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:04:39 devstack sudo[102934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:04:39 devstack sudo[102934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:04:39 devstack sudo[102934]: pam_unix(sudo:session): session closed for user root Sep 04 18:04:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-492dc750-6241-496c-9a9c-2cf009c766c5 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.238s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:04:39 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-492dc750-6241-496c-9a9c-2cf009c766c5 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:04:39 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-492dc750-6241-496c-9a9c-2cf009c766c5 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Deleted volume successfully. Sep 04 18:04:39 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-492dc750-6241-496c-9a9c-2cf009c766c5 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Lock "cinder-885158e1-62ce-4e9c-93ee-56a54ff7408e-delete_volume" released by "delete_volume" :: held 1.042s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:04:39 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ed064842-687f-4901-98c1-c5426bc79ccc tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Acquiring lock "cinder-707f017c-9968-4d95-8c9f-bf3234293407-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:04:39 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ed064842-687f-4901-98c1-c5426bc79ccc tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Lock "cinder-707f017c-9968-4d95-8c9f-bf3234293407-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:04:39 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ed064842-687f-4901-98c1-c5426bc79ccc tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Acquiring lock "cinder-quobyte-707f017c-9968-4d95-8c9f-bf3234293407" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:04:39 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ed064842-687f-4901-98c1-c5426bc79ccc tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Lock "cinder-quobyte-707f017c-9968-4d95-8c9f-bf3234293407" acquired by "delete_volume" :: waited 0.016s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:04:39 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ae3030-bf22-4e34-94f2-d64243ad2d33]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:04:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ed064842-687f-4901-98c1-c5426bc79ccc tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-707f017c-9968-4d95-8c9f-bf3234293407 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:04:40 devstack sudo[102937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-707f017c-9968-4d95-8c9f-bf3234293407 Sep 04 18:04:40 devstack sudo[102937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:04:40 devstack sudo[102937]: pam_unix(sudo:session): session closed for user root Sep 04 18:04:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ed064842-687f-4901-98c1-c5426bc79ccc tempest-CreateVolumesFromSourceVolumeTest-543632683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-707f017c-9968-4d95-8c9f-bf3234293407" returned: 0 in 0.358s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:04:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ed064842-687f-4901-98c1-c5426bc79ccc tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-707f017c-9968-4d95-8c9f-bf3234293407 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:04:40 devstack sudo[102942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-707f017c-9968-4d95-8c9f-bf3234293407 Sep 04 18:04:40 devstack sudo[102942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:04:40 devstack sudo[102942]: pam_unix(sudo:session): session closed for user root Sep 04 18:04:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ed064842-687f-4901-98c1-c5426bc79ccc tempest-CreateVolumesFromSourceVolumeTest-543632683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-707f017c-9968-4d95-8c9f-bf3234293407" returned: 0 in 0.253s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:04:40 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ed064842-687f-4901-98c1-c5426bc79ccc tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Lock "cinder-quobyte-707f017c-9968-4d95-8c9f-bf3234293407" released by "delete_volume" :: held 0.649s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:04:40 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-ed064842-687f-4901-98c1-c5426bc79ccc tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Created reservations ['3689ba25-85e7-404f-af2d-57013d60a3be', '4a36548b-4dda-4ef1-b456-83379e94ced4', '1ecd6b5a-716d-4ef1-a07b-577e544c4f43', 'b1312ded-80fd-47a1-8d16-fdeb671ac54d'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:04:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ed064842-687f-4901-98c1-c5426bc79ccc tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:04:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ed064842-687f-4901-98c1-c5426bc79ccc tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:04:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ed064842-687f-4901-98c1-c5426bc79ccc tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:04:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ed064842-687f-4901-98c1-c5426bc79ccc tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:04:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ed064842-687f-4901-98c1-c5426bc79ccc tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:04:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ed064842-687f-4901-98c1-c5426bc79ccc tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:04:40 devstack sudo[102945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:04:40 devstack sudo[102945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:04:40 devstack sudo[102945]: pam_unix(sudo:session): session closed for user root Sep 04 18:04:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ed064842-687f-4901-98c1-c5426bc79ccc tempest-CreateVolumesFromSourceVolumeTest-543632683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.253s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:04:40 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-ed064842-687f-4901-98c1-c5426bc79ccc tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:04:40 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-ed064842-687f-4901-98c1-c5426bc79ccc tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Deleted volume successfully. Sep 04 18:04:40 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ed064842-687f-4901-98c1-c5426bc79ccc tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Lock "cinder-707f017c-9968-4d95-8c9f-bf3234293407-delete_volume" released by "delete_volume" :: held 1.099s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:04:41 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d516f239-4fcc-41c4-9629-c38f664119c8 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Acquiring lock "cinder-0a19ef53-a24b-42b0-bb39-04a1d17ffcc2-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:04:41 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d516f239-4fcc-41c4-9629-c38f664119c8 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Lock "cinder-0a19ef53-a24b-42b0-bb39-04a1d17ffcc2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:04:41 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d516f239-4fcc-41c4-9629-c38f664119c8 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Acquiring lock "cinder-quobyte-0a19ef53-a24b-42b0-bb39-04a1d17ffcc2" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:04:41 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d516f239-4fcc-41c4-9629-c38f664119c8 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Lock "cinder-quobyte-0a19ef53-a24b-42b0-bb39-04a1d17ffcc2" acquired by "delete_volume" :: waited 0.016s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:04:41 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[142500a4-c902-4d82-b8fb-ef03f22cfa62]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:04:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d516f239-4fcc-41c4-9629-c38f664119c8 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0a19ef53-a24b-42b0-bb39-04a1d17ffcc2 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:04:41 devstack sudo[102948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0a19ef53-a24b-42b0-bb39-04a1d17ffcc2 Sep 04 18:04:41 devstack sudo[102948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:04:41 devstack sudo[102948]: pam_unix(sudo:session): session closed for user root Sep 04 18:04:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d516f239-4fcc-41c4-9629-c38f664119c8 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0a19ef53-a24b-42b0-bb39-04a1d17ffcc2" returned: 0 in 0.369s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:04:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d516f239-4fcc-41c4-9629-c38f664119c8 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0a19ef53-a24b-42b0-bb39-04a1d17ffcc2 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:04:41 devstack sudo[102953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0a19ef53-a24b-42b0-bb39-04a1d17ffcc2 Sep 04 18:04:41 devstack sudo[102953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:04:41 devstack sudo[102953]: pam_unix(sudo:session): session closed for user root Sep 04 18:04:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d516f239-4fcc-41c4-9629-c38f664119c8 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0a19ef53-a24b-42b0-bb39-04a1d17ffcc2" returned: 0 in 0.250s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:04:41 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d516f239-4fcc-41c4-9629-c38f664119c8 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Lock "cinder-quobyte-0a19ef53-a24b-42b0-bb39-04a1d17ffcc2" released by "delete_volume" :: held 0.669s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:04:41 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-d516f239-4fcc-41c4-9629-c38f664119c8 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Created reservations ['3bf6ac24-db3f-4dd6-8a86-ae64a0673d42', '97a0d21f-2935-497c-923b-29e642dc66e2', 'd55fd90d-7441-4d60-8d6b-6de5f880ad7b', 'a69b0ebd-8fe4-4c3c-94a6-3d69caff6d8b'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:04:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d516f239-4fcc-41c4-9629-c38f664119c8 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:04:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d516f239-4fcc-41c4-9629-c38f664119c8 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:04:41 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d516f239-4fcc-41c4-9629-c38f664119c8 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:04:41 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d516f239-4fcc-41c4-9629-c38f664119c8 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:04:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d516f239-4fcc-41c4-9629-c38f664119c8 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:04:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d516f239-4fcc-41c4-9629-c38f664119c8 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:04:41 devstack sudo[102956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:04:41 devstack sudo[102956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:04:42 devstack sudo[102956]: pam_unix(sudo:session): session closed for user root Sep 04 18:04:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d516f239-4fcc-41c4-9629-c38f664119c8 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.271s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:04:42 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-d516f239-4fcc-41c4-9629-c38f664119c8 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:04:42 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-d516f239-4fcc-41c4-9629-c38f664119c8 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Deleted volume successfully. Sep 04 18:04:42 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d516f239-4fcc-41c4-9629-c38f664119c8 tempest-CreateVolumesFromSourceVolumeTest-543632683 None] Lock "cinder-0a19ef53-a24b-42b0-bb39-04a1d17ffcc2-delete_volume" released by "delete_volume" :: held 1.149s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:04:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-0aa3be6e-6500-4e48-b54b-4609736aa536 req-42c0a8af-b95d-4622-b7d8-239c3264a9f7 tempest-TestServerVolumeAttachmentScenario-1350945788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:04:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-0aa3be6e-6500-4e48-b54b-4609736aa536 req-42c0a8af-b95d-4622-b7d8-239c3264a9f7 tempest-TestServerVolumeAttachmentScenario-1350945788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:04:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-0aa3be6e-6500-4e48-b54b-4609736aa536 req-42c0a8af-b95d-4622-b7d8-239c3264a9f7 tempest-TestServerVolumeAttachmentScenario-1350945788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:04:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-0aa3be6e-6500-4e48-b54b-4609736aa536 req-42c0a8af-b95d-4622-b7d8-239c3264a9f7 tempest-TestServerVolumeAttachmentScenario-1350945788 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a', 'name': 'volume-27e9a55e-6b50-4076-a782-2ee6e103f7b6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '59408099-cd41-4ed0-93fd-7cfd963f43b8', 'enforce_multipath': True} {{(pid=87314) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 18:04:46 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-0aa3be6e-6500-4e48-b54b-4609736aa536 req-42c0a8af-b95d-4622-b7d8-239c3264a9f7 tempest-TestServerVolumeAttachmentScenario-1350945788 None] attachment_update completed successfully. Sep 04 18:04:50 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-c23a0efb-45cf-49d5-af46-64e9e7f993b4 tempest-ProjectReaderTests-639086552 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:04:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c23a0efb-45cf-49d5-af46-64e9e7f993b4 tempest-ProjectReaderTests-639086552 None] Flow 'volume_create_manager' (94e9dc18-aa09-4f09-b161-bcb4ab63de8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:04:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c23a0efb-45cf-49d5-af46-64e9e7f993b4 tempest-ProjectReaderTests-639086552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (445aec7b-6a74-4cd1-9559-476c7f7a75bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c23a0efb-45cf-49d5-af46-64e9e7f993b4 tempest-ProjectReaderTests-639086552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (445aec7b-6a74-4cd1-9559-476c7f7a75bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2102828873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4542def0-e05d-4e78-be10-7f8c565cd558,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83ac3b05eb214a59be28fbca1272d810',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:04:50Z,use_quota=True,user_id='f4b173919ae0468eafac52e710a24e1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c23a0efb-45cf-49d5-af46-64e9e7f993b4 tempest-ProjectReaderTests-639086552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3444498b-56cf-4bae-b6c1-e5d1d12afddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c23a0efb-45cf-49d5-af46-64e9e7f993b4 tempest-ProjectReaderTests-639086552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3444498b-56cf-4bae-b6c1-e5d1d12afddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c23a0efb-45cf-49d5-af46-64e9e7f993b4 tempest-ProjectReaderTests-639086552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f13c1ad-0e0d-43ea-b2b5-43755fad6185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c23a0efb-45cf-49d5-af46-64e9e7f993b4 tempest-ProjectReaderTests-639086552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f13c1ad-0e0d-43ea-b2b5-43755fad6185) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4542def0-e05d-4e78-be10-7f8c565cd558', 'volume_name': 'volume-4542def0-e05d-4e78-be10-7f8c565cd558', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c23a0efb-45cf-49d5-af46-64e9e7f993b4 tempest-ProjectReaderTests-639086552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea228e69-5a92-4b0d-9655-9713aa45e220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c23a0efb-45cf-49d5-af46-64e9e7f993b4 tempest-ProjectReaderTests-639086552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea228e69-5a92-4b0d-9655-9713aa45e220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:50 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c23a0efb-45cf-49d5-af46-64e9e7f993b4 tempest-ProjectReaderTests-639086552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97d444aa-3ce5-4bca-a924-cd2edbf575e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:50 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-c23a0efb-45cf-49d5-af46-64e9e7f993b4 tempest-ProjectReaderTests-639086552 None] Volume 4542def0-e05d-4e78-be10-7f8c565cd558: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4542def0-e05d-4e78-be10-7f8c565cd558', 'volume_size': 1} Sep 04 18:04:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c23a0efb-45cf-49d5-af46-64e9e7f993b4 tempest-ProjectReaderTests-639086552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:04:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c23a0efb-45cf-49d5-af46-64e9e7f993b4 tempest-ProjectReaderTests-639086552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:04:50 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c23a0efb-45cf-49d5-af46-64e9e7f993b4 tempest-ProjectReaderTests-639086552 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2102828873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4542def0-e05d-4e78-be10-7f8c565cd558,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83ac3b05eb214a59be28fbca1272d810',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:04:50Z,use_quota=True,user_id='f4b173919ae0468eafac52e710a24e1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:04:50 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-c23a0efb-45cf-49d5-af46-64e9e7f993b4 tempest-ProjectReaderTests-639086552 None] Creating volume 4542def0-e05d-4e78-be10-7f8c565cd558 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:04:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c23a0efb-45cf-49d5-af46-64e9e7f993b4 tempest-ProjectReaderTests-639086552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:04:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c23a0efb-45cf-49d5-af46-64e9e7f993b4 tempest-ProjectReaderTests-639086552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:04:50 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c23a0efb-45cf-49d5-af46-64e9e7f993b4 tempest-ProjectReaderTests-639086552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:04:50 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c23a0efb-45cf-49d5-af46-64e9e7f993b4 tempest-ProjectReaderTests-639086552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:04:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c23a0efb-45cf-49d5-af46-64e9e7f993b4 tempest-ProjectReaderTests-639086552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:04:50 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c23a0efb-45cf-49d5-af46-64e9e7f993b4 tempest-ProjectReaderTests-639086552 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:04:50 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-c23a0efb-45cf-49d5-af46-64e9e7f993b4 tempest-ProjectReaderTests-639086552 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:04:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c23a0efb-45cf-49d5-af46-64e9e7f993b4 tempest-ProjectReaderTests-639086552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4542def0-e05d-4e78-be10-7f8c565cd558 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:04:50 devstack sudo[103391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4542def0-e05d-4e78-be10-7f8c565cd558 1073741824 Sep 04 18:04:50 devstack sudo[103391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:04:51 devstack sudo[103391]: pam_unix(sudo:session): session closed for user root Sep 04 18:04:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c23a0efb-45cf-49d5-af46-64e9e7f993b4 tempest-ProjectReaderTests-639086552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4542def0-e05d-4e78-be10-7f8c565cd558 1073741824" returned: 0 in 0.480s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:04:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c23a0efb-45cf-49d5-af46-64e9e7f993b4 tempest-ProjectReaderTests-639086552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4542def0-e05d-4e78-be10-7f8c565cd558 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:04:51 devstack sudo[103402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4542def0-e05d-4e78-be10-7f8c565cd558 Sep 04 18:04:51 devstack sudo[103402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:04:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-1fa51165-d4e9-45a3-8937-f34bf22e6523 req-d7dbfd57-0b8d-4907-b5b3-7f7333f12856 tempest-TestServerVolumeAttachmentScenario-1350945788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:04:51 devstack sudo[103402]: pam_unix(sudo:session): session closed for user root Sep 04 18:04:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c23a0efb-45cf-49d5-af46-64e9e7f993b4 tempest-ProjectReaderTests-639086552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4542def0-e05d-4e78-be10-7f8c565cd558" returned: 0 in 0.245s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:04:51 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c23a0efb-45cf-49d5-af46-64e9e7f993b4 tempest-ProjectReaderTests-639086552 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:04:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c23a0efb-45cf-49d5-af46-64e9e7f993b4 tempest-ProjectReaderTests-639086552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:04:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-1fa51165-d4e9-45a3-8937-f34bf22e6523 req-d7dbfd57-0b8d-4907-b5b3-7f7333f12856 tempest-TestServerVolumeAttachmentScenario-1350945788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.058s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:04:51 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c23a0efb-45cf-49d5-af46-64e9e7f993b4 tempest-ProjectReaderTests-639086552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97d444aa-3ce5-4bca-a924-cd2edbf575e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4542def0-e05d-4e78-be10-7f8c565cd558', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:51 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c23a0efb-45cf-49d5-af46-64e9e7f993b4 tempest-ProjectReaderTests-639086552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff0e31bd-ef01-4364-8d3a-beda1d09ef10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-1fa51165-d4e9-45a3-8937-f34bf22e6523 req-d7dbfd57-0b8d-4907-b5b3-7f7333f12856 tempest-TestServerVolumeAttachmentScenario-1350945788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:04:51 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-c23a0efb-45cf-49d5-af46-64e9e7f993b4 tempest-ProjectReaderTests-639086552 None] Volume volume-4542def0-e05d-4e78-be10-7f8c565cd558 (4542def0-e05d-4e78-be10-7f8c565cd558): created successfully Sep 04 18:04:51 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c23a0efb-45cf-49d5-af46-64e9e7f993b4 tempest-ProjectReaderTests-639086552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff0e31bd-ef01-4364-8d3a-beda1d09ef10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:51 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c23a0efb-45cf-49d5-af46-64e9e7f993b4 tempest-ProjectReaderTests-639086552 None] Flow 'volume_create_manager' (94e9dc18-aa09-4f09-b161-bcb4ab63de8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:04:51 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-c23a0efb-45cf-49d5-af46-64e9e7f993b4 tempest-ProjectReaderTests-639086552 None] Created volume successfully. Sep 04 18:04:51 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-1fa51165-d4e9-45a3-8937-f34bf22e6523 req-d7dbfd57-0b8d-4907-b5b3-7f7333f12856 tempest-TestServerVolumeAttachmentScenario-1350945788 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a', 'name': 'volume-016d0503-b59b-49d0-8e25-204e76541a41', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b0b41109-b29b-4cfe-8ca6-1be300586399', 'enforce_multipath': True} {{(pid=87314) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 18:04:51 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-1fa51165-d4e9-45a3-8937-f34bf22e6523 req-d7dbfd57-0b8d-4907-b5b3-7f7333f12856 tempest-TestServerVolumeAttachmentScenario-1350945788 None] attachment_update completed successfully. Sep 04 18:04:51 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-cb9359b0-4649-4f5b-bbe8-3739e9597b07 tempest-ProjectReaderTests-639086552 None] Acquiring lock "cinder-4542def0-e05d-4e78-be10-7f8c565cd558-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:04:51 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-cb9359b0-4649-4f5b-bbe8-3739e9597b07 tempest-ProjectReaderTests-639086552 None] Lock "cinder-4542def0-e05d-4e78-be10-7f8c565cd558-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:04:51 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-cb9359b0-4649-4f5b-bbe8-3739e9597b07 tempest-ProjectReaderTests-639086552 None] Acquiring lock "cinder-quobyte-4542def0-e05d-4e78-be10-7f8c565cd558" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:04:51 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-cb9359b0-4649-4f5b-bbe8-3739e9597b07 tempest-ProjectReaderTests-639086552 None] Lock "cinder-quobyte-4542def0-e05d-4e78-be10-7f8c565cd558" acquired by "delete_volume" :: waited 0.029s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:04:51 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[186da95d-ba1c-4225-8a4c-d712caed0fe4]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:04:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cb9359b0-4649-4f5b-bbe8-3739e9597b07 tempest-ProjectReaderTests-639086552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4542def0-e05d-4e78-be10-7f8c565cd558 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:04:51 devstack sudo[103413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4542def0-e05d-4e78-be10-7f8c565cd558 Sep 04 18:04:51 devstack sudo[103413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:04:52 devstack sudo[103413]: pam_unix(sudo:session): session closed for user root Sep 04 18:04:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cb9359b0-4649-4f5b-bbe8-3739e9597b07 tempest-ProjectReaderTests-639086552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4542def0-e05d-4e78-be10-7f8c565cd558" returned: 0 in 0.388s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:04:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cb9359b0-4649-4f5b-bbe8-3739e9597b07 tempest-ProjectReaderTests-639086552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4542def0-e05d-4e78-be10-7f8c565cd558 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:04:52 devstack sudo[103418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4542def0-e05d-4e78-be10-7f8c565cd558 Sep 04 18:04:52 devstack sudo[103418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:04:52 devstack sudo[103418]: pam_unix(sudo:session): session closed for user root Sep 04 18:04:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cb9359b0-4649-4f5b-bbe8-3739e9597b07 tempest-ProjectReaderTests-639086552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4542def0-e05d-4e78-be10-7f8c565cd558" returned: 0 in 0.244s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:04:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-cb9359b0-4649-4f5b-bbe8-3739e9597b07 tempest-ProjectReaderTests-639086552 None] Lock "cinder-quobyte-4542def0-e05d-4e78-be10-7f8c565cd558" released by "delete_volume" :: held 0.693s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:04:52 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-cb9359b0-4649-4f5b-bbe8-3739e9597b07 tempest-ProjectReaderTests-639086552 None] Created reservations ['5b4b09fc-3241-415a-a7db-af2497d66a5b', '13112cd8-19ab-4186-b939-2f8e91254393', '37bd8a6e-dda8-4bb9-894c-06fb119ecae8', '4b337f8a-f04e-4800-a6d7-a3902334003a'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:04:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-cb9359b0-4649-4f5b-bbe8-3739e9597b07 tempest-ProjectReaderTests-639086552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:04:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-cb9359b0-4649-4f5b-bbe8-3739e9597b07 tempest-ProjectReaderTests-639086552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:04:52 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-cb9359b0-4649-4f5b-bbe8-3739e9597b07 tempest-ProjectReaderTests-639086552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:04:52 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-cb9359b0-4649-4f5b-bbe8-3739e9597b07 tempest-ProjectReaderTests-639086552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:04:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-cb9359b0-4649-4f5b-bbe8-3739e9597b07 tempest-ProjectReaderTests-639086552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:04:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cb9359b0-4649-4f5b-bbe8-3739e9597b07 tempest-ProjectReaderTests-639086552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:04:52 devstack sudo[103421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:04:52 devstack sudo[103421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:04:52 devstack sudo[103421]: pam_unix(sudo:session): session closed for user root Sep 04 18:04:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-cb9359b0-4649-4f5b-bbe8-3739e9597b07 tempest-ProjectReaderTests-639086552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.244s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:04:52 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-cb9359b0-4649-4f5b-bbe8-3739e9597b07 tempest-ProjectReaderTests-639086552 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:04:52 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-cb9359b0-4649-4f5b-bbe8-3739e9597b07 tempest-ProjectReaderTests-639086552 None] Deleted volume successfully. Sep 04 18:04:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-cb9359b0-4649-4f5b-bbe8-3739e9597b07 tempest-ProjectReaderTests-639086552 None] Lock "cinder-4542def0-e05d-4e78-be10-7f8c565cd558-delete_volume" released by "delete_volume" :: held 1.152s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:04:53 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2ab34eb-a57a-4c5c-8d80-2a249cac212d tempest-ProjectReaderTests-639086552 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:04:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c2ab34eb-a57a-4c5c-8d80-2a249cac212d tempest-ProjectReaderTests-639086552 None] Flow 'volume_create_manager' (2b5ab49a-c32e-4053-81e5-83bc5ce8707f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:04:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c2ab34eb-a57a-4c5c-8d80-2a249cac212d tempest-ProjectReaderTests-639086552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06c222e0-9ee4-4cda-9922-3864037c442f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c2ab34eb-a57a-4c5c-8d80-2a249cac212d tempest-ProjectReaderTests-639086552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06c222e0-9ee4-4cda-9922-3864037c442f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:04:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1621874534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c0cb04b-65d0-4367-b671-aaa847f29209,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83ac3b05eb214a59be28fbca1272d810',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:04:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:04:53Z,use_quota=True,user_id='f4b173919ae0468eafac52e710a24e1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c2ab34eb-a57a-4c5c-8d80-2a249cac212d tempest-ProjectReaderTests-639086552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c5b3464-8056-4c26-b2e8-84a9e72908ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c2ab34eb-a57a-4c5c-8d80-2a249cac212d tempest-ProjectReaderTests-639086552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c5b3464-8056-4c26-b2e8-84a9e72908ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c2ab34eb-a57a-4c5c-8d80-2a249cac212d tempest-ProjectReaderTests-639086552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01600488-f8d2-4148-8739-dec8c2e70608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c2ab34eb-a57a-4c5c-8d80-2a249cac212d tempest-ProjectReaderTests-639086552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01600488-f8d2-4148-8739-dec8c2e70608) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c0cb04b-65d0-4367-b671-aaa847f29209', 'volume_name': 'volume-8c0cb04b-65d0-4367-b671-aaa847f29209', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c2ab34eb-a57a-4c5c-8d80-2a249cac212d tempest-ProjectReaderTests-639086552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f421ccd-95d3-4516-b97b-413235950946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c2ab34eb-a57a-4c5c-8d80-2a249cac212d tempest-ProjectReaderTests-639086552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f421ccd-95d3-4516-b97b-413235950946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c2ab34eb-a57a-4c5c-8d80-2a249cac212d tempest-ProjectReaderTests-639086552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aa32d0c-d70d-4287-b3ad-00174258bada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:53 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-c2ab34eb-a57a-4c5c-8d80-2a249cac212d tempest-ProjectReaderTests-639086552 None] Volume 8c0cb04b-65d0-4367-b671-aaa847f29209: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c0cb04b-65d0-4367-b671-aaa847f29209', 'volume_size': 1} Sep 04 18:04:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c2ab34eb-a57a-4c5c-8d80-2a249cac212d tempest-ProjectReaderTests-639086552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:04:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c2ab34eb-a57a-4c5c-8d80-2a249cac212d tempest-ProjectReaderTests-639086552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:04:53 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c2ab34eb-a57a-4c5c-8d80-2a249cac212d tempest-ProjectReaderTests-639086552 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:04:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1621874534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c0cb04b-65d0-4367-b671-aaa847f29209,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83ac3b05eb214a59be28fbca1272d810',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:04:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:04:53Z,use_quota=True,user_id='f4b173919ae0468eafac52e710a24e1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:04:53 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-c2ab34eb-a57a-4c5c-8d80-2a249cac212d tempest-ProjectReaderTests-639086552 None] Creating volume 8c0cb04b-65d0-4367-b671-aaa847f29209 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:04:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c2ab34eb-a57a-4c5c-8d80-2a249cac212d tempest-ProjectReaderTests-639086552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:04:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c2ab34eb-a57a-4c5c-8d80-2a249cac212d tempest-ProjectReaderTests-639086552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:04:53 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c2ab34eb-a57a-4c5c-8d80-2a249cac212d tempest-ProjectReaderTests-639086552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:04:53 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c2ab34eb-a57a-4c5c-8d80-2a249cac212d tempest-ProjectReaderTests-639086552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:04:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c2ab34eb-a57a-4c5c-8d80-2a249cac212d tempest-ProjectReaderTests-639086552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:04:53 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c2ab34eb-a57a-4c5c-8d80-2a249cac212d tempest-ProjectReaderTests-639086552 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:04:53 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-c2ab34eb-a57a-4c5c-8d80-2a249cac212d tempest-ProjectReaderTests-639086552 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:04:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c2ab34eb-a57a-4c5c-8d80-2a249cac212d tempest-ProjectReaderTests-639086552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8c0cb04b-65d0-4367-b671-aaa847f29209 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:04:53 devstack sudo[103424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8c0cb04b-65d0-4367-b671-aaa847f29209 1073741824 Sep 04 18:04:53 devstack sudo[103424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:04:53 devstack sudo[103424]: pam_unix(sudo:session): session closed for user root Sep 04 18:04:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c2ab34eb-a57a-4c5c-8d80-2a249cac212d tempest-ProjectReaderTests-639086552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8c0cb04b-65d0-4367-b671-aaa847f29209 1073741824" returned: 0 in 0.462s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:04:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c2ab34eb-a57a-4c5c-8d80-2a249cac212d tempest-ProjectReaderTests-639086552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8c0cb04b-65d0-4367-b671-aaa847f29209 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:04:53 devstack sudo[103431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8c0cb04b-65d0-4367-b671-aaa847f29209 Sep 04 18:04:53 devstack sudo[103431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:04:53 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-ec569d5f-f743-4298-8833-df00744502ef req-9f83a6e7-d086-48a0-bbb1-5a046b14006b tempest-TestServerVolumeAttachmentScenario-1350945788 None] Terminate volume connection completed successfully. Sep 04 18:04:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-ec569d5f-f743-4298-8833-df00744502ef req-9f83a6e7-d086-48a0-bbb1-5a046b14006b tempest-TestServerVolumeAttachmentScenario-1350945788 None] Deleting attachment b0b41109-b29b-4cfe-8ca6-1be300586399. {{(pid=87314) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 18:04:54 devstack sudo[103431]: pam_unix(sudo:session): session closed for user root Sep 04 18:04:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c2ab34eb-a57a-4c5c-8d80-2a249cac212d tempest-ProjectReaderTests-639086552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8c0cb04b-65d0-4367-b671-aaa847f29209" returned: 0 in 0.255s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:04:54 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c2ab34eb-a57a-4c5c-8d80-2a249cac212d tempest-ProjectReaderTests-639086552 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:04:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c2ab34eb-a57a-4c5c-8d80-2a249cac212d tempest-ProjectReaderTests-639086552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:04:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c2ab34eb-a57a-4c5c-8d80-2a249cac212d tempest-ProjectReaderTests-639086552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aa32d0c-d70d-4287-b3ad-00174258bada) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c0cb04b-65d0-4367-b671-aaa847f29209', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c2ab34eb-a57a-4c5c-8d80-2a249cac212d tempest-ProjectReaderTests-639086552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e226f61b-2f5c-4a50-87cb-d533b44e76de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:54 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-c2ab34eb-a57a-4c5c-8d80-2a249cac212d tempest-ProjectReaderTests-639086552 None] Volume volume-8c0cb04b-65d0-4367-b671-aaa847f29209 (8c0cb04b-65d0-4367-b671-aaa847f29209): created successfully Sep 04 18:04:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c2ab34eb-a57a-4c5c-8d80-2a249cac212d tempest-ProjectReaderTests-639086552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e226f61b-2f5c-4a50-87cb-d533b44e76de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c2ab34eb-a57a-4c5c-8d80-2a249cac212d tempest-ProjectReaderTests-639086552 None] Flow 'volume_create_manager' (2b5ab49a-c32e-4053-81e5-83bc5ce8707f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:04:54 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-c2ab34eb-a57a-4c5c-8d80-2a249cac212d tempest-ProjectReaderTests-639086552 None] Created volume successfully. Sep 04 18:04:54 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e2af5464-dfd4-448d-861e-4238a653712d tempest-ProjectReaderTests-639086552 None] Acquiring lock "cinder-8c0cb04b-65d0-4367-b671-aaa847f29209-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:04:54 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e2af5464-dfd4-448d-861e-4238a653712d tempest-ProjectReaderTests-639086552 None] Lock "cinder-8c0cb04b-65d0-4367-b671-aaa847f29209-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:04:54 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e2af5464-dfd4-448d-861e-4238a653712d tempest-ProjectReaderTests-639086552 None] Acquiring lock "cinder-quobyte-8c0cb04b-65d0-4367-b671-aaa847f29209" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:04:54 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e2af5464-dfd4-448d-861e-4238a653712d tempest-ProjectReaderTests-639086552 None] Lock "cinder-quobyte-8c0cb04b-65d0-4367-b671-aaa847f29209" acquired by "delete_volume" :: waited 0.016s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:04:54 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0936f7-4f2e-449f-ba93-f7e82440a365]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:04:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e2af5464-dfd4-448d-861e-4238a653712d tempest-ProjectReaderTests-639086552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8c0cb04b-65d0-4367-b671-aaa847f29209 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:04:54 devstack sudo[103436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8c0cb04b-65d0-4367-b671-aaa847f29209 Sep 04 18:04:54 devstack sudo[103436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:04:54 devstack sudo[103436]: pam_unix(sudo:session): session closed for user root Sep 04 18:04:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e2af5464-dfd4-448d-861e-4238a653712d tempest-ProjectReaderTests-639086552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8c0cb04b-65d0-4367-b671-aaa847f29209" returned: 0 in 0.355s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:04:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e2af5464-dfd4-448d-861e-4238a653712d tempest-ProjectReaderTests-639086552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8c0cb04b-65d0-4367-b671-aaa847f29209 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:04:54 devstack sudo[103442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8c0cb04b-65d0-4367-b671-aaa847f29209 Sep 04 18:04:54 devstack sudo[103442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:04:55 devstack sudo[103442]: pam_unix(sudo:session): session closed for user root Sep 04 18:04:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e2af5464-dfd4-448d-861e-4238a653712d tempest-ProjectReaderTests-639086552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-8c0cb04b-65d0-4367-b671-aaa847f29209" returned: 0 in 0.251s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:04:55 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e2af5464-dfd4-448d-861e-4238a653712d tempest-ProjectReaderTests-639086552 None] Lock "cinder-quobyte-8c0cb04b-65d0-4367-b671-aaa847f29209" released by "delete_volume" :: held 0.648s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:04:55 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-e2af5464-dfd4-448d-861e-4238a653712d tempest-ProjectReaderTests-639086552 None] Created reservations ['62a2a225-3285-4de5-bff5-5da228c6e93e', 'e2987804-a060-4a76-9d7d-4eb5260adb38', '0940ac24-643d-487d-8393-e4ada7e94dc5', '8696766b-89af-4367-87fc-6f12479fcee9'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:04:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e2af5464-dfd4-448d-861e-4238a653712d tempest-ProjectReaderTests-639086552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:04:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e2af5464-dfd4-448d-861e-4238a653712d tempest-ProjectReaderTests-639086552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:04:55 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e2af5464-dfd4-448d-861e-4238a653712d tempest-ProjectReaderTests-639086552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:04:55 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e2af5464-dfd4-448d-861e-4238a653712d tempest-ProjectReaderTests-639086552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:04:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e2af5464-dfd4-448d-861e-4238a653712d tempest-ProjectReaderTests-639086552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:04:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e2af5464-dfd4-448d-861e-4238a653712d tempest-ProjectReaderTests-639086552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:04:55 devstack sudo[103445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:04:55 devstack sudo[103445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:04:55 devstack sudo[103445]: pam_unix(sudo:session): session closed for user root Sep 04 18:04:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e2af5464-dfd4-448d-861e-4238a653712d tempest-ProjectReaderTests-639086552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.252s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:04:55 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-e2af5464-dfd4-448d-861e-4238a653712d tempest-ProjectReaderTests-639086552 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:04:55 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-e2af5464-dfd4-448d-861e-4238a653712d tempest-ProjectReaderTests-639086552 None] Deleted volume successfully. Sep 04 18:04:55 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e2af5464-dfd4-448d-861e-4238a653712d tempest-ProjectReaderTests-639086552 None] Lock "cinder-8c0cb04b-65d0-4367-b671-aaa847f29209-delete_volume" released by "delete_volume" :: held 1.138s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:04:55 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-3dbb93e2-8b14-4481-a9fd-bd2a13933b19 req-5e6f4ac6-4737-4c02-b38a-f2cbe46c7c87 tempest-TestServerVolumeAttachmentScenario-1350945788 None] Terminate volume connection completed successfully. Sep 04 18:04:55 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-3dbb93e2-8b14-4481-a9fd-bd2a13933b19 req-5e6f4ac6-4737-4c02-b38a-f2cbe46c7c87 tempest-TestServerVolumeAttachmentScenario-1350945788 None] Deleting attachment 59408099-cd41-4ed0-93fd-7cfd963f43b8. {{(pid=87314) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 18:04:55 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c2e9d5e-90cd-4d14-9118-1cf8979570be tempest-ProjectReaderTests-639086552 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:04:55 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9c2e9d5e-90cd-4d14-9118-1cf8979570be tempest-ProjectReaderTests-639086552 None] Flow 'volume_create_manager' (8dd7e2f1-e1dd-4e80-82e6-f0ff0017c55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:04:55 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9c2e9d5e-90cd-4d14-9118-1cf8979570be tempest-ProjectReaderTests-639086552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8040b2c6-f22f-418a-ba98-01b99dc34bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9c2e9d5e-90cd-4d14-9118-1cf8979570be tempest-ProjectReaderTests-639086552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8040b2c6-f22f-418a-ba98-01b99dc34bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:04:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1415669022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9fe56ef-dc0b-4991-af04-300d46cbc0c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83ac3b05eb214a59be28fbca1272d810',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:04:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:04:56Z,use_quota=True,user_id='f4b173919ae0468eafac52e710a24e1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9c2e9d5e-90cd-4d14-9118-1cf8979570be tempest-ProjectReaderTests-639086552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2b47b69-3c08-4d35-b4d4-fc5028abc056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9c2e9d5e-90cd-4d14-9118-1cf8979570be tempest-ProjectReaderTests-639086552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2b47b69-3c08-4d35-b4d4-fc5028abc056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9c2e9d5e-90cd-4d14-9118-1cf8979570be tempest-ProjectReaderTests-639086552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed58546e-ab82-49c9-9fe3-dafa074de9f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9c2e9d5e-90cd-4d14-9118-1cf8979570be tempest-ProjectReaderTests-639086552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed58546e-ab82-49c9-9fe3-dafa074de9f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9fe56ef-dc0b-4991-af04-300d46cbc0c4', 'volume_name': 'volume-b9fe56ef-dc0b-4991-af04-300d46cbc0c4', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9c2e9d5e-90cd-4d14-9118-1cf8979570be tempest-ProjectReaderTests-639086552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (526c7689-9c58-42b2-a92f-e6ab9f7275cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9c2e9d5e-90cd-4d14-9118-1cf8979570be tempest-ProjectReaderTests-639086552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (526c7689-9c58-42b2-a92f-e6ab9f7275cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9c2e9d5e-90cd-4d14-9118-1cf8979570be tempest-ProjectReaderTests-639086552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f6fa826-8585-4e2e-b8a7-6051d02ea9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:56 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-9c2e9d5e-90cd-4d14-9118-1cf8979570be tempest-ProjectReaderTests-639086552 None] Volume b9fe56ef-dc0b-4991-af04-300d46cbc0c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9fe56ef-dc0b-4991-af04-300d46cbc0c4', 'volume_size': 1} Sep 04 18:04:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9c2e9d5e-90cd-4d14-9118-1cf8979570be tempest-ProjectReaderTests-639086552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:04:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9c2e9d5e-90cd-4d14-9118-1cf8979570be tempest-ProjectReaderTests-639086552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:04:56 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9c2e9d5e-90cd-4d14-9118-1cf8979570be tempest-ProjectReaderTests-639086552 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:04:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1415669022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9fe56ef-dc0b-4991-af04-300d46cbc0c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83ac3b05eb214a59be28fbca1272d810',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:04:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:04:56Z,use_quota=True,user_id='f4b173919ae0468eafac52e710a24e1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:04:56 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-9c2e9d5e-90cd-4d14-9118-1cf8979570be tempest-ProjectReaderTests-639086552 None] Creating volume b9fe56ef-dc0b-4991-af04-300d46cbc0c4 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:04:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9c2e9d5e-90cd-4d14-9118-1cf8979570be tempest-ProjectReaderTests-639086552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:04:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9c2e9d5e-90cd-4d14-9118-1cf8979570be tempest-ProjectReaderTests-639086552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:04:56 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9c2e9d5e-90cd-4d14-9118-1cf8979570be tempest-ProjectReaderTests-639086552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:04:56 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9c2e9d5e-90cd-4d14-9118-1cf8979570be tempest-ProjectReaderTests-639086552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:04:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9c2e9d5e-90cd-4d14-9118-1cf8979570be tempest-ProjectReaderTests-639086552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:04:56 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9c2e9d5e-90cd-4d14-9118-1cf8979570be tempest-ProjectReaderTests-639086552 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:04:56 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-9c2e9d5e-90cd-4d14-9118-1cf8979570be tempest-ProjectReaderTests-639086552 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:04:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9c2e9d5e-90cd-4d14-9118-1cf8979570be tempest-ProjectReaderTests-639086552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b9fe56ef-dc0b-4991-af04-300d46cbc0c4 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:04:56 devstack sudo[103475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b9fe56ef-dc0b-4991-af04-300d46cbc0c4 1073741824 Sep 04 18:04:56 devstack sudo[103475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:04:56 devstack sudo[103475]: pam_unix(sudo:session): session closed for user root Sep 04 18:04:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9c2e9d5e-90cd-4d14-9118-1cf8979570be tempest-ProjectReaderTests-639086552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b9fe56ef-dc0b-4991-af04-300d46cbc0c4 1073741824" returned: 0 in 0.428s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:04:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9c2e9d5e-90cd-4d14-9118-1cf8979570be tempest-ProjectReaderTests-639086552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b9fe56ef-dc0b-4991-af04-300d46cbc0c4 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:04:56 devstack sudo[103481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b9fe56ef-dc0b-4991-af04-300d46cbc0c4 Sep 04 18:04:56 devstack sudo[103481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:04:56 devstack sudo[103481]: pam_unix(sudo:session): session closed for user root Sep 04 18:04:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9c2e9d5e-90cd-4d14-9118-1cf8979570be tempest-ProjectReaderTests-639086552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b9fe56ef-dc0b-4991-af04-300d46cbc0c4" returned: 0 in 0.317s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:04:56 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9c2e9d5e-90cd-4d14-9118-1cf8979570be tempest-ProjectReaderTests-639086552 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:04:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9c2e9d5e-90cd-4d14-9118-1cf8979570be tempest-ProjectReaderTests-639086552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:04:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9c2e9d5e-90cd-4d14-9118-1cf8979570be tempest-ProjectReaderTests-639086552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f6fa826-8585-4e2e-b8a7-6051d02ea9dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9fe56ef-dc0b-4991-af04-300d46cbc0c4', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9c2e9d5e-90cd-4d14-9118-1cf8979570be tempest-ProjectReaderTests-639086552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64d48910-8910-4197-b279-bf18ba1cc877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:56 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-9c2e9d5e-90cd-4d14-9118-1cf8979570be tempest-ProjectReaderTests-639086552 None] Volume volume-b9fe56ef-dc0b-4991-af04-300d46cbc0c4 (b9fe56ef-dc0b-4991-af04-300d46cbc0c4): created successfully Sep 04 18:04:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9c2e9d5e-90cd-4d14-9118-1cf8979570be tempest-ProjectReaderTests-639086552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64d48910-8910-4197-b279-bf18ba1cc877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:56 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9c2e9d5e-90cd-4d14-9118-1cf8979570be tempest-ProjectReaderTests-639086552 None] Flow 'volume_create_manager' (8dd7e2f1-e1dd-4e80-82e6-f0ff0017c55c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:04:57 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-9c2e9d5e-90cd-4d14-9118-1cf8979570be tempest-ProjectReaderTests-639086552 None] Created volume successfully. Sep 04 18:04:58 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0c199905-846a-4c57-978e-67a33b2f2e32 tempest-ProjectReaderTests-639086552 None] Acquiring lock "cinder-b9fe56ef-dc0b-4991-af04-300d46cbc0c4-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:04:58 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0c199905-846a-4c57-978e-67a33b2f2e32 tempest-ProjectReaderTests-639086552 None] Lock "cinder-b9fe56ef-dc0b-4991-af04-300d46cbc0c4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:04:58 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0c199905-846a-4c57-978e-67a33b2f2e32 tempest-ProjectReaderTests-639086552 None] Acquiring lock "cinder-quobyte-b9fe56ef-dc0b-4991-af04-300d46cbc0c4" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:04:58 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0c199905-846a-4c57-978e-67a33b2f2e32 tempest-ProjectReaderTests-639086552 None] Lock "cinder-quobyte-b9fe56ef-dc0b-4991-af04-300d46cbc0c4" acquired by "delete_volume" :: waited 0.024s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:04:58 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[caddea43-8a4f-4178-aae7-637efdec2cab]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:04:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0c199905-846a-4c57-978e-67a33b2f2e32 tempest-ProjectReaderTests-639086552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b9fe56ef-dc0b-4991-af04-300d46cbc0c4 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:04:58 devstack sudo[103508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b9fe56ef-dc0b-4991-af04-300d46cbc0c4 Sep 04 18:04:58 devstack sudo[103508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:04:58 devstack sudo[103508]: pam_unix(sudo:session): session closed for user root Sep 04 18:04:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0c199905-846a-4c57-978e-67a33b2f2e32 tempest-ProjectReaderTests-639086552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b9fe56ef-dc0b-4991-af04-300d46cbc0c4" returned: 0 in 0.385s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:04:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0c199905-846a-4c57-978e-67a33b2f2e32 tempest-ProjectReaderTests-639086552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b9fe56ef-dc0b-4991-af04-300d46cbc0c4 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:04:58 devstack sudo[103513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b9fe56ef-dc0b-4991-af04-300d46cbc0c4 Sep 04 18:04:58 devstack sudo[103513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:04:59 devstack sudo[103513]: pam_unix(sudo:session): session closed for user root Sep 04 18:04:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0c199905-846a-4c57-978e-67a33b2f2e32 tempest-ProjectReaderTests-639086552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b9fe56ef-dc0b-4991-af04-300d46cbc0c4" returned: 0 in 0.257s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:04:59 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0c199905-846a-4c57-978e-67a33b2f2e32 tempest-ProjectReaderTests-639086552 None] Lock "cinder-quobyte-b9fe56ef-dc0b-4991-af04-300d46cbc0c4" released by "delete_volume" :: held 0.691s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:04:59 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-0c199905-846a-4c57-978e-67a33b2f2e32 tempest-ProjectReaderTests-639086552 None] Created reservations ['e9eb9482-76b0-40fc-8f6e-d8c8db21989a', 'f37276ae-e45b-4910-bab4-72081469e188', 'b5a43922-d026-43a4-ac48-ebdad7e3cbef', 'a6f97fa3-dbdd-4f4d-b521-eaca6610e753'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:04:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0c199905-846a-4c57-978e-67a33b2f2e32 tempest-ProjectReaderTests-639086552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:04:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0c199905-846a-4c57-978e-67a33b2f2e32 tempest-ProjectReaderTests-639086552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:04:59 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0c199905-846a-4c57-978e-67a33b2f2e32 tempest-ProjectReaderTests-639086552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:04:59 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0c199905-846a-4c57-978e-67a33b2f2e32 tempest-ProjectReaderTests-639086552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:04:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0c199905-846a-4c57-978e-67a33b2f2e32 tempest-ProjectReaderTests-639086552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:04:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0c199905-846a-4c57-978e-67a33b2f2e32 tempest-ProjectReaderTests-639086552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:04:59 devstack sudo[103516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:04:59 devstack sudo[103516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:04:59 devstack sudo[103516]: pam_unix(sudo:session): session closed for user root Sep 04 18:04:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0c199905-846a-4c57-978e-67a33b2f2e32 tempest-ProjectReaderTests-639086552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.260s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:04:59 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-0c199905-846a-4c57-978e-67a33b2f2e32 tempest-ProjectReaderTests-639086552 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:04:59 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-0c199905-846a-4c57-978e-67a33b2f2e32 tempest-ProjectReaderTests-639086552 None] Deleted volume successfully. Sep 04 18:04:59 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0c199905-846a-4c57-978e-67a33b2f2e32 tempest-ProjectReaderTests-639086552 None] Lock "cinder-b9fe56ef-dc0b-4991-af04-300d46cbc0c4-delete_volume" released by "delete_volume" :: held 1.247s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:04:59 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-c32d9992-321a-4656-9716-b9e9fb41345f tempest-ProjectReaderTests-639086552 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:04:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c32d9992-321a-4656-9716-b9e9fb41345f tempest-ProjectReaderTests-639086552 None] Flow 'volume_create_manager' (736d66ef-c2d1-4f72-ba39-cb00a7c018df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:04:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c32d9992-321a-4656-9716-b9e9fb41345f tempest-ProjectReaderTests-639086552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6eec9ec3-5b6c-4714-9f0d-9e72d3799000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c32d9992-321a-4656-9716-b9e9fb41345f tempest-ProjectReaderTests-639086552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6eec9ec3-5b6c-4714-9f0d-9e72d3799000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:05:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-527518987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37519db1-430f-4838-ba91-5155d6af5b3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83ac3b05eb214a59be28fbca1272d810',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:05:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:05:00Z,use_quota=True,user_id='f4b173919ae0468eafac52e710a24e1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c32d9992-321a-4656-9716-b9e9fb41345f tempest-ProjectReaderTests-639086552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d350de12-0932-4d1c-8fae-608948cc6d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:04:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c32d9992-321a-4656-9716-b9e9fb41345f tempest-ProjectReaderTests-639086552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d350de12-0932-4d1c-8fae-608948cc6d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:04:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c32d9992-321a-4656-9716-b9e9fb41345f tempest-ProjectReaderTests-639086552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d92a2af-cd3c-49bc-9256-fcf26d1fdae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:05:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c32d9992-321a-4656-9716-b9e9fb41345f tempest-ProjectReaderTests-639086552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d92a2af-cd3c-49bc-9256-fcf26d1fdae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37519db1-430f-4838-ba91-5155d6af5b3e', 'volume_name': 'volume-37519db1-430f-4838-ba91-5155d6af5b3e', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:05:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c32d9992-321a-4656-9716-b9e9fb41345f tempest-ProjectReaderTests-639086552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e473825-9b78-43aa-9bf0-86179a36d2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:05:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c32d9992-321a-4656-9716-b9e9fb41345f tempest-ProjectReaderTests-639086552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e473825-9b78-43aa-9bf0-86179a36d2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:05:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c32d9992-321a-4656-9716-b9e9fb41345f tempest-ProjectReaderTests-639086552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d5fde3b-f354-43df-97d8-b7040abb5e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:05:00 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-c32d9992-321a-4656-9716-b9e9fb41345f tempest-ProjectReaderTests-639086552 None] Volume 37519db1-430f-4838-ba91-5155d6af5b3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37519db1-430f-4838-ba91-5155d6af5b3e', 'volume_size': 1} Sep 04 18:05:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c32d9992-321a-4656-9716-b9e9fb41345f tempest-ProjectReaderTests-639086552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:05:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c32d9992-321a-4656-9716-b9e9fb41345f tempest-ProjectReaderTests-639086552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:05:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c32d9992-321a-4656-9716-b9e9fb41345f tempest-ProjectReaderTests-639086552 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:05:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-527518987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37519db1-430f-4838-ba91-5155d6af5b3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83ac3b05eb214a59be28fbca1272d810',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:05:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:05:00Z,use_quota=True,user_id='f4b173919ae0468eafac52e710a24e1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:05:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-c32d9992-321a-4656-9716-b9e9fb41345f tempest-ProjectReaderTests-639086552 None] Creating volume 37519db1-430f-4838-ba91-5155d6af5b3e {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:05:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c32d9992-321a-4656-9716-b9e9fb41345f tempest-ProjectReaderTests-639086552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:05:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c32d9992-321a-4656-9716-b9e9fb41345f tempest-ProjectReaderTests-639086552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:05:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c32d9992-321a-4656-9716-b9e9fb41345f tempest-ProjectReaderTests-639086552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:05:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c32d9992-321a-4656-9716-b9e9fb41345f tempest-ProjectReaderTests-639086552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:05:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c32d9992-321a-4656-9716-b9e9fb41345f tempest-ProjectReaderTests-639086552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:05:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c32d9992-321a-4656-9716-b9e9fb41345f tempest-ProjectReaderTests-639086552 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:05:00 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-c32d9992-321a-4656-9716-b9e9fb41345f tempest-ProjectReaderTests-639086552 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:05:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c32d9992-321a-4656-9716-b9e9fb41345f tempest-ProjectReaderTests-639086552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-37519db1-430f-4838-ba91-5155d6af5b3e 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:05:00 devstack sudo[103519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-37519db1-430f-4838-ba91-5155d6af5b3e 1073741824 Sep 04 18:05:00 devstack sudo[103519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:05:00 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f7e1e020-ea11-493e-a92b-5d8a4c67f393 tempest-TestServerVolumeAttachmentScenario-1350945788 None] Acquiring lock "cinder-016d0503-b59b-49d0-8e25-204e76541a41-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:05:00 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f7e1e020-ea11-493e-a92b-5d8a4c67f393 tempest-TestServerVolumeAttachmentScenario-1350945788 None] Lock "cinder-016d0503-b59b-49d0-8e25-204e76541a41-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:05:00 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f7e1e020-ea11-493e-a92b-5d8a4c67f393 tempest-TestServerVolumeAttachmentScenario-1350945788 None] Acquiring lock "cinder-quobyte-016d0503-b59b-49d0-8e25-204e76541a41" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:05:00 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f7e1e020-ea11-493e-a92b-5d8a4c67f393 tempest-TestServerVolumeAttachmentScenario-1350945788 None] Lock "cinder-quobyte-016d0503-b59b-49d0-8e25-204e76541a41" acquired by "delete_volume" :: waited 0.015s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:05:00 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f74df11-872f-466b-b34d-0795ef0a7a03]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:05:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f7e1e020-ea11-493e-a92b-5d8a4c67f393 tempest-TestServerVolumeAttachmentScenario-1350945788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-016d0503-b59b-49d0-8e25-204e76541a41 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:05:00 devstack sudo[103525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-016d0503-b59b-49d0-8e25-204e76541a41 Sep 04 18:05:00 devstack sudo[103525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:05:00 devstack sudo[103519]: pam_unix(sudo:session): session closed for user root Sep 04 18:05:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c32d9992-321a-4656-9716-b9e9fb41345f tempest-ProjectReaderTests-639086552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-37519db1-430f-4838-ba91-5155d6af5b3e 1073741824" returned: 0 in 0.453s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:05:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c32d9992-321a-4656-9716-b9e9fb41345f tempest-ProjectReaderTests-639086552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-37519db1-430f-4838-ba91-5155d6af5b3e {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:05:00 devstack sudo[103528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-37519db1-430f-4838-ba91-5155d6af5b3e Sep 04 18:05:00 devstack sudo[103528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:05:00 devstack sudo[103525]: pam_unix(sudo:session): session closed for user root Sep 04 18:05:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f7e1e020-ea11-493e-a92b-5d8a4c67f393 tempest-TestServerVolumeAttachmentScenario-1350945788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-016d0503-b59b-49d0-8e25-204e76541a41" returned: 0 in 0.418s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:05:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f7e1e020-ea11-493e-a92b-5d8a4c67f393 tempest-TestServerVolumeAttachmentScenario-1350945788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-016d0503-b59b-49d0-8e25-204e76541a41 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:05:00 devstack sudo[103536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-016d0503-b59b-49d0-8e25-204e76541a41 Sep 04 18:05:00 devstack sudo[103536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:05:00 devstack sudo[103528]: pam_unix(sudo:session): session closed for user root Sep 04 18:05:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c32d9992-321a-4656-9716-b9e9fb41345f tempest-ProjectReaderTests-639086552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-37519db1-430f-4838-ba91-5155d6af5b3e" returned: 0 in 0.290s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:05:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c32d9992-321a-4656-9716-b9e9fb41345f tempest-ProjectReaderTests-639086552 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:05:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c32d9992-321a-4656-9716-b9e9fb41345f tempest-ProjectReaderTests-639086552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:05:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c32d9992-321a-4656-9716-b9e9fb41345f tempest-ProjectReaderTests-639086552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d5fde3b-f354-43df-97d8-b7040abb5e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37519db1-430f-4838-ba91-5155d6af5b3e', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:05:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c32d9992-321a-4656-9716-b9e9fb41345f tempest-ProjectReaderTests-639086552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5fa5e93-0a0e-4cfe-b12a-188c4419ea6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:05:00 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-c32d9992-321a-4656-9716-b9e9fb41345f tempest-ProjectReaderTests-639086552 None] Volume volume-37519db1-430f-4838-ba91-5155d6af5b3e (37519db1-430f-4838-ba91-5155d6af5b3e): created successfully Sep 04 18:05:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c32d9992-321a-4656-9716-b9e9fb41345f tempest-ProjectReaderTests-639086552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5fa5e93-0a0e-4cfe-b12a-188c4419ea6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:05:00 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c32d9992-321a-4656-9716-b9e9fb41345f tempest-ProjectReaderTests-639086552 None] Flow 'volume_create_manager' (736d66ef-c2d1-4f72-ba39-cb00a7c018df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:05:00 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-c32d9992-321a-4656-9716-b9e9fb41345f tempest-ProjectReaderTests-639086552 None] Created volume successfully. Sep 04 18:05:01 devstack sudo[103536]: pam_unix(sudo:session): session closed for user root Sep 04 18:05:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f7e1e020-ea11-493e-a92b-5d8a4c67f393 tempest-TestServerVolumeAttachmentScenario-1350945788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-016d0503-b59b-49d0-8e25-204e76541a41" returned: 0 in 0.272s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:05:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f7e1e020-ea11-493e-a92b-5d8a4c67f393 tempest-TestServerVolumeAttachmentScenario-1350945788 None] Lock "cinder-quobyte-016d0503-b59b-49d0-8e25-204e76541a41" released by "delete_volume" :: held 0.729s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:05:01 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-f7e1e020-ea11-493e-a92b-5d8a4c67f393 tempest-TestServerVolumeAttachmentScenario-1350945788 None] Created reservations ['e3a7d27d-7f2d-4198-8d4f-abd4a82dfe88', '3ebb46b3-4474-4ee5-835f-232fd7d6000f', 'a2244da7-fa59-42cb-ae26-3f1a9e57c607', '7967c9ce-5f68-43b6-8e65-3d263249ef98'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:05:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f7e1e020-ea11-493e-a92b-5d8a4c67f393 tempest-TestServerVolumeAttachmentScenario-1350945788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:05:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f7e1e020-ea11-493e-a92b-5d8a4c67f393 tempest-TestServerVolumeAttachmentScenario-1350945788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:05:01 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f7e1e020-ea11-493e-a92b-5d8a4c67f393 tempest-TestServerVolumeAttachmentScenario-1350945788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:05:01 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f7e1e020-ea11-493e-a92b-5d8a4c67f393 tempest-TestServerVolumeAttachmentScenario-1350945788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:05:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f7e1e020-ea11-493e-a92b-5d8a4c67f393 tempest-TestServerVolumeAttachmentScenario-1350945788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:05:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f7e1e020-ea11-493e-a92b-5d8a4c67f393 tempest-TestServerVolumeAttachmentScenario-1350945788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:05:01 devstack sudo[103543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:05:01 devstack sudo[103543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:05:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-164cb3ad-bf5b-4e02-af50-38825975e2ee tempest-TestServerVolumeAttachmentScenario-1350945788 None] Acquiring lock "cinder-27e9a55e-6b50-4076-a782-2ee6e103f7b6-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:05:01 devstack sudo[103543]: pam_unix(sudo:session): session closed for user root Sep 04 18:05:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f7e1e020-ea11-493e-a92b-5d8a4c67f393 tempest-TestServerVolumeAttachmentScenario-1350945788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.245s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:05:01 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-f7e1e020-ea11-493e-a92b-5d8a4c67f393 tempest-TestServerVolumeAttachmentScenario-1350945788 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:05:01 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-f7e1e020-ea11-493e-a92b-5d8a4c67f393 tempest-TestServerVolumeAttachmentScenario-1350945788 None] Deleted volume successfully. Sep 04 18:05:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-164cb3ad-bf5b-4e02-af50-38825975e2ee tempest-TestServerVolumeAttachmentScenario-1350945788 None] Lock "cinder-27e9a55e-6b50-4076-a782-2ee6e103f7b6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:05:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f7e1e020-ea11-493e-a92b-5d8a4c67f393 tempest-TestServerVolumeAttachmentScenario-1350945788 None] Lock "cinder-016d0503-b59b-49d0-8e25-204e76541a41-delete_volume" released by "delete_volume" :: held 1.181s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:05:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-164cb3ad-bf5b-4e02-af50-38825975e2ee tempest-TestServerVolumeAttachmentScenario-1350945788 None] Acquiring lock "cinder-quobyte-27e9a55e-6b50-4076-a782-2ee6e103f7b6" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:05:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-164cb3ad-bf5b-4e02-af50-38825975e2ee tempest-TestServerVolumeAttachmentScenario-1350945788 None] Lock "cinder-quobyte-27e9a55e-6b50-4076-a782-2ee6e103f7b6" acquired by "delete_volume" :: waited 0.015s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:05:01 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b312bb-6a74-4500-a4a6-da1b6dff8d48]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:05:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-164cb3ad-bf5b-4e02-af50-38825975e2ee tempest-TestServerVolumeAttachmentScenario-1350945788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-27e9a55e-6b50-4076-a782-2ee6e103f7b6 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:05:01 devstack sudo[103546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-27e9a55e-6b50-4076-a782-2ee6e103f7b6 Sep 04 18:05:01 devstack sudo[103546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:05:01 devstack sudo[103546]: pam_unix(sudo:session): session closed for user root Sep 04 18:05:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-164cb3ad-bf5b-4e02-af50-38825975e2ee tempest-TestServerVolumeAttachmentScenario-1350945788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-27e9a55e-6b50-4076-a782-2ee6e103f7b6" returned: 0 in 0.340s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:05:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-164cb3ad-bf5b-4e02-af50-38825975e2ee tempest-TestServerVolumeAttachmentScenario-1350945788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-27e9a55e-6b50-4076-a782-2ee6e103f7b6 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:05:01 devstack sudo[103554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-27e9a55e-6b50-4076-a782-2ee6e103f7b6 Sep 04 18:05:01 devstack sudo[103554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:05:02 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-54cbdba7-8f27-470f-b987-890017870830 tempest-ProjectReaderTests-639086552 None] Acquiring lock "cinder-37519db1-430f-4838-ba91-5155d6af5b3e-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:05:02 devstack sudo[103554]: pam_unix(sudo:session): session closed for user root Sep 04 18:05:02 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-54cbdba7-8f27-470f-b987-890017870830 tempest-ProjectReaderTests-639086552 None] Lock "cinder-37519db1-430f-4838-ba91-5155d6af5b3e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:05:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-164cb3ad-bf5b-4e02-af50-38825975e2ee tempest-TestServerVolumeAttachmentScenario-1350945788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-27e9a55e-6b50-4076-a782-2ee6e103f7b6" returned: 0 in 0.266s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:05:02 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-164cb3ad-bf5b-4e02-af50-38825975e2ee tempest-TestServerVolumeAttachmentScenario-1350945788 None] Lock "cinder-quobyte-27e9a55e-6b50-4076-a782-2ee6e103f7b6" released by "delete_volume" :: held 0.652s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:05:02 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-54cbdba7-8f27-470f-b987-890017870830 tempest-ProjectReaderTests-639086552 None] Acquiring lock "cinder-quobyte-37519db1-430f-4838-ba91-5155d6af5b3e" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:05:02 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-54cbdba7-8f27-470f-b987-890017870830 tempest-ProjectReaderTests-639086552 None] Lock "cinder-quobyte-37519db1-430f-4838-ba91-5155d6af5b3e" acquired by "delete_volume" :: waited 0.020s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:05:02 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab870dc-7732-4e64-b938-599b0b3a1b98]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:05:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-54cbdba7-8f27-470f-b987-890017870830 tempest-ProjectReaderTests-639086552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-37519db1-430f-4838-ba91-5155d6af5b3e {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:05:02 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-164cb3ad-bf5b-4e02-af50-38825975e2ee tempest-TestServerVolumeAttachmentScenario-1350945788 None] Created reservations ['8f375e7b-1c8a-4258-9d64-244f134262f4', '5263a736-4f55-49fb-aa89-03252acb2f21', 'a312d00a-13b4-4330-9eb3-4ee8801c3fb6', '10206678-d992-4dbb-ad73-616a31739c7a'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:05:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-164cb3ad-bf5b-4e02-af50-38825975e2ee tempest-TestServerVolumeAttachmentScenario-1350945788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:05:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-164cb3ad-bf5b-4e02-af50-38825975e2ee tempest-TestServerVolumeAttachmentScenario-1350945788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:05:02 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-164cb3ad-bf5b-4e02-af50-38825975e2ee tempest-TestServerVolumeAttachmentScenario-1350945788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:05:02 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-164cb3ad-bf5b-4e02-af50-38825975e2ee tempest-TestServerVolumeAttachmentScenario-1350945788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:05:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-164cb3ad-bf5b-4e02-af50-38825975e2ee tempest-TestServerVolumeAttachmentScenario-1350945788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:05:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-164cb3ad-bf5b-4e02-af50-38825975e2ee tempest-TestServerVolumeAttachmentScenario-1350945788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:05:02 devstack sudo[103558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:05:02 devstack sudo[103558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:05:02 devstack sudo[103557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-37519db1-430f-4838-ba91-5155d6af5b3e Sep 04 18:05:02 devstack sudo[103557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:05:02 devstack sudo[103558]: pam_unix(sudo:session): session closed for user root Sep 04 18:05:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-164cb3ad-bf5b-4e02-af50-38825975e2ee tempest-TestServerVolumeAttachmentScenario-1350945788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.260s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:05:02 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-164cb3ad-bf5b-4e02-af50-38825975e2ee tempest-TestServerVolumeAttachmentScenario-1350945788 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:05:02 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-164cb3ad-bf5b-4e02-af50-38825975e2ee tempest-TestServerVolumeAttachmentScenario-1350945788 None] Deleted volume successfully. Sep 04 18:05:02 devstack sudo[103557]: pam_unix(sudo:session): session closed for user root Sep 04 18:05:02 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-164cb3ad-bf5b-4e02-af50-38825975e2ee tempest-TestServerVolumeAttachmentScenario-1350945788 None] Lock "cinder-27e9a55e-6b50-4076-a782-2ee6e103f7b6-delete_volume" released by "delete_volume" :: held 1.171s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:05:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-54cbdba7-8f27-470f-b987-890017870830 tempest-ProjectReaderTests-639086552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-37519db1-430f-4838-ba91-5155d6af5b3e" returned: 0 in 0.396s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:05:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-54cbdba7-8f27-470f-b987-890017870830 tempest-ProjectReaderTests-639086552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-37519db1-430f-4838-ba91-5155d6af5b3e {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:05:02 devstack sudo[103565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-37519db1-430f-4838-ba91-5155d6af5b3e Sep 04 18:05:02 devstack sudo[103565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:05:02 devstack sudo[103565]: pam_unix(sudo:session): session closed for user root Sep 04 18:05:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-54cbdba7-8f27-470f-b987-890017870830 tempest-ProjectReaderTests-639086552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-37519db1-430f-4838-ba91-5155d6af5b3e" returned: 0 in 0.263s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:05:02 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-54cbdba7-8f27-470f-b987-890017870830 tempest-ProjectReaderTests-639086552 None] Lock "cinder-quobyte-37519db1-430f-4838-ba91-5155d6af5b3e" released by "delete_volume" :: held 0.704s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:05:02 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-54cbdba7-8f27-470f-b987-890017870830 tempest-ProjectReaderTests-639086552 None] Created reservations ['0396fa8d-d031-45a4-a2f8-0f83bf1cf600', '2c1e1823-4e64-4a75-91ed-116f8b3e1615', 'fc36e3b1-10da-43e3-b150-4fe365baba45', 'ef8c7f92-23f5-45fa-81c0-a49340aef7b2'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:05:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-54cbdba7-8f27-470f-b987-890017870830 tempest-ProjectReaderTests-639086552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:05:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-54cbdba7-8f27-470f-b987-890017870830 tempest-ProjectReaderTests-639086552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:05:02 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-54cbdba7-8f27-470f-b987-890017870830 tempest-ProjectReaderTests-639086552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:05:02 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-54cbdba7-8f27-470f-b987-890017870830 tempest-ProjectReaderTests-639086552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:05:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-54cbdba7-8f27-470f-b987-890017870830 tempest-ProjectReaderTests-639086552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:05:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-54cbdba7-8f27-470f-b987-890017870830 tempest-ProjectReaderTests-639086552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:05:03 devstack sudo[103570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:05:03 devstack sudo[103570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:05:03 devstack sudo[103570]: pam_unix(sudo:session): session closed for user root Sep 04 18:05:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-54cbdba7-8f27-470f-b987-890017870830 tempest-ProjectReaderTests-639086552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.269s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:05:03 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-54cbdba7-8f27-470f-b987-890017870830 tempest-ProjectReaderTests-639086552 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:05:03 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-54cbdba7-8f27-470f-b987-890017870830 tempest-ProjectReaderTests-639086552 None] Deleted volume successfully. Sep 04 18:05:03 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-54cbdba7-8f27-470f-b987-890017870830 tempest-ProjectReaderTests-639086552 None] Lock "cinder-37519db1-430f-4838-ba91-5155d6af5b3e-delete_volume" released by "delete_volume" :: held 1.229s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:05:12 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=109,cinder:UPDATE=123,cinder:DELETE=10,cinder:INSERT=27 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 18:05:13 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:UPDATE=135,cinder:SELECT=81,cinder:INSERT=31,cinder:DELETE=12 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 18:05:21 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 18:05:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:05:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:05:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:05:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:05:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:05:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:05:21 devstack sudo[103581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:05:21 devstack sudo[103581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:05:21 devstack sudo[103581]: pam_unix(sudo:session): session closed for user root Sep 04 18:05:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.243s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:05:21 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:05:21 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running periodic task VolumeManager._thread_info {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 18:05:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] thread count: 28 {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 18:05:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] thread info: [<_MainThread(MainThread, started 139900377723008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 18:05:36 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8c90f74-551a-4cc0-bca9-02aa9ef08806 tempest-TestShelveInstance-1189375588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:05:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d8c90f74-551a-4cc0-bca9-02aa9ef08806 tempest-TestShelveInstance-1189375588 None] Flow 'volume_create_manager' (341afa02-5758-42cd-baa3-01f390636fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:05:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d8c90f74-551a-4cc0-bca9-02aa9ef08806 tempest-TestShelveInstance-1189375588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23bbd620-324e-487e-83de-45440ff02481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:05:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d8c90f74-551a-4cc0-bca9-02aa9ef08806 tempest-TestShelveInstance-1189375588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23bbd620-324e-487e-83de-45440ff02481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:05:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-60994178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35266931-5cac-4526-98b7-88651db4bca0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05e035fb7802429fa240c17ef7b4c9fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:05:37Z,use_quota=True,user_id='6830c452bee647f28290cddff12bc28f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:05:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d8c90f74-551a-4cc0-bca9-02aa9ef08806 tempest-TestShelveInstance-1189375588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c822f55d-3bb7-4847-a0d1-8ce9938d6046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:05:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d8c90f74-551a-4cc0-bca9-02aa9ef08806 tempest-TestShelveInstance-1189375588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c822f55d-3bb7-4847-a0d1-8ce9938d6046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:05:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d8c90f74-551a-4cc0-bca9-02aa9ef08806 tempest-TestShelveInstance-1189375588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f0cc152-bc34-4cc1-a5f2-a0f4c0493f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:05:36 devstack cinder-volume[87314]: DEBUG cinder.image.glance [None req-d8c90f74-551a-4cc0-bca9-02aa9ef08806 tempest-TestShelveInstance-1189375588 None] Creating Keystone auth plugin from conf {{(pid=87314) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 04 18:05:37 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d8c90f74-551a-4cc0-bca9-02aa9ef08806 tempest-TestShelveInstance-1189375588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f0cc152-bc34-4cc1-a5f2-a0f4c0493f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '35266931-5cac-4526-98b7-88651db4bca0', 'volume_name': 'volume-35266931-5cac-4526-98b7-88651db4bca0', 'volume_size': 1, 'image_id': 'eeb1e1b9-f612-4acd-9439-6285840a52d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eeb1e1b9-f612-4acd-9439-6285840a52d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'be7dacacfc0f482c9fff51cfcb1c78e5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eeb1e1b9-f612-4acd-9439-6285840a52d1', 'created_at': datetime.datetime(2026, 9, 4, 15, 43, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 15, 43, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eeb1e1b9-f612-4acd-9439-6285840a52d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:05:37 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d8c90f74-551a-4cc0-bca9-02aa9ef08806 tempest-TestShelveInstance-1189375588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1e11a3d-5fc7-40b7-9047-3a9ccc6162c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:05:37 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d8c90f74-551a-4cc0-bca9-02aa9ef08806 tempest-TestShelveInstance-1189375588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1e11a3d-5fc7-40b7-9047-3a9ccc6162c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:05:37 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d8c90f74-551a-4cc0-bca9-02aa9ef08806 tempest-TestShelveInstance-1189375588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d11df690-589d-48ce-9bc4-e063322706ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:05:37 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-d8c90f74-551a-4cc0-bca9-02aa9ef08806 tempest-TestShelveInstance-1189375588 None] Volume 35266931-5cac-4526-98b7-88651db4bca0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-35266931-5cac-4526-98b7-88651db4bca0', 'volume_size': 1, 'image_id': 'eeb1e1b9-f612-4acd-9439-6285840a52d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eeb1e1b9-f612-4acd-9439-6285840a52d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'be7dacacfc0f482c9fff51cfcb1c78e5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eeb1e1b9-f612-4acd-9439-6285840a52d1', 'created_at': datetime.datetime(2026, 9, 4, 15, 43, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 15, 43, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eeb1e1b9-f612-4acd-9439-6285840a52d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 04 18:05:37 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8c90f74-551a-4cc0-bca9-02aa9ef08806 tempest-TestShelveInstance-1189375588 None] Trying to clone 35266931-5cac-4526-98b7-88651db4bca0 from image eeb1e1b9-f612-4acd-9439-6285840a52d1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/eeb1e1b9-f612-4acd-9439-6285840a52d1', 'metadata': {}}]). {{(pid=87314) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 04 18:05:37 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-d8c90f74-551a-4cc0-bca9-02aa9ef08806 tempest-TestShelveInstance-1189375588 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1_tcpkm7k9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87314) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 04 18:05:37 devstack cinder-volume[87314]: INFO cinder.image.image_utils [None req-d8c90f74-551a-4cc0-bca9-02aa9ef08806 tempest-TestShelveInstance-1189375588 None] Image download 20.69 MB at 20.69 MB/s Sep 04 18:05:37 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc81a01-b82d-4541-95fa-985b979b32c9]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:05:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d8c90f74-551a-4cc0-bca9-02aa9ef08806 tempest-TestShelveInstance-1189375588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1_tcpkm7k9devstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:05:37 devstack sudo[103588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1_tcpkm7k9devstack@QuobyteHD Sep 04 18:05:37 devstack sudo[103588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:05:38 devstack sudo[103588]: pam_unix(sudo:session): session closed for user root Sep 04 18:05:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d8c90f74-551a-4cc0-bca9-02aa9ef08806 tempest-TestShelveInstance-1189375588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1_tcpkm7k9devstack@QuobyteHD" returned: 0 in 0.376s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:05:38 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-d8c90f74-551a-4cc0-bca9-02aa9ef08806 tempest-TestShelveInstance-1189375588 None] Temporary image eeb1e1b9-f612-4acd-9439-6285840a52d1 is fetched for user 6830c452bee647f28290cddff12bc28f. {{(pid=87314) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 04 18:05:38 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c7595b-e1e0-41c5-872e-ff2d8d022564]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:05:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d8c90f74-551a-4cc0-bca9-02aa9ef08806 tempest-TestShelveInstance-1189375588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1_tcpkm7k9devstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:05:38 devstack sudo[103593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1_tcpkm7k9devstack@QuobyteHD Sep 04 18:05:38 devstack sudo[103593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:05:38 devstack sudo[103593]: pam_unix(sudo:session): session closed for user root Sep 04 18:05:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d8c90f74-551a-4cc0-bca9-02aa9ef08806 tempest-TestShelveInstance-1189375588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1_tcpkm7k9devstack@QuobyteHD" returned: 0 in 0.352s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:05:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d8c90f74-551a-4cc0-bca9-02aa9ef08806 tempest-TestShelveInstance-1189375588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:05:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d8c90f74-551a-4cc0-bca9-02aa9ef08806 tempest-TestShelveInstance-1189375588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:05:38 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d8c90f74-551a-4cc0-bca9-02aa9ef08806 tempest-TestShelveInstance-1189375588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:05:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-60994178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35266931-5cac-4526-98b7-88651db4bca0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05e035fb7802429fa240c17ef7b4c9fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:05:37Z,use_quota=True,user_id='6830c452bee647f28290cddff12bc28f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:05:38 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-d8c90f74-551a-4cc0-bca9-02aa9ef08806 tempest-TestShelveInstance-1189375588 None] Creating volume 35266931-5cac-4526-98b7-88651db4bca0 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:05:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d8c90f74-551a-4cc0-bca9-02aa9ef08806 tempest-TestShelveInstance-1189375588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:05:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d8c90f74-551a-4cc0-bca9-02aa9ef08806 tempest-TestShelveInstance-1189375588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:05:38 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d8c90f74-551a-4cc0-bca9-02aa9ef08806 tempest-TestShelveInstance-1189375588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:05:38 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d8c90f74-551a-4cc0-bca9-02aa9ef08806 tempest-TestShelveInstance-1189375588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:05:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d8c90f74-551a-4cc0-bca9-02aa9ef08806 tempest-TestShelveInstance-1189375588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:05:38 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d8c90f74-551a-4cc0-bca9-02aa9ef08806 tempest-TestShelveInstance-1189375588 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:05:38 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-d8c90f74-551a-4cc0-bca9-02aa9ef08806 tempest-TestShelveInstance-1189375588 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:05:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d8c90f74-551a-4cc0-bca9-02aa9ef08806 tempest-TestShelveInstance-1189375588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-35266931-5cac-4526-98b7-88651db4bca0 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:05:38 devstack sudo[103598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-35266931-5cac-4526-98b7-88651db4bca0 1073741824 Sep 04 18:05:38 devstack sudo[103598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:05:38 devstack sudo[103598]: pam_unix(sudo:session): session closed for user root Sep 04 18:05:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d8c90f74-551a-4cc0-bca9-02aa9ef08806 tempest-TestShelveInstance-1189375588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-35266931-5cac-4526-98b7-88651db4bca0 1073741824" returned: 0 in 0.449s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:05:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d8c90f74-551a-4cc0-bca9-02aa9ef08806 tempest-TestShelveInstance-1189375588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-35266931-5cac-4526-98b7-88651db4bca0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:05:39 devstack sudo[103604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-35266931-5cac-4526-98b7-88651db4bca0 Sep 04 18:05:39 devstack sudo[103604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:05:39 devstack sudo[103604]: pam_unix(sudo:session): session closed for user root Sep 04 18:05:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d8c90f74-551a-4cc0-bca9-02aa9ef08806 tempest-TestShelveInstance-1189375588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-35266931-5cac-4526-98b7-88651db4bca0" returned: 0 in 0.263s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:05:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d8c90f74-551a-4cc0-bca9-02aa9ef08806 tempest-TestShelveInstance-1189375588 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:05:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d8c90f74-551a-4cc0-bca9-02aa9ef08806 tempest-TestShelveInstance-1189375588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:05:39 devstack cinder-volume[87314]: DEBUG cinder.volume.volume_utils [None req-d8c90f74-551a-4cc0-bca9-02aa9ef08806 tempest-TestShelveInstance-1189375588 None] Attempting download of eeb1e1b9-f612-4acd-9439-6285840a52d1 ((None, [{'url': 'file:///opt/stack/data/glance/images/eeb1e1b9-f612-4acd-9439-6285840a52d1', 'metadata': {}}])) to volume 35266931-5cac-4526-98b7-88651db4bca0. {{(pid=87314) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 04 18:05:39 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe695416-3d5c-4f56-adf7-75cfac987b25]: (4, 'raw') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:05:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d8c90f74-551a-4cc0-bca9-02aa9ef08806 tempest-TestShelveInstance-1189375588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eeb1e1b9-f612-4acd-9439-6285840a52d1_0q43z8i8 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:05:39 devstack sudo[103607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eeb1e1b9-f612-4acd-9439-6285840a52d1_0q43z8i8 Sep 04 18:05:39 devstack sudo[103607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:05:39 devstack sudo[103607]: pam_unix(sudo:session): session closed for user root Sep 04 18:05:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d8c90f74-551a-4cc0-bca9-02aa9ef08806 tempest-TestShelveInstance-1189375588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eeb1e1b9-f612-4acd-9439-6285840a52d1_0q43z8i8" returned: 0 in 0.325s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:05:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d8c90f74-551a-4cc0-bca9-02aa9ef08806 tempest-TestShelveInstance-1189375588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eeb1e1b9-f612-4acd-9439-6285840a52d1_0q43z8i8 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:05:39 devstack sudo[103611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eeb1e1b9-f612-4acd-9439-6285840a52d1_0q43z8i8 Sep 04 18:05:39 devstack sudo[103611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:05:39 devstack sudo[103611]: pam_unix(sudo:session): session closed for user root Sep 04 18:05:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d8c90f74-551a-4cc0-bca9-02aa9ef08806 tempest-TestShelveInstance-1189375588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eeb1e1b9-f612-4acd-9439-6285840a52d1_0q43z8i8" returned: 1 in 0.325s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:05:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d8c90f74-551a-4cc0-bca9-02aa9ef08806 tempest-TestShelveInstance-1189375588 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eeb1e1b9-f612-4acd-9439-6285840a52d1_0q43z8i8' failed. Not Retrying. {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 18:05:39 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a66afa3-b4d5-4afc-9534-7f6c2aa42a9d]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:05:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d8c90f74-551a-4cc0-bca9-02aa9ef08806 tempest-TestShelveInstance-1189375588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1_tcpkm7k9devstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:05:40 devstack sudo[103615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1_tcpkm7k9devstack@QuobyteHD Sep 04 18:05:40 devstack sudo[103615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:05:40 devstack sudo[103615]: pam_unix(sudo:session): session closed for user root Sep 04 18:05:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d8c90f74-551a-4cc0-bca9-02aa9ef08806 tempest-TestShelveInstance-1189375588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1_tcpkm7k9devstack@QuobyteHD" returned: 0 in 0.309s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:05:40 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-d8c90f74-551a-4cc0-bca9-02aa9ef08806 tempest-TestShelveInstance-1189375588 None] eeb1e1b9-f612-4acd-9439-6285840a52d1 was qcow2, converting to qcow2 {{(pid=87314) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 04 18:05:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d8c90f74-551a-4cc0-bca9-02aa9ef08806 tempest-TestShelveInstance-1189375588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1_tcpkm7k9devstack@QuobyteHD /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-35266931-5cac-4526-98b7-88651db4bca0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:05:40 devstack sudo[103620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1_tcpkm7k9devstack@QuobyteHD /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-35266931-5cac-4526-98b7-88651db4bca0 Sep 04 18:05:40 devstack sudo[103620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:05:41 devstack sudo[103620]: pam_unix(sudo:session): session closed for user root Sep 04 18:05:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d8c90f74-551a-4cc0-bca9-02aa9ef08806 tempest-TestShelveInstance-1189375588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1_tcpkm7k9devstack@QuobyteHD /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-35266931-5cac-4526-98b7-88651db4bca0" returned: 0 in 1.564s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:05:41 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-d8c90f74-551a-4cc0-bca9-02aa9ef08806 tempest-TestShelveInstance-1189375588 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_eeb1e1b9-f612-4acd-9439-6285840a52d1_tcpkm7k9devstack@QuobyteHD, size 112.00 MB, duration 1.57 sec, destination /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-35266931-5cac-4526-98b7-88651db4bca0 {{(pid=87314) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 18:05:41 devstack cinder-volume[87314]: INFO cinder.image.image_utils [None req-d8c90f74-551a-4cc0-bca9-02aa9ef08806 tempest-TestShelveInstance-1189375588 None] Converted 112.00 MB image at 71.56 MB/s Sep 04 18:05:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d8c90f74-551a-4cc0-bca9-02aa9ef08806 tempest-TestShelveInstance-1189375588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-35266931-5cac-4526-98b7-88651db4bca0 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:05:41 devstack sudo[103629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-35266931-5cac-4526-98b7-88651db4bca0 1G Sep 04 18:05:41 devstack sudo[103629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:05:42 devstack sudo[103629]: pam_unix(sudo:session): session closed for user root Sep 04 18:05:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d8c90f74-551a-4cc0-bca9-02aa9ef08806 tempest-TestShelveInstance-1189375588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-35266931-5cac-4526-98b7-88651db4bca0 1G" returned: 0 in 0.325s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:05:42 devstack cinder-volume[87314]: DEBUG cinder.volume.volume_utils [None req-d8c90f74-551a-4cc0-bca9-02aa9ef08806 tempest-TestShelveInstance-1189375588 None] Downloaded image eeb1e1b9-f612-4acd-9439-6285840a52d1 ((None, [{'url': 'file:///opt/stack/data/glance/images/eeb1e1b9-f612-4acd-9439-6285840a52d1', 'metadata': {}}])) to volume 35266931-5cac-4526-98b7-88651db4bca0 successfully. {{(pid=87314) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 04 18:05:42 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-d8c90f74-551a-4cc0-bca9-02aa9ef08806 tempest-TestShelveInstance-1189375588 None] Temporary image eeb1e1b9-f612-4acd-9439-6285840a52d1 for user 6830c452bee647f28290cddff12bc28f is deleted. {{(pid=87314) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 04 18:05:42 devstack cinder-volume[87314]: DEBUG cinder.volume.volume_utils [None req-d8c90f74-551a-4cc0-bca9-02aa9ef08806 tempest-TestShelveInstance-1189375588 None] Marking volume 35266931-5cac-4526-98b7-88651db4bca0 as bootable. {{(pid=87314) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 04 18:05:42 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8c90f74-551a-4cc0-bca9-02aa9ef08806 tempest-TestShelveInstance-1189375588 None] Copying metadata from image eeb1e1b9-f612-4acd-9439-6285840a52d1 to 35266931-5cac-4526-98b7-88651db4bca0. {{(pid=87314) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 04 18:05:42 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8c90f74-551a-4cc0-bca9-02aa9ef08806 tempest-TestShelveInstance-1189375588 None] Creating volume glance metadata for volume 35266931-5cac-4526-98b7-88651db4bca0 backed by image eeb1e1b9-f612-4acd-9439-6285840a52d1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'eeb1e1b9-f612-4acd-9439-6285840a52d1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87314) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 04 18:05:42 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d8c90f74-551a-4cc0-bca9-02aa9ef08806 tempest-TestShelveInstance-1189375588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d11df690-589d-48ce-9bc4-e063322706ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35266931-5cac-4526-98b7-88651db4bca0', 'volume_size': 1, 'image_id': 'eeb1e1b9-f612-4acd-9439-6285840a52d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eeb1e1b9-f612-4acd-9439-6285840a52d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'be7dacacfc0f482c9fff51cfcb1c78e5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eeb1e1b9-f612-4acd-9439-6285840a52d1', 'created_at': datetime.datetime(2026, 9, 4, 15, 43, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 15, 43, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eeb1e1b9-f612-4acd-9439-6285840a52d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:05:42 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d8c90f74-551a-4cc0-bca9-02aa9ef08806 tempest-TestShelveInstance-1189375588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8232f150-4adc-4156-b6e4-93623bcf5f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:05:42 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-d8c90f74-551a-4cc0-bca9-02aa9ef08806 tempest-TestShelveInstance-1189375588 None] Volume volume-35266931-5cac-4526-98b7-88651db4bca0 (35266931-5cac-4526-98b7-88651db4bca0): created successfully Sep 04 18:05:42 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d8c90f74-551a-4cc0-bca9-02aa9ef08806 tempest-TestShelveInstance-1189375588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8232f150-4adc-4156-b6e4-93623bcf5f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:05:42 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-d8c90f74-551a-4cc0-bca9-02aa9ef08806 tempest-TestShelveInstance-1189375588 None] Flow 'volume_create_manager' (341afa02-5758-42cd-baa3-01f390636fdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:05:42 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-d8c90f74-551a-4cc0-bca9-02aa9ef08806 tempest-TestShelveInstance-1189375588 None] Created volume successfully. Sep 04 18:05:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-485d5c37-4a82-4fbc-9040-a68b8a2c67fd req-37f7d00f-da23-4ff9-9598-77828f0472f6 tempest-TestShelveInstance-1189375588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:05:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-485d5c37-4a82-4fbc-9040-a68b8a2c67fd req-37f7d00f-da23-4ff9-9598-77828f0472f6 tempest-TestShelveInstance-1189375588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:05:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-485d5c37-4a82-4fbc-9040-a68b8a2c67fd req-37f7d00f-da23-4ff9-9598-77828f0472f6 tempest-TestShelveInstance-1189375588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:05:46 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-485d5c37-4a82-4fbc-9040-a68b8a2c67fd req-37f7d00f-da23-4ff9-9598-77828f0472f6 tempest-TestShelveInstance-1189375588 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a', 'name': 'volume-35266931-5cac-4526-98b7-88651db4bca0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9899a583-4d9f-4cda-bc2e-9b4839213a8b', 'enforce_multipath': True} {{(pid=87314) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 18:05:46 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-485d5c37-4a82-4fbc-9040-a68b8a2c67fd req-37f7d00f-da23-4ff9-9598-77828f0472f6 tempest-TestShelveInstance-1189375588 None] attachment_update completed successfully. Sep 04 18:05:56 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:UPDATE=7,cinder:SELECT=14,cinder:INSERT=8,cinder:DELETE=1 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 18:05:56 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=18,cinder:INSERT=6,cinder:UPDATE=5 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 18:06:12 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=1 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 18:06:12 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:UPDATE=1 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 18:06:18 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-2061e6aa-5937-4952-ad60-82250237f48f req-fb85bf14-ab7e-4d2c-ab32-e7a2b29cc938 tempest-TestShelveInstance-1189375588 None] Terminate volume connection completed successfully. Sep 04 18:06:18 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-2061e6aa-5937-4952-ad60-82250237f48f req-fb85bf14-ab7e-4d2c-ab32-e7a2b29cc938 tempest-TestShelveInstance-1189375588 None] Deleting attachment 9899a583-4d9f-4cda-bc2e-9b4839213a8b. {{(pid=87314) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 18:06:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-0472c89f-1b66-471a-b642-2557860b8120 req-d25a5da5-a210-4fcc-a7a7-047d07b07721 tempest-TestShelveInstance-1189375588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:06:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-0472c89f-1b66-471a-b642-2557860b8120 req-d25a5da5-a210-4fcc-a7a7-047d07b07721 tempest-TestShelveInstance-1189375588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:06:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-0472c89f-1b66-471a-b642-2557860b8120 req-d25a5da5-a210-4fcc-a7a7-047d07b07721 tempest-TestShelveInstance-1189375588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:06:20 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-0472c89f-1b66-471a-b642-2557860b8120 req-d25a5da5-a210-4fcc-a7a7-047d07b07721 tempest-TestShelveInstance-1189375588 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a', 'name': 'volume-35266931-5cac-4526-98b7-88651db4bca0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cb171c91-9920-4493-955d-c469824ec2db', 'enforce_multipath': True} {{(pid=87314) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 18:06:20 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-0472c89f-1b66-471a-b642-2557860b8120 req-d25a5da5-a210-4fcc-a7a7-047d07b07721 tempest-TestShelveInstance-1189375588 None] attachment_update completed successfully. Sep 04 18:06:21 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 18:06:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:06:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:06:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:06:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:06:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:06:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:06:21 devstack sudo[104233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:06:21 devstack sudo[104233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:06:21 devstack sudo[104233]: pam_unix(sudo:session): session closed for user root Sep 04 18:06:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.314s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:06:21 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:06:21 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running periodic task VolumeManager._thread_info {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 18:06:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] thread count: 28 {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 18:06:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] thread info: [<_MainThread(MainThread, started 139900377723008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 18:06:30 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 18:06:30 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=8 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 18:06:48 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-76a21df8-3d85-4c76-8dca-94fd7c9f170a req-54b215c0-a00c-4d11-9591-a686d37e4a78 tempest-TestShelveInstance-1189375588 None] Terminate volume connection completed successfully. Sep 04 18:06:48 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-76a21df8-3d85-4c76-8dca-94fd7c9f170a req-54b215c0-a00c-4d11-9591-a686d37e4a78 tempest-TestShelveInstance-1189375588 None] Deleting attachment cb171c91-9920-4493-955d-c469824ec2db. {{(pid=87314) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 18:06:48 devstack cinder-volume[87314]: DEBUG cinder.coordination [req-76a21df8-3d85-4c76-8dca-94fd7c9f170a req-b2dbac5a-a990-4526-bd65-41bceef1576d tempest-TestShelveInstance-1189375588 None] Acquiring lock "cinder-35266931-5cac-4526-98b7-88651db4bca0-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:06:48 devstack cinder-volume[87314]: DEBUG cinder.coordination [req-76a21df8-3d85-4c76-8dca-94fd7c9f170a req-b2dbac5a-a990-4526-bd65-41bceef1576d tempest-TestShelveInstance-1189375588 None] Lock "cinder-35266931-5cac-4526-98b7-88651db4bca0-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:06:48 devstack cinder-volume[87314]: DEBUG cinder.coordination [req-76a21df8-3d85-4c76-8dca-94fd7c9f170a req-b2dbac5a-a990-4526-bd65-41bceef1576d tempest-TestShelveInstance-1189375588 None] Acquiring lock "cinder-quobyte-35266931-5cac-4526-98b7-88651db4bca0" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:06:48 devstack cinder-volume[87314]: DEBUG cinder.coordination [req-76a21df8-3d85-4c76-8dca-94fd7c9f170a req-b2dbac5a-a990-4526-bd65-41bceef1576d tempest-TestShelveInstance-1189375588 None] Lock "cinder-quobyte-35266931-5cac-4526-98b7-88651db4bca0" acquired by "delete_volume" :: waited 0.017s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:06:48 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b1fc3d-7e84-4c42-b77a-e28c9c3e9bdd]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:06:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-76a21df8-3d85-4c76-8dca-94fd7c9f170a req-b2dbac5a-a990-4526-bd65-41bceef1576d tempest-TestShelveInstance-1189375588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-35266931-5cac-4526-98b7-88651db4bca0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:06:48 devstack sudo[104789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-35266931-5cac-4526-98b7-88651db4bca0 Sep 04 18:06:48 devstack sudo[104789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:06:48 devstack sudo[104789]: pam_unix(sudo:session): session closed for user root Sep 04 18:06:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-76a21df8-3d85-4c76-8dca-94fd7c9f170a req-b2dbac5a-a990-4526-bd65-41bceef1576d tempest-TestShelveInstance-1189375588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-35266931-5cac-4526-98b7-88651db4bca0" returned: 0 in 0.394s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:06:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-76a21df8-3d85-4c76-8dca-94fd7c9f170a req-b2dbac5a-a990-4526-bd65-41bceef1576d tempest-TestShelveInstance-1189375588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-35266931-5cac-4526-98b7-88651db4bca0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:06:48 devstack sudo[104795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-35266931-5cac-4526-98b7-88651db4bca0 Sep 04 18:06:48 devstack sudo[104795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:06:48 devstack sudo[104795]: pam_unix(sudo:session): session closed for user root Sep 04 18:06:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-76a21df8-3d85-4c76-8dca-94fd7c9f170a req-b2dbac5a-a990-4526-bd65-41bceef1576d tempest-TestShelveInstance-1189375588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-35266931-5cac-4526-98b7-88651db4bca0" returned: 0 in 0.253s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:06:48 devstack cinder-volume[87314]: DEBUG cinder.coordination [req-76a21df8-3d85-4c76-8dca-94fd7c9f170a req-b2dbac5a-a990-4526-bd65-41bceef1576d tempest-TestShelveInstance-1189375588 None] Lock "cinder-quobyte-35266931-5cac-4526-98b7-88651db4bca0" released by "delete_volume" :: held 0.693s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:06:48 devstack cinder-volume[87314]: DEBUG cinder.quota [req-76a21df8-3d85-4c76-8dca-94fd7c9f170a req-b2dbac5a-a990-4526-bd65-41bceef1576d tempest-TestShelveInstance-1189375588 None] Created reservations ['68316770-24a9-40d9-8ea1-6849fdd72df6', '0e68a947-99f1-42e1-9696-26c3370c8432', '0aad5e81-2f5d-44f2-9869-32ef9a85359b', 'bd4fb13d-65a3-4fbd-9fa4-36c0bc3bf66a'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:06:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-76a21df8-3d85-4c76-8dca-94fd7c9f170a req-b2dbac5a-a990-4526-bd65-41bceef1576d tempest-TestShelveInstance-1189375588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:06:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-76a21df8-3d85-4c76-8dca-94fd7c9f170a req-b2dbac5a-a990-4526-bd65-41bceef1576d tempest-TestShelveInstance-1189375588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:06:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [req-76a21df8-3d85-4c76-8dca-94fd7c9f170a req-b2dbac5a-a990-4526-bd65-41bceef1576d tempest-TestShelveInstance-1189375588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:06:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [req-76a21df8-3d85-4c76-8dca-94fd7c9f170a req-b2dbac5a-a990-4526-bd65-41bceef1576d tempest-TestShelveInstance-1189375588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:06:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-76a21df8-3d85-4c76-8dca-94fd7c9f170a req-b2dbac5a-a990-4526-bd65-41bceef1576d tempest-TestShelveInstance-1189375588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:06:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-76a21df8-3d85-4c76-8dca-94fd7c9f170a req-b2dbac5a-a990-4526-bd65-41bceef1576d tempest-TestShelveInstance-1189375588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:06:49 devstack sudo[104798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:06:49 devstack sudo[104798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:06:49 devstack sudo[104798]: pam_unix(sudo:session): session closed for user root Sep 04 18:06:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [req-76a21df8-3d85-4c76-8dca-94fd7c9f170a req-b2dbac5a-a990-4526-bd65-41bceef1576d tempest-TestShelveInstance-1189375588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.252s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:06:49 devstack cinder-volume[87314]: DEBUG cinder.manager [req-76a21df8-3d85-4c76-8dca-94fd7c9f170a req-b2dbac5a-a990-4526-bd65-41bceef1576d tempest-TestShelveInstance-1189375588 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:06:49 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-76a21df8-3d85-4c76-8dca-94fd7c9f170a req-b2dbac5a-a990-4526-bd65-41bceef1576d tempest-TestShelveInstance-1189375588 None] Deleted volume successfully. Sep 04 18:06:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [req-76a21df8-3d85-4c76-8dca-94fd7c9f170a req-b2dbac5a-a990-4526-bd65-41bceef1576d tempest-TestShelveInstance-1189375588 None] Lock "cinder-35266931-5cac-4526-98b7-88651db4bca0-delete_volume" released by "delete_volume" :: held 1.159s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:06:59 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=7,cinder:INSERT=3,cinder:UPDATE=6 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 18:06:59 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=5,cinder:UPDATE=10,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 18:07:21 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 18:07:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:07:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:07:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:07:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:07:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:07:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:07:21 devstack sudo[104821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:07:21 devstack sudo[104821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:07:21 devstack sudo[104821]: pam_unix(sudo:session): session closed for user root Sep 04 18:07:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.261s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:07:21 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:07:21 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running periodic task VolumeManager._thread_info {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 18:07:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] thread count: 28 {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 18:07:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] thread info: [<_MainThread(MainThread, started 139900377723008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 18:07:23 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-461c2c36-44d0-48c7-b442-7dca08250c7e tempest-TestStampPattern-1938697043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:07:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-461c2c36-44d0-48c7-b442-7dca08250c7e tempest-TestStampPattern-1938697043 None] Flow 'volume_create_manager' (8155ffe8-2c64-4194-8e98-4358cf460d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:07:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-461c2c36-44d0-48c7-b442-7dca08250c7e tempest-TestStampPattern-1938697043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70ed2df6-a66b-4691-83d4-71ca094f6956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:07:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-461c2c36-44d0-48c7-b442-7dca08250c7e tempest-TestStampPattern-1938697043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70ed2df6-a66b-4691-83d4-71ca094f6956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1147802639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=909ae4d1-c4e9-4596-afdb-8ecd73710f8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79a516a5f8c24882a725be9b575072d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:07:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:07:23Z,use_quota=True,user_id='a3717cf14c0f4ef5802cd6ce96e4d8ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:07:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-461c2c36-44d0-48c7-b442-7dca08250c7e tempest-TestStampPattern-1938697043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2403ba23-5834-437a-b985-e146c23ab5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:07:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-461c2c36-44d0-48c7-b442-7dca08250c7e tempest-TestStampPattern-1938697043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2403ba23-5834-437a-b985-e146c23ab5aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:07:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-461c2c36-44d0-48c7-b442-7dca08250c7e tempest-TestStampPattern-1938697043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5462c4cb-d5ea-447f-b850-ee641daccc68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:07:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-461c2c36-44d0-48c7-b442-7dca08250c7e tempest-TestStampPattern-1938697043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5462c4cb-d5ea-447f-b850-ee641daccc68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '909ae4d1-c4e9-4596-afdb-8ecd73710f8d', 'volume_name': 'volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:07:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-461c2c36-44d0-48c7-b442-7dca08250c7e tempest-TestStampPattern-1938697043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ba8881c-c4c9-4db6-afbe-94f6a27832bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:07:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-461c2c36-44d0-48c7-b442-7dca08250c7e tempest-TestStampPattern-1938697043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ba8881c-c4c9-4db6-afbe-94f6a27832bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:07:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-461c2c36-44d0-48c7-b442-7dca08250c7e tempest-TestStampPattern-1938697043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (116b415c-1f5e-4f15-8fbc-95b80cbf029d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:07:23 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-461c2c36-44d0-48c7-b442-7dca08250c7e tempest-TestStampPattern-1938697043 None] Volume 909ae4d1-c4e9-4596-afdb-8ecd73710f8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d', 'volume_size': 1} Sep 04 18:07:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-461c2c36-44d0-48c7-b442-7dca08250c7e tempest-TestStampPattern-1938697043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:07:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-461c2c36-44d0-48c7-b442-7dca08250c7e tempest-TestStampPattern-1938697043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:07:23 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-461c2c36-44d0-48c7-b442-7dca08250c7e tempest-TestStampPattern-1938697043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1147802639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=909ae4d1-c4e9-4596-afdb-8ecd73710f8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79a516a5f8c24882a725be9b575072d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:07:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:07:23Z,use_quota=True,user_id='a3717cf14c0f4ef5802cd6ce96e4d8ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:07:23 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-461c2c36-44d0-48c7-b442-7dca08250c7e tempest-TestStampPattern-1938697043 None] Creating volume 909ae4d1-c4e9-4596-afdb-8ecd73710f8d {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:07:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-461c2c36-44d0-48c7-b442-7dca08250c7e tempest-TestStampPattern-1938697043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:07:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-461c2c36-44d0-48c7-b442-7dca08250c7e tempest-TestStampPattern-1938697043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:07:23 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-461c2c36-44d0-48c7-b442-7dca08250c7e tempest-TestStampPattern-1938697043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:07:23 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-461c2c36-44d0-48c7-b442-7dca08250c7e tempest-TestStampPattern-1938697043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:07:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-461c2c36-44d0-48c7-b442-7dca08250c7e tempest-TestStampPattern-1938697043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:07:23 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-461c2c36-44d0-48c7-b442-7dca08250c7e tempest-TestStampPattern-1938697043 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:07:23 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-461c2c36-44d0-48c7-b442-7dca08250c7e tempest-TestStampPattern-1938697043 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:07:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-461c2c36-44d0-48c7-b442-7dca08250c7e tempest-TestStampPattern-1938697043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:07:23 devstack sudo[104824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d 1073741824 Sep 04 18:07:23 devstack sudo[104824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:07:23 devstack sudo[104824]: pam_unix(sudo:session): session closed for user root Sep 04 18:07:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-461c2c36-44d0-48c7-b442-7dca08250c7e tempest-TestStampPattern-1938697043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d 1073741824" returned: 0 in 0.420s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:07:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-461c2c36-44d0-48c7-b442-7dca08250c7e tempest-TestStampPattern-1938697043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:07:23 devstack sudo[104830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d Sep 04 18:07:23 devstack sudo[104830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:07:23 devstack sudo[104830]: pam_unix(sudo:session): session closed for user root Sep 04 18:07:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-461c2c36-44d0-48c7-b442-7dca08250c7e tempest-TestStampPattern-1938697043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d" returned: 0 in 0.271s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:07:23 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-461c2c36-44d0-48c7-b442-7dca08250c7e tempest-TestStampPattern-1938697043 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:07:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-461c2c36-44d0-48c7-b442-7dca08250c7e tempest-TestStampPattern-1938697043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:07:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-461c2c36-44d0-48c7-b442-7dca08250c7e tempest-TestStampPattern-1938697043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (116b415c-1f5e-4f15-8fbc-95b80cbf029d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:07:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-461c2c36-44d0-48c7-b442-7dca08250c7e tempest-TestStampPattern-1938697043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (157e4dd9-1837-41b2-89c1-36d3a2a97df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:07:23 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-461c2c36-44d0-48c7-b442-7dca08250c7e tempest-TestStampPattern-1938697043 None] Volume volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d (909ae4d1-c4e9-4596-afdb-8ecd73710f8d): created successfully Sep 04 18:07:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-461c2c36-44d0-48c7-b442-7dca08250c7e tempest-TestStampPattern-1938697043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (157e4dd9-1837-41b2-89c1-36d3a2a97df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:07:24 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-461c2c36-44d0-48c7-b442-7dca08250c7e tempest-TestStampPattern-1938697043 None] Flow 'volume_create_manager' (8155ffe8-2c64-4194-8e98-4358cf460d88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:07:24 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-461c2c36-44d0-48c7-b442-7dca08250c7e tempest-TestStampPattern-1938697043 None] Created volume successfully. Sep 04 18:07:34 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:UPDATE=4,cinder:SELECT=2 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 18:07:34 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=2,cinder:INSERT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 18:07:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-66c1aef6-071c-407c-8590-4076336bc075 req-2ee02384-d70a-42b8-a425-e9c77f4e524f tempest-TestStampPattern-1938697043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:07:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-66c1aef6-071c-407c-8590-4076336bc075 req-2ee02384-d70a-42b8-a425-e9c77f4e524f tempest-TestStampPattern-1938697043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:07:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-66c1aef6-071c-407c-8590-4076336bc075 req-2ee02384-d70a-42b8-a425-e9c77f4e524f tempest-TestStampPattern-1938697043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:07:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-66c1aef6-071c-407c-8590-4076336bc075 req-2ee02384-d70a-42b8-a425-e9c77f4e524f tempest-TestStampPattern-1938697043 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a', 'name': 'volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7069bf61-879d-4dca-8419-69f94c616cf2', 'enforce_multipath': True} {{(pid=87314) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 18:07:53 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-66c1aef6-071c-407c-8590-4076336bc075 req-2ee02384-d70a-42b8-a425-e9c77f4e524f tempest-TestStampPattern-1938697043 None] attachment_update completed successfully. Sep 04 18:07:57 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-ceeb668c-9774-4d89-b1c0-13b7fb486b93 req-928a763a-2926-4d9e-bc78-cfad69e6b913 tempest-TestStampPattern-1938697043 None] Terminate volume connection completed successfully. Sep 04 18:07:57 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-ceeb668c-9774-4d89-b1c0-13b7fb486b93 req-928a763a-2926-4d9e-bc78-cfad69e6b913 tempest-TestStampPattern-1938697043 None] Deleting attachment 7069bf61-879d-4dca-8419-69f94c616cf2. {{(pid=87314) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 18:07:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f556baa7-ba92-482a-a796-57160a6ebd7e tempest-TestStampPattern-1938697043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:07:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f556baa7-ba92-482a-a796-57160a6ebd7e tempest-TestStampPattern-1938697043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:07:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-f556baa7-ba92-482a-a796-57160a6ebd7e tempest-TestStampPattern-1938697043 None] Creating offline snapshot 5f383908-7525-4a96-b5ff-7ce4c3aecf8d of volume 909ae4d1-c4e9-4596-afdb-8ecd73710f8d {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 18:07:58 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[3066a418-23d1-4987-87dd-866666f3e2a4]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:07:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f556baa7-ba92-482a-a796-57160a6ebd7e tempest-TestStampPattern-1938697043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:07:58 devstack sudo[105427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d Sep 04 18:07:58 devstack sudo[105427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:07:58 devstack sudo[105427]: pam_unix(sudo:session): session closed for user root Sep 04 18:07:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f556baa7-ba92-482a-a796-57160a6ebd7e tempest-TestStampPattern-1938697043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d" returned: 0 in 0.358s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:07:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f556baa7-ba92-482a-a796-57160a6ebd7e tempest-TestStampPattern-1938697043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d.5f383908-7525-4a96-b5ff-7ce4c3aecf8d 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:07:58 devstack sudo[105432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d.5f383908-7525-4a96-b5ff-7ce4c3aecf8d 1G Sep 04 18:07:58 devstack sudo[105432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:07:59 devstack sudo[105432]: pam_unix(sudo:session): session closed for user root Sep 04 18:07:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f556baa7-ba92-482a-a796-57160a6ebd7e tempest-TestStampPattern-1938697043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d.5f383908-7525-4a96-b5ff-7ce4c3aecf8d 1G" returned: 0 in 0.400s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:07:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f556baa7-ba92-482a-a796-57160a6ebd7e tempest-TestStampPattern-1938697043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d.5f383908-7525-4a96-b5ff-7ce4c3aecf8d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:07:59 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d.5f383908-7525-4a96-b5ff-7ce4c3aecf8d Sep 04 18:07:59 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:07:59 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Sep 04 18:07:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f556baa7-ba92-482a-a796-57160a6ebd7e tempest-TestStampPattern-1938697043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d.5f383908-7525-4a96-b5ff-7ce4c3aecf8d" returned: 0 in 0.287s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:07:59 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-f556baa7-ba92-482a-a796-57160a6ebd7e tempest-TestStampPattern-1938697043 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d.5f383908-7525-4a96-b5ff-7ce4c3aecf8d is being set with open permissions: ugo+rw Sep 04 18:07:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f556baa7-ba92-482a-a796-57160a6ebd7e tempest-TestStampPattern-1938697043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d.5f383908-7525-4a96-b5ff-7ce4c3aecf8d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:07:59 devstack sudo[105442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d.5f383908-7525-4a96-b5ff-7ce4c3aecf8d Sep 04 18:07:59 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:07:59 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root Sep 04 18:07:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f556baa7-ba92-482a-a796-57160a6ebd7e tempest-TestStampPattern-1938697043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d.5f383908-7525-4a96-b5ff-7ce4c3aecf8d" returned: 0 in 0.242s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:07:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f556baa7-ba92-482a-a796-57160a6ebd7e tempest-TestStampPattern-1938697043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:07:59 devstack sudo[105445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d.info Sep 04 18:07:59 devstack sudo[105445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:08:00 devstack sudo[105445]: pam_unix(sudo:session): session closed for user root Sep 04 18:08:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f556baa7-ba92-482a-a796-57160a6ebd7e tempest-TestStampPattern-1938697043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d.info" returned: 0 in 0.242s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:08:00 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-f556baa7-ba92-482a-a796-57160a6ebd7e tempest-TestStampPattern-1938697043 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d.info is being set with open permissions: ugo+rw Sep 04 18:08:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f556baa7-ba92-482a-a796-57160a6ebd7e tempest-TestStampPattern-1938697043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:08:00 devstack sudo[105449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d.info Sep 04 18:08:00 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:08:00 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root Sep 04 18:08:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f556baa7-ba92-482a-a796-57160a6ebd7e tempest-TestStampPattern-1938697043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d.info" returned: 0 in 0.230s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:08:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f556baa7-ba92-482a-a796-57160a6ebd7e tempest-TestStampPattern-1938697043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.843s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:08:00 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-f556baa7-ba92-482a-a796-57160a6ebd7e tempest-TestStampPattern-1938697043 None] Create snapshot completed successfully Sep 04 18:08:07 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-414f986e-50a9-4bae-a6be-b0b4f7c1544a tempest-TestStampPattern-1938697043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:08:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-414f986e-50a9-4bae-a6be-b0b4f7c1544a tempest-TestStampPattern-1938697043 None] Flow 'volume_create_manager' (c082fa63-a2f4-4567-90a8-3c0f3eac0f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:08:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-414f986e-50a9-4bae-a6be-b0b4f7c1544a tempest-TestStampPattern-1938697043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17e6c926-10f3-45e5-9993-ba9da27f6cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:08:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-414f986e-50a9-4bae-a6be-b0b4f7c1544a tempest-TestStampPattern-1938697043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17e6c926-10f3-45e5-9993-ba9da27f6cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-245123420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb7799fb-26ff-4897-88ea-47102d135b06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79a516a5f8c24882a725be9b575072d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5f383908-7525-4a96-b5ff-7ce4c3aecf8d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:08:07Z,use_quota=True,user_id='a3717cf14c0f4ef5802cd6ce96e4d8ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:08:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-414f986e-50a9-4bae-a6be-b0b4f7c1544a tempest-TestStampPattern-1938697043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46a8b27c-5496-4d9e-9030-83c87367d795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:08:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-414f986e-50a9-4bae-a6be-b0b4f7c1544a tempest-TestStampPattern-1938697043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46a8b27c-5496-4d9e-9030-83c87367d795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:08:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-414f986e-50a9-4bae-a6be-b0b4f7c1544a tempest-TestStampPattern-1938697043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0faa48d3-39cc-491d-b652-9baec490b2de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:08:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-414f986e-50a9-4bae-a6be-b0b4f7c1544a tempest-TestStampPattern-1938697043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0faa48d3-39cc-491d-b652-9baec490b2de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'eb7799fb-26ff-4897-88ea-47102d135b06', 'volume_name': 'volume-eb7799fb-26ff-4897-88ea-47102d135b06', 'volume_size': 1, 'snapshot_id': '5f383908-7525-4a96-b5ff-7ce4c3aecf8d'}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:08:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-414f986e-50a9-4bae-a6be-b0b4f7c1544a tempest-TestStampPattern-1938697043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7054b3e1-280b-4396-aa55-f71dfad99b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:08:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-414f986e-50a9-4bae-a6be-b0b4f7c1544a tempest-TestStampPattern-1938697043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7054b3e1-280b-4396-aa55-f71dfad99b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:08:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-414f986e-50a9-4bae-a6be-b0b4f7c1544a tempest-TestStampPattern-1938697043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (829f9639-fb1a-40d3-9a62-122edd2a72e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:08:07 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-414f986e-50a9-4bae-a6be-b0b4f7c1544a tempest-TestStampPattern-1938697043 None] Volume eb7799fb-26ff-4897-88ea-47102d135b06: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-eb7799fb-26ff-4897-88ea-47102d135b06', 'volume_size': 1, 'snapshot_id': '5f383908-7525-4a96-b5ff-7ce4c3aecf8d'} Sep 04 18:08:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-414f986e-50a9-4bae-a6be-b0b4f7c1544a tempest-TestStampPattern-1938697043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:08:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-414f986e-50a9-4bae-a6be-b0b4f7c1544a tempest-TestStampPattern-1938697043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:08:07 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-414f986e-50a9-4bae-a6be-b0b4f7c1544a tempest-TestStampPattern-1938697043 None] Acquiring lock "cinder-quobyte-5f383908-7525-4a96-b5ff-7ce4c3aecf8d-eb7799fb-26ff-4897-88ea-47102d135b06" by "_create_volume_from_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:08:07 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-414f986e-50a9-4bae-a6be-b0b4f7c1544a tempest-TestStampPattern-1938697043 None] Lock "cinder-quobyte-5f383908-7525-4a96-b5ff-7ce4c3aecf8d-eb7799fb-26ff-4897-88ea-47102d135b06" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:08:07 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-414f986e-50a9-4bae-a6be-b0b4f7c1544a tempest-TestStampPattern-1938697043 None] Creating volume eb7799fb-26ff-4897-88ea-47102d135b06 from snapshot 5f383908-7525-4a96-b5ff-7ce4c3aecf8d {{(pid=87314) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 04 18:08:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-414f986e-50a9-4bae-a6be-b0b4f7c1544a tempest-TestStampPattern-1938697043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:08:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-414f986e-50a9-4bae-a6be-b0b4f7c1544a tempest-TestStampPattern-1938697043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:08:07 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-414f986e-50a9-4bae-a6be-b0b4f7c1544a tempest-TestStampPattern-1938697043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:08:07 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-414f986e-50a9-4bae-a6be-b0b4f7c1544a tempest-TestStampPattern-1938697043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:08:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-414f986e-50a9-4bae-a6be-b0b4f7c1544a tempest-TestStampPattern-1938697043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:08:07 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-414f986e-50a9-4bae-a6be-b0b4f7c1544a tempest-TestStampPattern-1938697043 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:08:07 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-414f986e-50a9-4bae-a6be-b0b4f7c1544a tempest-TestStampPattern-1938697043 None] Acquiring lock "cinder-quobyte-eb7799fb-26ff-4897-88ea-47102d135b06" by "_copy_volume_from_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:08:07 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-414f986e-50a9-4bae-a6be-b0b4f7c1544a tempest-TestStampPattern-1938697043 None] Lock "cinder-quobyte-eb7799fb-26ff-4897-88ea-47102d135b06" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:08:07 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-414f986e-50a9-4bae-a6be-b0b4f7c1544a tempest-TestStampPattern-1938697043 None] snapshot: 5f383908-7525-4a96-b5ff-7ce4c3aecf8d, volume: eb7799fb-26ff-4897-88ea-47102d135b06, {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 04 18:08:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-414f986e-50a9-4bae-a6be-b0b4f7c1544a tempest-TestStampPattern-1938697043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:08:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-414f986e-50a9-4bae-a6be-b0b4f7c1544a tempest-TestStampPattern-1938697043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:08:07 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-414f986e-50a9-4bae-a6be-b0b4f7c1544a tempest-TestStampPattern-1938697043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:08:07 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-414f986e-50a9-4bae-a6be-b0b4f7c1544a tempest-TestStampPattern-1938697043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:08:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-414f986e-50a9-4bae-a6be-b0b4f7c1544a tempest-TestStampPattern-1938697043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:08:07 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[44da75fe-9f65-4765-9c4f-1aaa74e02585]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:08:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-414f986e-50a9-4bae-a6be-b0b4f7c1544a tempest-TestStampPattern-1938697043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d.5f383908-7525-4a96-b5ff-7ce4c3aecf8d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:08:07 devstack sudo[105486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d.5f383908-7525-4a96-b5ff-7ce4c3aecf8d Sep 04 18:08:07 devstack sudo[105486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:08:07 devstack sudo[105486]: pam_unix(sudo:session): session closed for user root Sep 04 18:08:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-414f986e-50a9-4bae-a6be-b0b4f7c1544a tempest-TestStampPattern-1938697043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d.5f383908-7525-4a96-b5ff-7ce4c3aecf8d" returned: 0 in 0.373s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:08:07 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-414f986e-50a9-4bae-a6be-b0b4f7c1544a tempest-TestStampPattern-1938697043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 18:08:07 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c0c620-d471-44ec-9311-2b4a4afe56f5]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:08:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-414f986e-50a9-4bae-a6be-b0b4f7c1544a tempest-TestStampPattern-1938697043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:08:08 devstack sudo[105491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d Sep 04 18:08:08 devstack sudo[105491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:08:08 devstack sudo[105491]: pam_unix(sudo:session): session closed for user root Sep 04 18:08:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-414f986e-50a9-4bae-a6be-b0b4f7c1544a tempest-TestStampPattern-1938697043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d" returned: 0 in 0.400s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:08:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-414f986e-50a9-4bae-a6be-b0b4f7c1544a tempest-TestStampPattern-1938697043 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 04 18:08:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-414f986e-50a9-4bae-a6be-b0b4f7c1544a tempest-TestStampPattern-1938697043 None] Creating direct copy from snapshot {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 04 18:08:08 devstack cinder-volume[87314]: DEBUG cinder.utils [None req-414f986e-50a9-4bae-a6be-b0b4f7c1544a tempest-TestStampPattern-1938697043 None] Path /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-eb7799fb-26ff-4897-88ea-47102d135b06 not found in is_blk_device check {{(pid=87314) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 04 18:08:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-414f986e-50a9-4bae-a6be-b0b4f7c1544a tempest-TestStampPattern-1938697043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-eb7799fb-26ff-4897-88ea-47102d135b06 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:08:08 devstack sudo[105499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-eb7799fb-26ff-4897-88ea-47102d135b06 Sep 04 18:08:08 devstack sudo[105499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:08:14 devstack sudo[105499]: pam_unix(sudo:session): session closed for user root Sep 04 18:08:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-414f986e-50a9-4bae-a6be-b0b4f7c1544a tempest-TestStampPattern-1938697043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-eb7799fb-26ff-4897-88ea-47102d135b06" returned: 0 in 5.712s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:08:14 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-414f986e-50a9-4bae-a6be-b0b4f7c1544a tempest-TestStampPattern-1938697043 None] Image conversion details: src /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d, size 1024.00 MB, duration 5.71 sec, destination /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-eb7799fb-26ff-4897-88ea-47102d135b06 {{(pid=87314) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 18:08:14 devstack cinder-volume[87314]: INFO cinder.image.image_utils [None req-414f986e-50a9-4bae-a6be-b0b4f7c1544a tempest-TestStampPattern-1938697043 None] Converted 1024.00 MB image at 179.25 MB/s Sep 04 18:08:14 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-414f986e-50a9-4bae-a6be-b0b4f7c1544a tempest-TestStampPattern-1938697043 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-eb7799fb-26ff-4897-88ea-47102d135b06 is being set with open permissions: ugo+rw Sep 04 18:08:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-414f986e-50a9-4bae-a6be-b0b4f7c1544a tempest-TestStampPattern-1938697043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-eb7799fb-26ff-4897-88ea-47102d135b06 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:08:14 devstack sudo[105530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-eb7799fb-26ff-4897-88ea-47102d135b06 Sep 04 18:08:14 devstack sudo[105530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:08:14 devstack sudo[105530]: pam_unix(sudo:session): session closed for user root Sep 04 18:08:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-414f986e-50a9-4bae-a6be-b0b4f7c1544a tempest-TestStampPattern-1938697043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-eb7799fb-26ff-4897-88ea-47102d135b06" returned: 0 in 0.266s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:08:14 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-414f986e-50a9-4bae-a6be-b0b4f7c1544a tempest-TestStampPattern-1938697043 None] Lock "cinder-quobyte-eb7799fb-26ff-4897-88ea-47102d135b06" released by "_copy_volume_from_snapshot" :: held 6.840s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:08:14 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-414f986e-50a9-4bae-a6be-b0b4f7c1544a tempest-TestStampPattern-1938697043 None] Lock "cinder-quobyte-5f383908-7525-4a96-b5ff-7ce4c3aecf8d-eb7799fb-26ff-4897-88ea-47102d135b06" released by "_create_volume_from_snapshot" :: held 6.915s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:08:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-414f986e-50a9-4bae-a6be-b0b4f7c1544a tempest-TestStampPattern-1938697043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.932s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:08:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-414f986e-50a9-4bae-a6be-b0b4f7c1544a tempest-TestStampPattern-1938697043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (829f9639-fb1a-40d3-9a62-122edd2a72e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb7799fb-26ff-4897-88ea-47102d135b06', 'volume_size': 1, 'snapshot_id': '5f383908-7525-4a96-b5ff-7ce4c3aecf8d'}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:08:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-414f986e-50a9-4bae-a6be-b0b4f7c1544a tempest-TestStampPattern-1938697043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (419d18b1-69d2-468a-966c-9bac4afbbe8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:08:14 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-414f986e-50a9-4bae-a6be-b0b4f7c1544a tempest-TestStampPattern-1938697043 None] Volume volume-eb7799fb-26ff-4897-88ea-47102d135b06 (eb7799fb-26ff-4897-88ea-47102d135b06): created successfully Sep 04 18:08:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-414f986e-50a9-4bae-a6be-b0b4f7c1544a tempest-TestStampPattern-1938697043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (419d18b1-69d2-468a-966c-9bac4afbbe8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:08:14 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-414f986e-50a9-4bae-a6be-b0b4f7c1544a tempest-TestStampPattern-1938697043 None] Flow 'volume_create_manager' (c082fa63-a2f4-4567-90a8-3c0f3eac0f25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:08:14 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-414f986e-50a9-4bae-a6be-b0b4f7c1544a tempest-TestStampPattern-1938697043 None] Created volume successfully. Sep 04 18:08:21 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 18:08:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:08:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:08:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:08:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:08:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:08:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:08:21 devstack sudo[105602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:08:21 devstack sudo[105602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:08:21 devstack sudo[105602]: pam_unix(sudo:session): session closed for user root Sep 04 18:08:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.246s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:08:21 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:08:21 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running periodic task VolumeManager._thread_info {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 18:08:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] thread count: 28 {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 18:08:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] thread info: [<_MainThread(MainThread, started 139900377723008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 18:08:24 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=16,cinder:UPDATE=8,cinder:INSERT=1 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 18:08:24 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=14,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=2 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 18:08:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-e16093ca-4f7b-4f6d-bd30-f67ee8772968 req-26a57b0b-b4dd-4551-b20e-bfc2a1915450 tempest-TestStampPattern-1938697043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:08:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-e16093ca-4f7b-4f6d-bd30-f67ee8772968 req-26a57b0b-b4dd-4551-b20e-bfc2a1915450 tempest-TestStampPattern-1938697043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:08:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [req-e16093ca-4f7b-4f6d-bd30-f67ee8772968 req-26a57b0b-b4dd-4551-b20e-bfc2a1915450 tempest-TestStampPattern-1938697043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:08:43 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-e16093ca-4f7b-4f6d-bd30-f67ee8772968 req-26a57b0b-b4dd-4551-b20e-bfc2a1915450 tempest-TestStampPattern-1938697043 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a', 'name': 'volume-eb7799fb-26ff-4897-88ea-47102d135b06', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '89009d6a-10cf-4ca4-b428-0f62cfe7b43f', 'enforce_multipath': True} {{(pid=87314) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 18:08:43 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-e16093ca-4f7b-4f6d-bd30-f67ee8772968 req-26a57b0b-b4dd-4551-b20e-bfc2a1915450 tempest-TestStampPattern-1938697043 None] attachment_update completed successfully. Sep 04 18:08:47 devstack cinder-volume[87314]: INFO cinder.volume.manager [req-18b4b4b8-422f-4ac5-8611-c882168dd087 req-3677cd9f-20e8-4f73-ac1b-f5a1fe2ff0d1 tempest-TestStampPattern-1938697043 None] Terminate volume connection completed successfully. Sep 04 18:08:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [req-18b4b4b8-422f-4ac5-8611-c882168dd087 req-3677cd9f-20e8-4f73-ac1b-f5a1fe2ff0d1 tempest-TestStampPattern-1938697043 None] Deleting attachment 89009d6a-10cf-4ca4-b428-0f62cfe7b43f. {{(pid=87314) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 18:08:51 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8cbb44e5-b53d-4636-a34a-1431ec86f199 tempest-TestStampPattern-1938697043 None] Acquiring lock "cinder-eb7799fb-26ff-4897-88ea-47102d135b06-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:08:51 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8cbb44e5-b53d-4636-a34a-1431ec86f199 tempest-TestStampPattern-1938697043 None] Lock "cinder-eb7799fb-26ff-4897-88ea-47102d135b06-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:08:51 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8cbb44e5-b53d-4636-a34a-1431ec86f199 tempest-TestStampPattern-1938697043 None] Acquiring lock "cinder-quobyte-eb7799fb-26ff-4897-88ea-47102d135b06" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:08:51 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8cbb44e5-b53d-4636-a34a-1431ec86f199 tempest-TestStampPattern-1938697043 None] Lock "cinder-quobyte-eb7799fb-26ff-4897-88ea-47102d135b06" acquired by "delete_volume" :: waited 0.019s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:08:51 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[195606d8-82f1-4fc0-b772-f22113e99aa5]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:08:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8cbb44e5-b53d-4636-a34a-1431ec86f199 tempest-TestStampPattern-1938697043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-eb7799fb-26ff-4897-88ea-47102d135b06 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:08:51 devstack sudo[106127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-eb7799fb-26ff-4897-88ea-47102d135b06 Sep 04 18:08:51 devstack sudo[106127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:08:52 devstack sudo[106127]: pam_unix(sudo:session): session closed for user root Sep 04 18:08:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8cbb44e5-b53d-4636-a34a-1431ec86f199 tempest-TestStampPattern-1938697043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-eb7799fb-26ff-4897-88ea-47102d135b06" returned: 0 in 0.390s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:08:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8cbb44e5-b53d-4636-a34a-1431ec86f199 tempest-TestStampPattern-1938697043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-eb7799fb-26ff-4897-88ea-47102d135b06 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:08:52 devstack sudo[106132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-eb7799fb-26ff-4897-88ea-47102d135b06 Sep 04 18:08:52 devstack sudo[106132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:08:52 devstack sudo[106132]: pam_unix(sudo:session): session closed for user root Sep 04 18:08:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8cbb44e5-b53d-4636-a34a-1431ec86f199 tempest-TestStampPattern-1938697043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-eb7799fb-26ff-4897-88ea-47102d135b06" returned: 0 in 0.245s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:08:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8cbb44e5-b53d-4636-a34a-1431ec86f199 tempest-TestStampPattern-1938697043 None] Lock "cinder-quobyte-eb7799fb-26ff-4897-88ea-47102d135b06" released by "delete_volume" :: held 0.676s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:08:52 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-8cbb44e5-b53d-4636-a34a-1431ec86f199 tempest-TestStampPattern-1938697043 None] Created reservations ['5ca88864-9622-472f-8ee6-de18a726611a', 'a321daab-c37d-4a6f-922c-8289fffed1e4', 'c5a0088e-27fa-4c8b-832b-126d7fe63078', '0e115fc6-54a9-4206-b179-c026d19ec33a'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:08:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8cbb44e5-b53d-4636-a34a-1431ec86f199 tempest-TestStampPattern-1938697043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:08:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8cbb44e5-b53d-4636-a34a-1431ec86f199 tempest-TestStampPattern-1938697043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:08:52 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8cbb44e5-b53d-4636-a34a-1431ec86f199 tempest-TestStampPattern-1938697043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:08:52 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8cbb44e5-b53d-4636-a34a-1431ec86f199 tempest-TestStampPattern-1938697043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:08:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8cbb44e5-b53d-4636-a34a-1431ec86f199 tempest-TestStampPattern-1938697043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:08:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8cbb44e5-b53d-4636-a34a-1431ec86f199 tempest-TestStampPattern-1938697043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:08:52 devstack sudo[106135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:08:52 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:08:52 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root Sep 04 18:08:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8cbb44e5-b53d-4636-a34a-1431ec86f199 tempest-TestStampPattern-1938697043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.260s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:08:52 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-8cbb44e5-b53d-4636-a34a-1431ec86f199 tempest-TestStampPattern-1938697043 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:08:52 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-8cbb44e5-b53d-4636-a34a-1431ec86f199 tempest-TestStampPattern-1938697043 None] Deleted volume successfully. Sep 04 18:08:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8cbb44e5-b53d-4636-a34a-1431ec86f199 tempest-TestStampPattern-1938697043 None] Lock "cinder-eb7799fb-26ff-4897-88ea-47102d135b06-delete_volume" released by "delete_volume" :: held 1.151s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:08:53 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e1f743f4-04e3-48ed-9576-4f5972ea9e51 tempest-TestStampPattern-1938697043 None] Acquiring lock "cinder-5f383908-7525-4a96-b5ff-7ce4c3aecf8d-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:08:53 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e1f743f4-04e3-48ed-9576-4f5972ea9e51 tempest-TestStampPattern-1938697043 None] Lock "cinder-5f383908-7525-4a96-b5ff-7ce4c3aecf8d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:08:53 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e1f743f4-04e3-48ed-9576-4f5972ea9e51 tempest-TestStampPattern-1938697043 None] Acquiring lock "cinder-quobyte-909ae4d1-c4e9-4596-afdb-8ecd73710f8d" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:08:53 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e1f743f4-04e3-48ed-9576-4f5972ea9e51 tempest-TestStampPattern-1938697043 None] Lock "cinder-quobyte-909ae4d1-c4e9-4596-afdb-8ecd73710f8d" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:08:53 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e1f743f4-04e3-48ed-9576-4f5972ea9e51 tempest-TestStampPattern-1938697043 None] Acquiring lock "cinder-quobyte-5f383908-7525-4a96-b5ff-7ce4c3aecf8d" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:08:53 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e1f743f4-04e3-48ed-9576-4f5972ea9e51 tempest-TestStampPattern-1938697043 None] Lock "cinder-quobyte-5f383908-7525-4a96-b5ff-7ce4c3aecf8d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:08:53 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-e1f743f4-04e3-48ed-9576-4f5972ea9e51 tempest-TestStampPattern-1938697043 None] Deleting offline snapshot 5f383908-7525-4a96-b5ff-7ce4c3aecf8d of volume 909ae4d1-c4e9-4596-afdb-8ecd73710f8d {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 18:08:53 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-e1f743f4-04e3-48ed-9576-4f5972ea9e51 tempest-TestStampPattern-1938697043 None] snapshot_file for this snap is: volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d.5f383908-7525-4a96-b5ff-7ce4c3aecf8d {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 18:08:53 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b3a063-4aa5-4081-a9c7-e561d18c1031]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:08:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e1f743f4-04e3-48ed-9576-4f5972ea9e51 tempest-TestStampPattern-1938697043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d.5f383908-7525-4a96-b5ff-7ce4c3aecf8d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:08:53 devstack sudo[106138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d.5f383908-7525-4a96-b5ff-7ce4c3aecf8d Sep 04 18:08:53 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:08:53 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root Sep 04 18:08:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e1f743f4-04e3-48ed-9576-4f5972ea9e51 tempest-TestStampPattern-1938697043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d.5f383908-7525-4a96-b5ff-7ce4c3aecf8d" returned: 0 in 0.373s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:08:53 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-e1f743f4-04e3-48ed-9576-4f5972ea9e51 tempest-TestStampPattern-1938697043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 18:08:53 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c9dd54-806a-479f-97c4-c106f351f7af]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:08:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e1f743f4-04e3-48ed-9576-4f5972ea9e51 tempest-TestStampPattern-1938697043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:08:53 devstack sudo[106143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d Sep 04 18:08:53 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:08:54 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root Sep 04 18:08:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e1f743f4-04e3-48ed-9576-4f5972ea9e51 tempest-TestStampPattern-1938697043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d" returned: 0 in 0.535s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:08:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e1f743f4-04e3-48ed-9576-4f5972ea9e51 tempest-TestStampPattern-1938697043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d.5f383908-7525-4a96-b5ff-7ce4c3aecf8d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:08:54 devstack sudo[106150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d.5f383908-7525-4a96-b5ff-7ce4c3aecf8d Sep 04 18:08:54 devstack sudo[106150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:08:54 devstack sudo[106150]: pam_unix(sudo:session): session closed for user root Sep 04 18:08:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e1f743f4-04e3-48ed-9576-4f5972ea9e51 tempest-TestStampPattern-1938697043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d.5f383908-7525-4a96-b5ff-7ce4c3aecf8d" returned: 0 in 0.349s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:08:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e1f743f4-04e3-48ed-9576-4f5972ea9e51 tempest-TestStampPattern-1938697043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d.5f383908-7525-4a96-b5ff-7ce4c3aecf8d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:08:54 devstack sudo[106155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d.5f383908-7525-4a96-b5ff-7ce4c3aecf8d Sep 04 18:08:54 devstack sudo[106155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:08:54 devstack sudo[106155]: pam_unix(sudo:session): session closed for user root Sep 04 18:08:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e1f743f4-04e3-48ed-9576-4f5972ea9e51 tempest-TestStampPattern-1938697043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d.5f383908-7525-4a96-b5ff-7ce4c3aecf8d" returned: 0 in 0.261s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:08:54 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e1f743f4-04e3-48ed-9576-4f5972ea9e51 tempest-TestStampPattern-1938697043 None] Lock "cinder-quobyte-5f383908-7525-4a96-b5ff-7ce4c3aecf8d" released by "_delete_snapshot" :: held 1.631s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:08:54 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e1f743f4-04e3-48ed-9576-4f5972ea9e51 tempest-TestStampPattern-1938697043 None] Lock "cinder-quobyte-909ae4d1-c4e9-4596-afdb-8ecd73710f8d" released by "delete_snapshot" :: held 1.655s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:08:54 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-e1f743f4-04e3-48ed-9576-4f5972ea9e51 tempest-TestStampPattern-1938697043 None] Created reservations ['4664bd76-2de0-4d0b-ab1b-f32aa5512c20', '4b18c8d5-e32f-4853-a6a2-028807fe89b1', 'd5ffbfd4-0b75-4990-bea7-56b59d16eb37', '2bfdae64-1ae0-46ab-b1d1-8e0053f42fc7'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:08:54 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-e1f743f4-04e3-48ed-9576-4f5972ea9e51 tempest-TestStampPattern-1938697043 None] Delete snapshot completed successfully. Sep 04 18:08:54 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e1f743f4-04e3-48ed-9576-4f5972ea9e51 tempest-TestStampPattern-1938697043 None] Lock "cinder-5f383908-7525-4a96-b5ff-7ce4c3aecf8d-delete_snapshot" released by "delete_snapshot" :: held 1.797s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:08:58 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b75cd3f6-41fa-446b-9c9b-88c893e632c5 tempest-TestStampPattern-1938697043 None] Acquiring lock "cinder-909ae4d1-c4e9-4596-afdb-8ecd73710f8d-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:08:58 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b75cd3f6-41fa-446b-9c9b-88c893e632c5 tempest-TestStampPattern-1938697043 None] Lock "cinder-909ae4d1-c4e9-4596-afdb-8ecd73710f8d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:08:58 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b75cd3f6-41fa-446b-9c9b-88c893e632c5 tempest-TestStampPattern-1938697043 None] Acquiring lock "cinder-quobyte-909ae4d1-c4e9-4596-afdb-8ecd73710f8d" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:08:58 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b75cd3f6-41fa-446b-9c9b-88c893e632c5 tempest-TestStampPattern-1938697043 None] Lock "cinder-quobyte-909ae4d1-c4e9-4596-afdb-8ecd73710f8d" acquired by "delete_volume" :: waited 0.014s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:08:59 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ec3ef8-d0cb-433e-a28e-8711e0a8bd1e]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:08:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b75cd3f6-41fa-446b-9c9b-88c893e632c5 tempest-TestStampPattern-1938697043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:08:59 devstack sudo[106184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d Sep 04 18:08:59 devstack sudo[106184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:08:59 devstack sudo[106184]: pam_unix(sudo:session): session closed for user root Sep 04 18:08:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b75cd3f6-41fa-446b-9c9b-88c893e632c5 tempest-TestStampPattern-1938697043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d" returned: 0 in 0.370s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:08:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b75cd3f6-41fa-446b-9c9b-88c893e632c5 tempest-TestStampPattern-1938697043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:08:59 devstack sudo[106189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d Sep 04 18:08:59 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:08:59 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root Sep 04 18:08:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b75cd3f6-41fa-446b-9c9b-88c893e632c5 tempest-TestStampPattern-1938697043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-909ae4d1-c4e9-4596-afdb-8ecd73710f8d" returned: 0 in 0.244s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:08:59 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b75cd3f6-41fa-446b-9c9b-88c893e632c5 tempest-TestStampPattern-1938697043 None] Lock "cinder-quobyte-909ae4d1-c4e9-4596-afdb-8ecd73710f8d" released by "delete_volume" :: held 0.682s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:08:59 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-b75cd3f6-41fa-446b-9c9b-88c893e632c5 tempest-TestStampPattern-1938697043 None] Created reservations ['c1585c3c-703c-43c7-9710-5df4c16a4370', '5495317c-f570-4a37-a326-74c1bf58cfae', '4afd6d41-7e01-4a93-9a4d-e57f4be965f7', '590891ae-ac92-4ddc-b759-2b75ca69605b'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:08:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b75cd3f6-41fa-446b-9c9b-88c893e632c5 tempest-TestStampPattern-1938697043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:08:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b75cd3f6-41fa-446b-9c9b-88c893e632c5 tempest-TestStampPattern-1938697043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:08:59 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b75cd3f6-41fa-446b-9c9b-88c893e632c5 tempest-TestStampPattern-1938697043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:08:59 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b75cd3f6-41fa-446b-9c9b-88c893e632c5 tempest-TestStampPattern-1938697043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:08:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b75cd3f6-41fa-446b-9c9b-88c893e632c5 tempest-TestStampPattern-1938697043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:08:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b75cd3f6-41fa-446b-9c9b-88c893e632c5 tempest-TestStampPattern-1938697043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:08:59 devstack sudo[106192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:08:59 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:09:00 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root Sep 04 18:09:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b75cd3f6-41fa-446b-9c9b-88c893e632c5 tempest-TestStampPattern-1938697043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.261s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:09:00 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-b75cd3f6-41fa-446b-9c9b-88c893e632c5 tempest-TestStampPattern-1938697043 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:09:00 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-b75cd3f6-41fa-446b-9c9b-88c893e632c5 tempest-TestStampPattern-1938697043 None] Deleted volume successfully. Sep 04 18:09:00 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b75cd3f6-41fa-446b-9c9b-88c893e632c5 tempest-TestStampPattern-1938697043 None] Lock "cinder-909ae4d1-c4e9-4596-afdb-8ecd73710f8d-delete_volume" released by "delete_volume" :: held 1.139s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:09:09 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=22,cinder:UPDATE=24,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 18:09:10 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=24,cinder:UPDATE=22,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 18:09:16 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:09:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Flow 'volume_create_manager' (9d46a5d9-1b42-4562-9470-2c5ea8baf854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:09:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (611628ad-9595-43cf-a0ae-98e7f3985497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:09:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (611628ad-9595-43cf-a0ae-98e7f3985497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:09:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03aab174-8ff9-401a-b11f-839dda1764dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e50aa9e5fccc4293bf78e924eab68131',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:09:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:09:16Z,use_quota=True,user_id='a71cd671c51f45a7ac81e168f8021551',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(135fb74b-ea81-491e-8b81-6069f5ea8be8),volume_type_id=135fb74b-ea81-491e-8b81-6069f5ea8be8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:09:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e6746d9-1f23-46b0-ac69-0ba7f5aa4704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:09:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e6746d9-1f23-46b0-ac69-0ba7f5aa4704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:09:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81877657-3d12-4271-b598-db8fa0e0ccf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:09:16 devstack cinder-volume[87314]: DEBUG cinder.image.glance [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Creating Keystone auth plugin from conf {{(pid=87314) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 04 18:09:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81877657-3d12-4271-b598-db8fa0e0ccf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '03aab174-8ff9-401a-b11f-839dda1764dc', 'volume_name': 'volume-03aab174-8ff9-401a-b11f-839dda1764dc', 'volume_size': 1, 'image_id': 'cf4c6cf8-b36f-4379-a93a-f4d2edab8d4c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cf4c6cf8-b36f-4379-a93a-f4d2edab8d4c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '340a63ad279f2316f953d6cfd0682df2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e50aa9e5fccc4293bf78e924eab68131', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3e2f1438c3a64259d8772798c7651926de85495619dd299e0f571a2b80d3810f1075daa6530826208a8f23f2d27fda268eac66b9114d4a5b00e98a3deec0b031', 'id': 'cf4c6cf8-b36f-4379-a93a-f4d2edab8d4c', 'created_at': datetime.datetime(2026, 9, 4, 16, 9, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 16, 9, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cf4c6cf8-b36f-4379-a93a-f4d2edab8d4c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:09:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (769b29a1-778c-4d76-b00f-9d65760def82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:09:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (769b29a1-778c-4d76-b00f-9d65760def82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:09:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3c85606-53d0-4c67-aa0d-b7061789c051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:09:16 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Volume 03aab174-8ff9-401a-b11f-839dda1764dc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-03aab174-8ff9-401a-b11f-839dda1764dc', 'volume_size': 1, 'image_id': 'cf4c6cf8-b36f-4379-a93a-f4d2edab8d4c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cf4c6cf8-b36f-4379-a93a-f4d2edab8d4c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '340a63ad279f2316f953d6cfd0682df2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e50aa9e5fccc4293bf78e924eab68131', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3e2f1438c3a64259d8772798c7651926de85495619dd299e0f571a2b80d3810f1075daa6530826208a8f23f2d27fda268eac66b9114d4a5b00e98a3deec0b031', 'id': 'cf4c6cf8-b36f-4379-a93a-f4d2edab8d4c', 'created_at': datetime.datetime(2026, 9, 4, 16, 9, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 16, 9, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cf4c6cf8-b36f-4379-a93a-f4d2edab8d4c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 04 18:09:16 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Trying to clone 03aab174-8ff9-401a-b11f-839dda1764dc from image cf4c6cf8-b36f-4379-a93a-f4d2edab8d4c at location (None, [{'url': 'file:///opt/stack/data/glance/images/cf4c6cf8-b36f-4379-a93a-f4d2edab8d4c', 'metadata': {}}]). {{(pid=87314) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 04 18:09:16 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cf4c6cf8-b36f-4379-a93a-f4d2edab8d4c_d1j1amb2devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87314) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 04 18:09:16 devstack cinder-volume[87314]: INFO cinder.image.image_utils [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Image download 0.00 MB at 0.00 MB/s Sep 04 18:09:16 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[737b33f3-d6b4-40ce-aa88-318cefeacb4e]: (4, 'raw') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:09:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf4c6cf8-b36f-4379-a93a-f4d2edab8d4c_d1j1amb2devstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:09:16 devstack sudo[106211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf4c6cf8-b36f-4379-a93a-f4d2edab8d4c_d1j1amb2devstack@QuobyteHD Sep 04 18:09:16 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:09:16 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root Sep 04 18:09:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf4c6cf8-b36f-4379-a93a-f4d2edab8d4c_d1j1amb2devstack@QuobyteHD" returned: 0 in 0.313s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:09:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf4c6cf8-b36f-4379-a93a-f4d2edab8d4c_d1j1amb2devstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:09:17 devstack sudo[106215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf4c6cf8-b36f-4379-a93a-f4d2edab8d4c_d1j1amb2devstack@QuobyteHD Sep 04 18:09:17 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:09:17 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root Sep 04 18:09:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf4c6cf8-b36f-4379-a93a-f4d2edab8d4c_d1j1amb2devstack@QuobyteHD" returned: 1 in 0.314s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:09:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf4c6cf8-b36f-4379-a93a-f4d2edab8d4c_d1j1amb2devstack@QuobyteHD' failed. Not Retrying. {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 18:09:17 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Temporary image cf4c6cf8-b36f-4379-a93a-f4d2edab8d4c is fetched for user a71cd671c51f45a7ac81e168f8021551. {{(pid=87314) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 04 18:09:17 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a166e11-7f00-4a17-bbc5-5d908b260027]: (4, 'raw') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:09:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf4c6cf8-b36f-4379-a93a-f4d2edab8d4c_d1j1amb2devstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:09:17 devstack sudo[106222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf4c6cf8-b36f-4379-a93a-f4d2edab8d4c_d1j1amb2devstack@QuobyteHD Sep 04 18:09:17 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:09:17 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root Sep 04 18:09:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf4c6cf8-b36f-4379-a93a-f4d2edab8d4c_d1j1amb2devstack@QuobyteHD" returned: 0 in 0.335s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:09:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf4c6cf8-b36f-4379-a93a-f4d2edab8d4c_d1j1amb2devstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:09:17 devstack sudo[106226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf4c6cf8-b36f-4379-a93a-f4d2edab8d4c_d1j1amb2devstack@QuobyteHD Sep 04 18:09:17 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:09:17 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root Sep 04 18:09:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf4c6cf8-b36f-4379-a93a-f4d2edab8d4c_d1j1amb2devstack@QuobyteHD" returned: 1 in 0.329s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:09:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf4c6cf8-b36f-4379-a93a-f4d2edab8d4c_d1j1amb2devstack@QuobyteHD' failed. Not Retrying. {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 18:09:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:09:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:09:17 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:09:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03aab174-8ff9-401a-b11f-839dda1764dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e50aa9e5fccc4293bf78e924eab68131',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:09:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:09:16Z,use_quota=True,user_id='a71cd671c51f45a7ac81e168f8021551',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(135fb74b-ea81-491e-8b81-6069f5ea8be8),volume_type_id=135fb74b-ea81-491e-8b81-6069f5ea8be8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:09:17 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Creating volume 03aab174-8ff9-401a-b11f-839dda1764dc {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:09:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:09:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:09:17 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:09:17 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:09:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:09:17 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:09:17 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:09:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-03aab174-8ff9-401a-b11f-839dda1764dc 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:09:17 devstack sudo[106231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-03aab174-8ff9-401a-b11f-839dda1764dc 1073741824 Sep 04 18:09:17 devstack sudo[106231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:09:18 devstack sudo[106231]: pam_unix(sudo:session): session closed for user root Sep 04 18:09:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-03aab174-8ff9-401a-b11f-839dda1764dc 1073741824" returned: 0 in 0.388s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:09:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-03aab174-8ff9-401a-b11f-839dda1764dc {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:09:18 devstack sudo[106237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-03aab174-8ff9-401a-b11f-839dda1764dc Sep 04 18:09:18 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:09:18 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root Sep 04 18:09:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-03aab174-8ff9-401a-b11f-839dda1764dc" returned: 0 in 0.241s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:09:18 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] <== create_volume: return (674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:09:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.676s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:09:18 devstack cinder-volume[87314]: DEBUG cinder.volume.volume_utils [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Attempting download of cf4c6cf8-b36f-4379-a93a-f4d2edab8d4c ((None, [{'url': 'file:///opt/stack/data/glance/images/cf4c6cf8-b36f-4379-a93a-f4d2edab8d4c', 'metadata': {}}])) to volume 03aab174-8ff9-401a-b11f-839dda1764dc. {{(pid=87314) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 04 18:09:18 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[516038cb-8ba5-4de2-b7cf-6228d8569978]: (4, 'raw') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:09:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cf4c6cf8-b36f-4379-a93a-f4d2edab8d4c_zqwlubtm {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:09:18 devstack sudo[106240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cf4c6cf8-b36f-4379-a93a-f4d2edab8d4c_zqwlubtm Sep 04 18:09:18 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:09:19 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root Sep 04 18:09:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cf4c6cf8-b36f-4379-a93a-f4d2edab8d4c_zqwlubtm" returned: 0 in 0.319s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:09:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cf4c6cf8-b36f-4379-a93a-f4d2edab8d4c_zqwlubtm {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:09:19 devstack sudo[106244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cf4c6cf8-b36f-4379-a93a-f4d2edab8d4c_zqwlubtm Sep 04 18:09:19 devstack sudo[106244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:09:19 devstack sudo[106244]: pam_unix(sudo:session): session closed for user root Sep 04 18:09:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cf4c6cf8-b36f-4379-a93a-f4d2edab8d4c_zqwlubtm" returned: 1 in 0.310s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:09:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cf4c6cf8-b36f-4379-a93a-f4d2edab8d4c_zqwlubtm' failed. Not Retrying. {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 18:09:19 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[b801afca-966e-4789-a67e-0c41cab5f3b8]: (4, 'raw') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:09:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf4c6cf8-b36f-4379-a93a-f4d2edab8d4c_d1j1amb2devstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:09:19 devstack sudo[106248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf4c6cf8-b36f-4379-a93a-f4d2edab8d4c_d1j1amb2devstack@QuobyteHD Sep 04 18:09:19 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:09:19 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root Sep 04 18:09:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf4c6cf8-b36f-4379-a93a-f4d2edab8d4c_d1j1amb2devstack@QuobyteHD" returned: 0 in 0.305s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:09:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf4c6cf8-b36f-4379-a93a-f4d2edab8d4c_d1j1amb2devstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:09:19 devstack sudo[106252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf4c6cf8-b36f-4379-a93a-f4d2edab8d4c_d1j1amb2devstack@QuobyteHD Sep 04 18:09:19 devstack sudo[106252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:09:19 devstack sudo[106252]: pam_unix(sudo:session): session closed for user root Sep 04 18:09:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf4c6cf8-b36f-4379-a93a-f4d2edab8d4c_d1j1amb2devstack@QuobyteHD" returned: 1 in 0.308s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:09:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf4c6cf8-b36f-4379-a93a-f4d2edab8d4c_d1j1amb2devstack@QuobyteHD' failed. Not Retrying. {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 18:09:19 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] cf4c6cf8-b36f-4379-a93a-f4d2edab8d4c was raw, converting to qcow2 {{(pid=87314) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 04 18:09:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cf4c6cf8-b36f-4379-a93a-f4d2edab8d4c_d1j1amb2devstack@QuobyteHD /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-03aab174-8ff9-401a-b11f-839dda1764dc {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:09:19 devstack sudo[106257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cf4c6cf8-b36f-4379-a93a-f4d2edab8d4c_d1j1amb2devstack@QuobyteHD /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-03aab174-8ff9-401a-b11f-839dda1764dc Sep 04 18:09:19 devstack sudo[106257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:09:20 devstack sudo[106257]: pam_unix(sudo:session): session closed for user root Sep 04 18:09:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cf4c6cf8-b36f-4379-a93a-f4d2edab8d4c_d1j1amb2devstack@QuobyteHD /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-03aab174-8ff9-401a-b11f-839dda1764dc" returned: 0 in 0.413s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:09:20 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cf4c6cf8-b36f-4379-a93a-f4d2edab8d4c_d1j1amb2devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-03aab174-8ff9-401a-b11f-839dda1764dc {{(pid=87314) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 18:09:20 devstack cinder-volume[87314]: INFO cinder.image.image_utils [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Converted 0.00 MB image at 0.00 MB/s Sep 04 18:09:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-03aab174-8ff9-401a-b11f-839dda1764dc 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:09:20 devstack sudo[106262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-03aab174-8ff9-401a-b11f-839dda1764dc 1G Sep 04 18:09:20 devstack sudo[106262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:09:20 devstack sudo[106262]: pam_unix(sudo:session): session closed for user root Sep 04 18:09:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-03aab174-8ff9-401a-b11f-839dda1764dc 1G" returned: 0 in 0.289s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:09:20 devstack cinder-volume[87314]: DEBUG cinder.volume.volume_utils [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Downloaded image cf4c6cf8-b36f-4379-a93a-f4d2edab8d4c ((None, [{'url': 'file:///opt/stack/data/glance/images/cf4c6cf8-b36f-4379-a93a-f4d2edab8d4c', 'metadata': {}}])) to volume 03aab174-8ff9-401a-b11f-839dda1764dc successfully. {{(pid=87314) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 04 18:09:20 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Temporary image cf4c6cf8-b36f-4379-a93a-f4d2edab8d4c for user a71cd671c51f45a7ac81e168f8021551 is deleted. {{(pid=87314) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 04 18:09:20 devstack cinder-volume[87314]: DEBUG cinder.volume.volume_utils [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Marking volume 03aab174-8ff9-401a-b11f-839dda1764dc as bootable. {{(pid=87314) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 04 18:09:20 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Copying metadata from image cf4c6cf8-b36f-4379-a93a-f4d2edab8d4c to 03aab174-8ff9-401a-b11f-839dda1764dc. {{(pid=87314) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 04 18:09:20 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Creating volume glance metadata for volume 03aab174-8ff9-401a-b11f-839dda1764dc backed by image cf4c6cf8-b36f-4379-a93a-f4d2edab8d4c with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'cf4c6cf8-b36f-4379-a93a-f4d2edab8d4c', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '340a63ad279f2316f953d6cfd0682df2', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87314) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 04 18:09:20 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3c85606-53d0-4c67-aa0d-b7061789c051) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03aab174-8ff9-401a-b11f-839dda1764dc', 'volume_size': 1, 'image_id': 'cf4c6cf8-b36f-4379-a93a-f4d2edab8d4c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cf4c6cf8-b36f-4379-a93a-f4d2edab8d4c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '340a63ad279f2316f953d6cfd0682df2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e50aa9e5fccc4293bf78e924eab68131', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3e2f1438c3a64259d8772798c7651926de85495619dd299e0f571a2b80d3810f1075daa6530826208a8f23f2d27fda268eac66b9114d4a5b00e98a3deec0b031', 'id': 'cf4c6cf8-b36f-4379-a93a-f4d2edab8d4c', 'created_at': datetime.datetime(2026, 9, 4, 16, 9, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 16, 9, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cf4c6cf8-b36f-4379-a93a-f4d2edab8d4c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:09:20 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec5ee2c2-2aea-4408-8f78-4194c56289cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:09:20 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Volume volume-03aab174-8ff9-401a-b11f-839dda1764dc (03aab174-8ff9-401a-b11f-839dda1764dc): created successfully Sep 04 18:09:20 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec5ee2c2-2aea-4408-8f78-4194c56289cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:09:20 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Flow 'volume_create_manager' (9d46a5d9-1b42-4562-9470-2c5ea8baf854) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:09:20 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-b3832941-a6ff-4b98-a16f-73bf435b558d tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Created volume successfully. Sep 04 18:09:21 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running periodic task VolumeManager._thread_info {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 18:09:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] thread count: 28 {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 18:09:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] thread info: [<_MainThread(MainThread, started 139900377723008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 18:09:21 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b9e96b39-b0ca-4881-a86b-14b6e41c2a72 tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Acquiring lock "cinder-03aab174-8ff9-401a-b11f-839dda1764dc-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:09:21 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b9e96b39-b0ca-4881-a86b-14b6e41c2a72 tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Lock "cinder-03aab174-8ff9-401a-b11f-839dda1764dc-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:09:21 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b9e96b39-b0ca-4881-a86b-14b6e41c2a72 tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Acquiring lock "cinder-quobyte-03aab174-8ff9-401a-b11f-839dda1764dc" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:09:21 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b9e96b39-b0ca-4881-a86b-14b6e41c2a72 tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Lock "cinder-quobyte-03aab174-8ff9-401a-b11f-839dda1764dc" acquired by "delete_volume" :: waited 0.014s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:09:21 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc498a8-b1bd-40df-a4f9-319448ca9bb5]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:09:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b9e96b39-b0ca-4881-a86b-14b6e41c2a72 tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-03aab174-8ff9-401a-b11f-839dda1764dc {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:09:21 devstack sudo[106267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-03aab174-8ff9-401a-b11f-839dda1764dc Sep 04 18:09:21 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:09:21 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root Sep 04 18:09:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b9e96b39-b0ca-4881-a86b-14b6e41c2a72 tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-03aab174-8ff9-401a-b11f-839dda1764dc" returned: 0 in 0.365s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:09:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b9e96b39-b0ca-4881-a86b-14b6e41c2a72 tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-03aab174-8ff9-401a-b11f-839dda1764dc {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:09:21 devstack sudo[106272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-03aab174-8ff9-401a-b11f-839dda1764dc Sep 04 18:09:21 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:09:22 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root Sep 04 18:09:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b9e96b39-b0ca-4881-a86b-14b6e41c2a72 tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-03aab174-8ff9-401a-b11f-839dda1764dc" returned: 0 in 0.249s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:09:22 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b9e96b39-b0ca-4881-a86b-14b6e41c2a72 tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Lock "cinder-quobyte-03aab174-8ff9-401a-b11f-839dda1764dc" released by "delete_volume" :: held 0.651s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:09:22 devstack cinder-volume[87314]: WARNING cinder.quota [None req-b9e96b39-b0ca-4881-a86b-14b6e41c2a72 tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 04 18:09:22 devstack cinder-volume[87314]: WARNING cinder.quota [None req-b9e96b39-b0ca-4881-a86b-14b6e41c2a72 tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 04 18:09:22 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-b9e96b39-b0ca-4881-a86b-14b6e41c2a72 tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Created reservations ['62f3dd46-ee18-4afe-a56d-4f663083d71f', 'df4bec61-7154-4a07-b58b-492476528eec', 'be29d76f-d8c0-4129-afb1-2cff51a2ed19', '867c5804-347f-4c45-9ba4-496b98df6bcd'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:09:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b9e96b39-b0ca-4881-a86b-14b6e41c2a72 tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:09:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b9e96b39-b0ca-4881-a86b-14b6e41c2a72 tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:09:22 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b9e96b39-b0ca-4881-a86b-14b6e41c2a72 tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:09:22 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b9e96b39-b0ca-4881-a86b-14b6e41c2a72 tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:09:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b9e96b39-b0ca-4881-a86b-14b6e41c2a72 tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:09:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b9e96b39-b0ca-4881-a86b-14b6e41c2a72 tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:09:22 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:09:22 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:09:22 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Sep 04 18:09:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b9e96b39-b0ca-4881-a86b-14b6e41c2a72 tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.287s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:09:22 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-b9e96b39-b0ca-4881-a86b-14b6e41c2a72 tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:09:22 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-b9e96b39-b0ca-4881-a86b-14b6e41c2a72 tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Deleted volume successfully. Sep 04 18:09:22 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b9e96b39-b0ca-4881-a86b-14b6e41c2a72 tempest-VolumeAndVolumeTypeFromImageTest-758588506 None] Lock "cinder-03aab174-8ff9-401a-b11f-839dda1764dc-delete_volume" released by "delete_volume" :: held 1.170s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:09:26 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ef90ef4-d730-480f-8636-af338c555dac tempest-VolumeDependencyTests-1735350708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:09:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2ef90ef4-d730-480f-8636-af338c555dac tempest-VolumeDependencyTests-1735350708 None] Flow 'volume_create_manager' (ad44d047-04b1-4fd6-9b8e-7e813e3da6a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:09:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2ef90ef4-d730-480f-8636-af338c555dac tempest-VolumeDependencyTests-1735350708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ec3fe4f-7303-4813-bf80-6aacc6d2020d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:09:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2ef90ef4-d730-480f-8636-af338c555dac tempest-VolumeDependencyTests-1735350708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ec3fe4f-7303-4813-bf80-6aacc6d2020d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1815740856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=838692dd-f103-408c-880a-5838f67558da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ace7ea760bbd42aba44a46803af9be05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:09:27Z,use_quota=True,user_id='7afe9a5c0864402089acec8fb5c06793',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:09:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2ef90ef4-d730-480f-8636-af338c555dac tempest-VolumeDependencyTests-1735350708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef0f5ca2-8a6c-4970-adfa-7d98f8c80eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:09:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2ef90ef4-d730-480f-8636-af338c555dac tempest-VolumeDependencyTests-1735350708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef0f5ca2-8a6c-4970-adfa-7d98f8c80eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:09:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2ef90ef4-d730-480f-8636-af338c555dac tempest-VolumeDependencyTests-1735350708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c97ef93-1477-42c0-94f7-bc8bf72e97ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:09:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2ef90ef4-d730-480f-8636-af338c555dac tempest-VolumeDependencyTests-1735350708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c97ef93-1477-42c0-94f7-bc8bf72e97ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '838692dd-f103-408c-880a-5838f67558da', 'volume_name': 'volume-838692dd-f103-408c-880a-5838f67558da', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:09:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2ef90ef4-d730-480f-8636-af338c555dac tempest-VolumeDependencyTests-1735350708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78f09f1c-ea4e-4fe2-8d1f-5388b7243448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:09:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2ef90ef4-d730-480f-8636-af338c555dac tempest-VolumeDependencyTests-1735350708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78f09f1c-ea4e-4fe2-8d1f-5388b7243448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:09:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2ef90ef4-d730-480f-8636-af338c555dac tempest-VolumeDependencyTests-1735350708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba01acbe-108a-4c74-95fd-767fae647ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:09:26 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-2ef90ef4-d730-480f-8636-af338c555dac tempest-VolumeDependencyTests-1735350708 None] Volume 838692dd-f103-408c-880a-5838f67558da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-838692dd-f103-408c-880a-5838f67558da', 'volume_size': 1} Sep 04 18:09:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-2ef90ef4-d730-480f-8636-af338c555dac tempest-VolumeDependencyTests-1735350708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:09:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-2ef90ef4-d730-480f-8636-af338c555dac tempest-VolumeDependencyTests-1735350708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:09:26 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-2ef90ef4-d730-480f-8636-af338c555dac tempest-VolumeDependencyTests-1735350708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1815740856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=838692dd-f103-408c-880a-5838f67558da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ace7ea760bbd42aba44a46803af9be05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:09:27Z,use_quota=True,user_id='7afe9a5c0864402089acec8fb5c06793',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:09:26 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-2ef90ef4-d730-480f-8636-af338c555dac tempest-VolumeDependencyTests-1735350708 None] Creating volume 838692dd-f103-408c-880a-5838f67558da {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:09:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-2ef90ef4-d730-480f-8636-af338c555dac tempest-VolumeDependencyTests-1735350708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:09:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-2ef90ef4-d730-480f-8636-af338c555dac tempest-VolumeDependencyTests-1735350708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:09:26 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-2ef90ef4-d730-480f-8636-af338c555dac tempest-VolumeDependencyTests-1735350708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:09:26 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-2ef90ef4-d730-480f-8636-af338c555dac tempest-VolumeDependencyTests-1735350708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:09:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-2ef90ef4-d730-480f-8636-af338c555dac tempest-VolumeDependencyTests-1735350708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:09:26 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-2ef90ef4-d730-480f-8636-af338c555dac tempest-VolumeDependencyTests-1735350708 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:09:26 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-2ef90ef4-d730-480f-8636-af338c555dac tempest-VolumeDependencyTests-1735350708 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:09:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2ef90ef4-d730-480f-8636-af338c555dac tempest-VolumeDependencyTests-1735350708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-838692dd-f103-408c-880a-5838f67558da 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:09:26 devstack sudo[106280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-838692dd-f103-408c-880a-5838f67558da 1073741824 Sep 04 18:09:26 devstack sudo[106280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:09:27 devstack sudo[106280]: pam_unix(sudo:session): session closed for user root Sep 04 18:09:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2ef90ef4-d730-480f-8636-af338c555dac tempest-VolumeDependencyTests-1735350708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-838692dd-f103-408c-880a-5838f67558da 1073741824" returned: 0 in 0.426s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:09:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2ef90ef4-d730-480f-8636-af338c555dac tempest-VolumeDependencyTests-1735350708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-838692dd-f103-408c-880a-5838f67558da {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:09:27 devstack sudo[106286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-838692dd-f103-408c-880a-5838f67558da Sep 04 18:09:27 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:09:27 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root Sep 04 18:09:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2ef90ef4-d730-480f-8636-af338c555dac tempest-VolumeDependencyTests-1735350708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-838692dd-f103-408c-880a-5838f67558da" returned: 0 in 0.246s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:09:27 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-2ef90ef4-d730-480f-8636-af338c555dac tempest-VolumeDependencyTests-1735350708 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:09:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-2ef90ef4-d730-480f-8636-af338c555dac tempest-VolumeDependencyTests-1735350708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:09:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2ef90ef4-d730-480f-8636-af338c555dac tempest-VolumeDependencyTests-1735350708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba01acbe-108a-4c74-95fd-767fae647ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-838692dd-f103-408c-880a-5838f67558da', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:09:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2ef90ef4-d730-480f-8636-af338c555dac tempest-VolumeDependencyTests-1735350708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e90a5332-3f6b-46ce-bdc9-7787a75fb5e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:09:27 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-2ef90ef4-d730-480f-8636-af338c555dac tempest-VolumeDependencyTests-1735350708 None] Volume volume-838692dd-f103-408c-880a-5838f67558da (838692dd-f103-408c-880a-5838f67558da): created successfully Sep 04 18:09:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2ef90ef4-d730-480f-8636-af338c555dac tempest-VolumeDependencyTests-1735350708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e90a5332-3f6b-46ce-bdc9-7787a75fb5e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:09:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2ef90ef4-d730-480f-8636-af338c555dac tempest-VolumeDependencyTests-1735350708 None] Flow 'volume_create_manager' (ad44d047-04b1-4fd6-9b8e-7e813e3da6a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:09:27 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-2ef90ef4-d730-480f-8636-af338c555dac tempest-VolumeDependencyTests-1735350708 None] Created volume successfully. Sep 04 18:09:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-151f3ecf-8c9e-4bf3-bf3d-7e87d3061c8f tempest-VolumeDependencyTests-1735350708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:09:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-151f3ecf-8c9e-4bf3-bf3d-7e87d3061c8f tempest-VolumeDependencyTests-1735350708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:09:27 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-151f3ecf-8c9e-4bf3-bf3d-7e87d3061c8f tempest-VolumeDependencyTests-1735350708 None] Creating offline snapshot 0e4f5005-0260-4247-a96a-d6308cc23967 of volume 838692dd-f103-408c-880a-5838f67558da {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 18:09:27 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd91a1b-d506-442e-bcb3-9178a1f25714]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:09:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-151f3ecf-8c9e-4bf3-bf3d-7e87d3061c8f tempest-VolumeDependencyTests-1735350708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-838692dd-f103-408c-880a-5838f67558da {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:09:28 devstack sudo[106289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-838692dd-f103-408c-880a-5838f67558da Sep 04 18:09:28 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:09:28 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root Sep 04 18:09:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-151f3ecf-8c9e-4bf3-bf3d-7e87d3061c8f tempest-VolumeDependencyTests-1735350708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-838692dd-f103-408c-880a-5838f67558da" returned: 0 in 0.412s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:09:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-151f3ecf-8c9e-4bf3-bf3d-7e87d3061c8f tempest-VolumeDependencyTests-1735350708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-838692dd-f103-408c-880a-5838f67558da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-838692dd-f103-408c-880a-5838f67558da.0e4f5005-0260-4247-a96a-d6308cc23967 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:09:28 devstack sudo[106294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-838692dd-f103-408c-880a-5838f67558da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-838692dd-f103-408c-880a-5838f67558da.0e4f5005-0260-4247-a96a-d6308cc23967 1G Sep 04 18:09:28 devstack sudo[106294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:09:28 devstack sudo[106294]: pam_unix(sudo:session): session closed for user root Sep 04 18:09:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-151f3ecf-8c9e-4bf3-bf3d-7e87d3061c8f tempest-VolumeDependencyTests-1735350708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-838692dd-f103-408c-880a-5838f67558da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-838692dd-f103-408c-880a-5838f67558da.0e4f5005-0260-4247-a96a-d6308cc23967 1G" returned: 0 in 0.417s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:09:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-151f3ecf-8c9e-4bf3-bf3d-7e87d3061c8f tempest-VolumeDependencyTests-1735350708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-838692dd-f103-408c-880a-5838f67558da -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-838692dd-f103-408c-880a-5838f67558da.0e4f5005-0260-4247-a96a-d6308cc23967 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:09:28 devstack sudo[106300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-838692dd-f103-408c-880a-5838f67558da -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-838692dd-f103-408c-880a-5838f67558da.0e4f5005-0260-4247-a96a-d6308cc23967 Sep 04 18:09:28 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:09:29 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root Sep 04 18:09:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-151f3ecf-8c9e-4bf3-bf3d-7e87d3061c8f tempest-VolumeDependencyTests-1735350708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-838692dd-f103-408c-880a-5838f67558da -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-838692dd-f103-408c-880a-5838f67558da.0e4f5005-0260-4247-a96a-d6308cc23967" returned: 0 in 0.325s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:09:29 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-151f3ecf-8c9e-4bf3-bf3d-7e87d3061c8f tempest-VolumeDependencyTests-1735350708 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-838692dd-f103-408c-880a-5838f67558da.0e4f5005-0260-4247-a96a-d6308cc23967 is being set with open permissions: ugo+rw Sep 04 18:09:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-151f3ecf-8c9e-4bf3-bf3d-7e87d3061c8f tempest-VolumeDependencyTests-1735350708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-838692dd-f103-408c-880a-5838f67558da.0e4f5005-0260-4247-a96a-d6308cc23967 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:09:29 devstack sudo[106305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-838692dd-f103-408c-880a-5838f67558da.0e4f5005-0260-4247-a96a-d6308cc23967 Sep 04 18:09:29 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:09:29 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root Sep 04 18:09:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-151f3ecf-8c9e-4bf3-bf3d-7e87d3061c8f tempest-VolumeDependencyTests-1735350708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-838692dd-f103-408c-880a-5838f67558da.0e4f5005-0260-4247-a96a-d6308cc23967" returned: 0 in 0.249s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:09:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-151f3ecf-8c9e-4bf3-bf3d-7e87d3061c8f tempest-VolumeDependencyTests-1735350708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-838692dd-f103-408c-880a-5838f67558da.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:09:29 devstack sudo[106308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-838692dd-f103-408c-880a-5838f67558da.info Sep 04 18:09:29 devstack sudo[106308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:09:29 devstack sudo[106308]: pam_unix(sudo:session): session closed for user root Sep 04 18:09:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-151f3ecf-8c9e-4bf3-bf3d-7e87d3061c8f tempest-VolumeDependencyTests-1735350708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-838692dd-f103-408c-880a-5838f67558da.info" returned: 0 in 0.245s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:09:29 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-151f3ecf-8c9e-4bf3-bf3d-7e87d3061c8f tempest-VolumeDependencyTests-1735350708 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-838692dd-f103-408c-880a-5838f67558da.info is being set with open permissions: ugo+rw Sep 04 18:09:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-151f3ecf-8c9e-4bf3-bf3d-7e87d3061c8f tempest-VolumeDependencyTests-1735350708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-838692dd-f103-408c-880a-5838f67558da.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:09:29 devstack sudo[106311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-838692dd-f103-408c-880a-5838f67558da.info Sep 04 18:09:29 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:09:29 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root Sep 04 18:09:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-151f3ecf-8c9e-4bf3-bf3d-7e87d3061c8f tempest-VolumeDependencyTests-1735350708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-838692dd-f103-408c-880a-5838f67558da.info" returned: 0 in 0.268s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:09:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-151f3ecf-8c9e-4bf3-bf3d-7e87d3061c8f tempest-VolumeDependencyTests-1735350708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.004s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:09:29 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-151f3ecf-8c9e-4bf3-bf3d-7e87d3061c8f tempest-VolumeDependencyTests-1735350708 None] Create snapshot completed successfully Sep 04 18:09:30 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-251fd76b-7c07-4cde-bcf9-b18ebb8a811e tempest-VolumeDependencyTests-1735350708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:09:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-251fd76b-7c07-4cde-bcf9-b18ebb8a811e tempest-VolumeDependencyTests-1735350708 None] Flow 'volume_create_manager' (8a478720-bf37-4d48-ba6e-fd840196789b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:09:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-251fd76b-7c07-4cde-bcf9-b18ebb8a811e tempest-VolumeDependencyTests-1735350708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccb130f9-9d2c-461d-b79f-6a0e050868a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:09:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-251fd76b-7c07-4cde-bcf9-b18ebb8a811e tempest-VolumeDependencyTests-1735350708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccb130f9-9d2c-461d-b79f-6a0e050868a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:09:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1272334174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5544772f-f6a1-4c5c-a223-cee4807f041e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ace7ea760bbd42aba44a46803af9be05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0e4f5005-0260-4247-a96a-d6308cc23967,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:09:31Z,use_quota=True,user_id='7afe9a5c0864402089acec8fb5c06793',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:09:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-251fd76b-7c07-4cde-bcf9-b18ebb8a811e tempest-VolumeDependencyTests-1735350708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d893224-40d5-4674-8f3f-aedf4fd29c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:09:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-251fd76b-7c07-4cde-bcf9-b18ebb8a811e tempest-VolumeDependencyTests-1735350708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d893224-40d5-4674-8f3f-aedf4fd29c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:09:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-251fd76b-7c07-4cde-bcf9-b18ebb8a811e tempest-VolumeDependencyTests-1735350708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18b49e21-cd29-4710-90ec-b9c51edd3e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:09:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-251fd76b-7c07-4cde-bcf9-b18ebb8a811e tempest-VolumeDependencyTests-1735350708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18b49e21-cd29-4710-90ec-b9c51edd3e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5544772f-f6a1-4c5c-a223-cee4807f041e', 'volume_name': 'volume-5544772f-f6a1-4c5c-a223-cee4807f041e', 'volume_size': 1, 'snapshot_id': '0e4f5005-0260-4247-a96a-d6308cc23967'}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:09:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-251fd76b-7c07-4cde-bcf9-b18ebb8a811e tempest-VolumeDependencyTests-1735350708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (801809fa-2730-4b9e-8de6-10dacb709b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:09:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-251fd76b-7c07-4cde-bcf9-b18ebb8a811e tempest-VolumeDependencyTests-1735350708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (801809fa-2730-4b9e-8de6-10dacb709b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:09:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-251fd76b-7c07-4cde-bcf9-b18ebb8a811e tempest-VolumeDependencyTests-1735350708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f897971-30a8-4f02-a504-15e077b61558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:09:30 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-251fd76b-7c07-4cde-bcf9-b18ebb8a811e tempest-VolumeDependencyTests-1735350708 None] Volume 5544772f-f6a1-4c5c-a223-cee4807f041e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5544772f-f6a1-4c5c-a223-cee4807f041e', 'volume_size': 1, 'snapshot_id': '0e4f5005-0260-4247-a96a-d6308cc23967'} Sep 04 18:09:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-251fd76b-7c07-4cde-bcf9-b18ebb8a811e tempest-VolumeDependencyTests-1735350708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:09:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-251fd76b-7c07-4cde-bcf9-b18ebb8a811e tempest-VolumeDependencyTests-1735350708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:09:30 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-251fd76b-7c07-4cde-bcf9-b18ebb8a811e tempest-VolumeDependencyTests-1735350708 None] Acquiring lock "cinder-quobyte-0e4f5005-0260-4247-a96a-d6308cc23967-5544772f-f6a1-4c5c-a223-cee4807f041e" by "_create_volume_from_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:09:30 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-251fd76b-7c07-4cde-bcf9-b18ebb8a811e tempest-VolumeDependencyTests-1735350708 None] Lock "cinder-quobyte-0e4f5005-0260-4247-a96a-d6308cc23967-5544772f-f6a1-4c5c-a223-cee4807f041e" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:09:30 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-251fd76b-7c07-4cde-bcf9-b18ebb8a811e tempest-VolumeDependencyTests-1735350708 None] Creating volume 5544772f-f6a1-4c5c-a223-cee4807f041e from snapshot 0e4f5005-0260-4247-a96a-d6308cc23967 {{(pid=87314) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 04 18:09:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-251fd76b-7c07-4cde-bcf9-b18ebb8a811e tempest-VolumeDependencyTests-1735350708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:09:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-251fd76b-7c07-4cde-bcf9-b18ebb8a811e tempest-VolumeDependencyTests-1735350708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:09:30 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-251fd76b-7c07-4cde-bcf9-b18ebb8a811e tempest-VolumeDependencyTests-1735350708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:09:30 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-251fd76b-7c07-4cde-bcf9-b18ebb8a811e tempest-VolumeDependencyTests-1735350708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:09:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-251fd76b-7c07-4cde-bcf9-b18ebb8a811e tempest-VolumeDependencyTests-1735350708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:09:30 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-251fd76b-7c07-4cde-bcf9-b18ebb8a811e tempest-VolumeDependencyTests-1735350708 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:09:30 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-251fd76b-7c07-4cde-bcf9-b18ebb8a811e tempest-VolumeDependencyTests-1735350708 None] Acquiring lock "cinder-quobyte-5544772f-f6a1-4c5c-a223-cee4807f041e" by "_copy_volume_from_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:09:30 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-251fd76b-7c07-4cde-bcf9-b18ebb8a811e tempest-VolumeDependencyTests-1735350708 None] Lock "cinder-quobyte-5544772f-f6a1-4c5c-a223-cee4807f041e" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:09:30 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-251fd76b-7c07-4cde-bcf9-b18ebb8a811e tempest-VolumeDependencyTests-1735350708 None] snapshot: 0e4f5005-0260-4247-a96a-d6308cc23967, volume: 5544772f-f6a1-4c5c-a223-cee4807f041e, {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 04 18:09:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-251fd76b-7c07-4cde-bcf9-b18ebb8a811e tempest-VolumeDependencyTests-1735350708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:09:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-251fd76b-7c07-4cde-bcf9-b18ebb8a811e tempest-VolumeDependencyTests-1735350708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:09:30 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-251fd76b-7c07-4cde-bcf9-b18ebb8a811e tempest-VolumeDependencyTests-1735350708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:09:30 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-251fd76b-7c07-4cde-bcf9-b18ebb8a811e tempest-VolumeDependencyTests-1735350708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:09:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-251fd76b-7c07-4cde-bcf9-b18ebb8a811e tempest-VolumeDependencyTests-1735350708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:09:30 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[42734e16-276f-4f4e-8df3-ea0c6f4c0d42]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:09:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-251fd76b-7c07-4cde-bcf9-b18ebb8a811e tempest-VolumeDependencyTests-1735350708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-838692dd-f103-408c-880a-5838f67558da.0e4f5005-0260-4247-a96a-d6308cc23967 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:09:30 devstack sudo[106314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-838692dd-f103-408c-880a-5838f67558da.0e4f5005-0260-4247-a96a-d6308cc23967 Sep 04 18:09:30 devstack sudo[106314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:09:31 devstack sudo[106314]: pam_unix(sudo:session): session closed for user root Sep 04 18:09:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-251fd76b-7c07-4cde-bcf9-b18ebb8a811e tempest-VolumeDependencyTests-1735350708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-838692dd-f103-408c-880a-5838f67558da.0e4f5005-0260-4247-a96a-d6308cc23967" returned: 0 in 0.401s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:09:31 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-251fd76b-7c07-4cde-bcf9-b18ebb8a811e tempest-VolumeDependencyTests-1735350708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-838692dd-f103-408c-880a-5838f67558da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 18:09:31 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[b65fa161-5e95-4c52-b702-16e4eb744d8c]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:09:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-251fd76b-7c07-4cde-bcf9-b18ebb8a811e tempest-VolumeDependencyTests-1735350708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-838692dd-f103-408c-880a-5838f67558da {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:09:31 devstack sudo[106319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-838692dd-f103-408c-880a-5838f67558da Sep 04 18:09:31 devstack sudo[106319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:09:31 devstack sudo[106319]: pam_unix(sudo:session): session closed for user root Sep 04 18:09:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-251fd76b-7c07-4cde-bcf9-b18ebb8a811e tempest-VolumeDependencyTests-1735350708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-838692dd-f103-408c-880a-5838f67558da" returned: 0 in 0.395s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:09:31 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-251fd76b-7c07-4cde-bcf9-b18ebb8a811e tempest-VolumeDependencyTests-1735350708 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-838692dd-f103-408c-880a-5838f67558da {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 04 18:09:31 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-251fd76b-7c07-4cde-bcf9-b18ebb8a811e tempest-VolumeDependencyTests-1735350708 None] Creating direct copy from snapshot {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 04 18:09:31 devstack cinder-volume[87314]: DEBUG cinder.utils [None req-251fd76b-7c07-4cde-bcf9-b18ebb8a811e tempest-VolumeDependencyTests-1735350708 None] Path /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5544772f-f6a1-4c5c-a223-cee4807f041e not found in is_blk_device check {{(pid=87314) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 04 18:09:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-251fd76b-7c07-4cde-bcf9-b18ebb8a811e tempest-VolumeDependencyTests-1735350708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-838692dd-f103-408c-880a-5838f67558da /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5544772f-f6a1-4c5c-a223-cee4807f041e {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:09:31 devstack sudo[106324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-838692dd-f103-408c-880a-5838f67558da /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5544772f-f6a1-4c5c-a223-cee4807f041e Sep 04 18:09:31 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:09:35 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root Sep 04 18:09:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-251fd76b-7c07-4cde-bcf9-b18ebb8a811e tempest-VolumeDependencyTests-1735350708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-838692dd-f103-408c-880a-5838f67558da /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5544772f-f6a1-4c5c-a223-cee4807f041e" returned: 0 in 4.384s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:09:35 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-251fd76b-7c07-4cde-bcf9-b18ebb8a811e tempest-VolumeDependencyTests-1735350708 None] Image conversion details: src /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-838692dd-f103-408c-880a-5838f67558da, size 1024.00 MB, duration 4.39 sec, destination /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5544772f-f6a1-4c5c-a223-cee4807f041e {{(pid=87314) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 18:09:35 devstack cinder-volume[87314]: INFO cinder.image.image_utils [None req-251fd76b-7c07-4cde-bcf9-b18ebb8a811e tempest-VolumeDependencyTests-1735350708 None] Converted 1024.00 MB image at 233.52 MB/s Sep 04 18:09:35 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-251fd76b-7c07-4cde-bcf9-b18ebb8a811e tempest-VolumeDependencyTests-1735350708 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5544772f-f6a1-4c5c-a223-cee4807f041e is being set with open permissions: ugo+rw Sep 04 18:09:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-251fd76b-7c07-4cde-bcf9-b18ebb8a811e tempest-VolumeDependencyTests-1735350708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5544772f-f6a1-4c5c-a223-cee4807f041e {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:09:36 devstack sudo[106338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5544772f-f6a1-4c5c-a223-cee4807f041e Sep 04 18:09:36 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:09:36 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root Sep 04 18:09:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-251fd76b-7c07-4cde-bcf9-b18ebb8a811e tempest-VolumeDependencyTests-1735350708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5544772f-f6a1-4c5c-a223-cee4807f041e" returned: 0 in 0.285s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:09:36 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-251fd76b-7c07-4cde-bcf9-b18ebb8a811e tempest-VolumeDependencyTests-1735350708 None] Lock "cinder-quobyte-5544772f-f6a1-4c5c-a223-cee4807f041e" released by "_copy_volume_from_snapshot" :: held 5.541s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:09:36 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-251fd76b-7c07-4cde-bcf9-b18ebb8a811e tempest-VolumeDependencyTests-1735350708 None] Lock "cinder-quobyte-0e4f5005-0260-4247-a96a-d6308cc23967-5544772f-f6a1-4c5c-a223-cee4807f041e" released by "_create_volume_from_snapshot" :: held 5.611s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:09:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-251fd76b-7c07-4cde-bcf9-b18ebb8a811e tempest-VolumeDependencyTests-1735350708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.627s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:09:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-251fd76b-7c07-4cde-bcf9-b18ebb8a811e tempest-VolumeDependencyTests-1735350708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f897971-30a8-4f02-a504-15e077b61558) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5544772f-f6a1-4c5c-a223-cee4807f041e', 'volume_size': 1, 'snapshot_id': '0e4f5005-0260-4247-a96a-d6308cc23967'}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:09:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-251fd76b-7c07-4cde-bcf9-b18ebb8a811e tempest-VolumeDependencyTests-1735350708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (940a725d-9316-49d6-9662-209fedaeb848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:09:36 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-251fd76b-7c07-4cde-bcf9-b18ebb8a811e tempest-VolumeDependencyTests-1735350708 None] Volume volume-5544772f-f6a1-4c5c-a223-cee4807f041e (5544772f-f6a1-4c5c-a223-cee4807f041e): created successfully Sep 04 18:09:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-251fd76b-7c07-4cde-bcf9-b18ebb8a811e tempest-VolumeDependencyTests-1735350708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (940a725d-9316-49d6-9662-209fedaeb848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:09:36 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-251fd76b-7c07-4cde-bcf9-b18ebb8a811e tempest-VolumeDependencyTests-1735350708 None] Flow 'volume_create_manager' (8a478720-bf37-4d48-ba6e-fd840196789b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:09:36 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-251fd76b-7c07-4cde-bcf9-b18ebb8a811e tempest-VolumeDependencyTests-1735350708 None] Created volume successfully. Sep 04 18:09:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-994b8333-e9b0-4917-b162-67989037d447 tempest-VolumeDependencyTests-1735350708 None] Acquiring lock "cinder-0e4f5005-0260-4247-a96a-d6308cc23967-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:09:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-994b8333-e9b0-4917-b162-67989037d447 tempest-VolumeDependencyTests-1735350708 None] Lock "cinder-0e4f5005-0260-4247-a96a-d6308cc23967-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:09:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-994b8333-e9b0-4917-b162-67989037d447 tempest-VolumeDependencyTests-1735350708 None] Acquiring lock "cinder-quobyte-838692dd-f103-408c-880a-5838f67558da" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:09:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-994b8333-e9b0-4917-b162-67989037d447 tempest-VolumeDependencyTests-1735350708 None] Lock "cinder-quobyte-838692dd-f103-408c-880a-5838f67558da" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:09:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-994b8333-e9b0-4917-b162-67989037d447 tempest-VolumeDependencyTests-1735350708 None] Acquiring lock "cinder-quobyte-0e4f5005-0260-4247-a96a-d6308cc23967" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:09:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-994b8333-e9b0-4917-b162-67989037d447 tempest-VolumeDependencyTests-1735350708 None] Lock "cinder-quobyte-0e4f5005-0260-4247-a96a-d6308cc23967" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:09:37 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-994b8333-e9b0-4917-b162-67989037d447 tempest-VolumeDependencyTests-1735350708 None] Deleting offline snapshot 0e4f5005-0260-4247-a96a-d6308cc23967 of volume 838692dd-f103-408c-880a-5838f67558da {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 18:09:37 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-994b8333-e9b0-4917-b162-67989037d447 tempest-VolumeDependencyTests-1735350708 None] snapshot_file for this snap is: volume-838692dd-f103-408c-880a-5838f67558da.0e4f5005-0260-4247-a96a-d6308cc23967 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 18:09:37 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c19de4b-1756-4003-8a13-7a1040c03383]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:09:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-994b8333-e9b0-4917-b162-67989037d447 tempest-VolumeDependencyTests-1735350708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-838692dd-f103-408c-880a-5838f67558da.0e4f5005-0260-4247-a96a-d6308cc23967 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:09:37 devstack sudo[106341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-838692dd-f103-408c-880a-5838f67558da.0e4f5005-0260-4247-a96a-d6308cc23967 Sep 04 18:09:37 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:09:37 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root Sep 04 18:09:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-994b8333-e9b0-4917-b162-67989037d447 tempest-VolumeDependencyTests-1735350708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-838692dd-f103-408c-880a-5838f67558da.0e4f5005-0260-4247-a96a-d6308cc23967" returned: 0 in 0.362s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:09:37 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-994b8333-e9b0-4917-b162-67989037d447 tempest-VolumeDependencyTests-1735350708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-838692dd-f103-408c-880a-5838f67558da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 18:09:37 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e9315d-d292-4aaa-9baa-bbc1d7eab165]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:09:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-994b8333-e9b0-4917-b162-67989037d447 tempest-VolumeDependencyTests-1735350708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-838692dd-f103-408c-880a-5838f67558da {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:09:37 devstack sudo[106346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-838692dd-f103-408c-880a-5838f67558da Sep 04 18:09:37 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:09:38 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root Sep 04 18:09:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-994b8333-e9b0-4917-b162-67989037d447 tempest-VolumeDependencyTests-1735350708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-838692dd-f103-408c-880a-5838f67558da" returned: 0 in 0.539s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:09:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-994b8333-e9b0-4917-b162-67989037d447 tempest-VolumeDependencyTests-1735350708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-838692dd-f103-408c-880a-5838f67558da.0e4f5005-0260-4247-a96a-d6308cc23967 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:09:38 devstack sudo[106351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-838692dd-f103-408c-880a-5838f67558da.0e4f5005-0260-4247-a96a-d6308cc23967 Sep 04 18:09:38 devstack sudo[106351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:09:38 devstack sudo[106351]: pam_unix(sudo:session): session closed for user root Sep 04 18:09:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-994b8333-e9b0-4917-b162-67989037d447 tempest-VolumeDependencyTests-1735350708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-838692dd-f103-408c-880a-5838f67558da.0e4f5005-0260-4247-a96a-d6308cc23967" returned: 0 in 0.330s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:09:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-994b8333-e9b0-4917-b162-67989037d447 tempest-VolumeDependencyTests-1735350708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-838692dd-f103-408c-880a-5838f67558da.0e4f5005-0260-4247-a96a-d6308cc23967 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:09:38 devstack sudo[106357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-838692dd-f103-408c-880a-5838f67558da.0e4f5005-0260-4247-a96a-d6308cc23967 Sep 04 18:09:38 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:09:38 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root Sep 04 18:09:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-994b8333-e9b0-4917-b162-67989037d447 tempest-VolumeDependencyTests-1735350708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-838692dd-f103-408c-880a-5838f67558da.0e4f5005-0260-4247-a96a-d6308cc23967" returned: 0 in 0.255s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:09:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-994b8333-e9b0-4917-b162-67989037d447 tempest-VolumeDependencyTests-1735350708 None] Lock "cinder-quobyte-0e4f5005-0260-4247-a96a-d6308cc23967" released by "_delete_snapshot" :: held 1.587s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:09:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-994b8333-e9b0-4917-b162-67989037d447 tempest-VolumeDependencyTests-1735350708 None] Lock "cinder-quobyte-838692dd-f103-408c-880a-5838f67558da" released by "delete_snapshot" :: held 1.610s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:09:38 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-994b8333-e9b0-4917-b162-67989037d447 tempest-VolumeDependencyTests-1735350708 None] Created reservations ['2070bb2b-87de-4016-9cc5-0070325c3ae8', 'a99ac1ac-fbf3-4add-9b15-409b8dd081e4', '99fe664b-1295-41d7-8a4e-7fb76bfced15', '88cfa577-73ae-4b2e-bab7-afc5e140efa7'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:09:38 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-994b8333-e9b0-4917-b162-67989037d447 tempest-VolumeDependencyTests-1735350708 None] Delete snapshot completed successfully. Sep 04 18:09:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-994b8333-e9b0-4917-b162-67989037d447 tempest-VolumeDependencyTests-1735350708 None] Lock "cinder-0e4f5005-0260-4247-a96a-d6308cc23967-delete_snapshot" released by "delete_snapshot" :: held 1.745s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:09:39 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-01a9f42c-838c-4e49-a585-03fbec1ff908 tempest-VolumeDependencyTests-1735350708 None] Acquiring lock "cinder-838692dd-f103-408c-880a-5838f67558da-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:09:39 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-01a9f42c-838c-4e49-a585-03fbec1ff908 tempest-VolumeDependencyTests-1735350708 None] Lock "cinder-838692dd-f103-408c-880a-5838f67558da-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:09:39 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-01a9f42c-838c-4e49-a585-03fbec1ff908 tempest-VolumeDependencyTests-1735350708 None] Acquiring lock "cinder-quobyte-838692dd-f103-408c-880a-5838f67558da" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:09:39 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-01a9f42c-838c-4e49-a585-03fbec1ff908 tempest-VolumeDependencyTests-1735350708 None] Lock "cinder-quobyte-838692dd-f103-408c-880a-5838f67558da" acquired by "delete_volume" :: waited 0.018s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:09:39 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f270084-06d7-4e90-88a9-5c9afc67bcd3]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:09:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-01a9f42c-838c-4e49-a585-03fbec1ff908 tempest-VolumeDependencyTests-1735350708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-838692dd-f103-408c-880a-5838f67558da {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:09:39 devstack sudo[106360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-838692dd-f103-408c-880a-5838f67558da Sep 04 18:09:39 devstack sudo[106360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:09:39 devstack sudo[106360]: pam_unix(sudo:session): session closed for user root Sep 04 18:09:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-01a9f42c-838c-4e49-a585-03fbec1ff908 tempest-VolumeDependencyTests-1735350708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-838692dd-f103-408c-880a-5838f67558da" returned: 0 in 0.389s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:09:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-01a9f42c-838c-4e49-a585-03fbec1ff908 tempest-VolumeDependencyTests-1735350708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-838692dd-f103-408c-880a-5838f67558da {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:09:39 devstack sudo[106365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-838692dd-f103-408c-880a-5838f67558da Sep 04 18:09:39 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:09:40 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root Sep 04 18:09:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-01a9f42c-838c-4e49-a585-03fbec1ff908 tempest-VolumeDependencyTests-1735350708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-838692dd-f103-408c-880a-5838f67558da" returned: 0 in 0.273s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:09:40 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-01a9f42c-838c-4e49-a585-03fbec1ff908 tempest-VolumeDependencyTests-1735350708 None] Lock "cinder-quobyte-838692dd-f103-408c-880a-5838f67558da" released by "delete_volume" :: held 0.723s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:09:40 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-01a9f42c-838c-4e49-a585-03fbec1ff908 tempest-VolumeDependencyTests-1735350708 None] Created reservations ['82326613-9d0b-4bf6-8c56-ef5339f5bbac', '5921da9a-53d0-4e1e-a39d-ccb0e297cb50', '2ebdfef6-c574-476f-b79e-129a9065dddc', '959236eb-8f02-4258-a623-4266027ce258'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:09:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-01a9f42c-838c-4e49-a585-03fbec1ff908 tempest-VolumeDependencyTests-1735350708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:09:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-01a9f42c-838c-4e49-a585-03fbec1ff908 tempest-VolumeDependencyTests-1735350708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:09:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-01a9f42c-838c-4e49-a585-03fbec1ff908 tempest-VolumeDependencyTests-1735350708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:09:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-01a9f42c-838c-4e49-a585-03fbec1ff908 tempest-VolumeDependencyTests-1735350708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:09:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-01a9f42c-838c-4e49-a585-03fbec1ff908 tempest-VolumeDependencyTests-1735350708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:09:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-01a9f42c-838c-4e49-a585-03fbec1ff908 tempest-VolumeDependencyTests-1735350708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:09:40 devstack sudo[106368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:09:40 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:09:40 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2b193562-ca90-4d19-b35a-75d9609d94f7 tempest-VolumeDependencyTests-1735350708 None] Acquiring lock "cinder-5544772f-f6a1-4c5c-a223-cee4807f041e-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:09:40 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root Sep 04 18:09:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-01a9f42c-838c-4e49-a585-03fbec1ff908 tempest-VolumeDependencyTests-1735350708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.256s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:09:40 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-01a9f42c-838c-4e49-a585-03fbec1ff908 tempest-VolumeDependencyTests-1735350708 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:09:40 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-01a9f42c-838c-4e49-a585-03fbec1ff908 tempest-VolumeDependencyTests-1735350708 None] Deleted volume successfully. Sep 04 18:09:40 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2b193562-ca90-4d19-b35a-75d9609d94f7 tempest-VolumeDependencyTests-1735350708 None] Lock "cinder-5544772f-f6a1-4c5c-a223-cee4807f041e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:09:40 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-01a9f42c-838c-4e49-a585-03fbec1ff908 tempest-VolumeDependencyTests-1735350708 None] Lock "cinder-838692dd-f103-408c-880a-5838f67558da-delete_volume" released by "delete_volume" :: held 1.229s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:09:40 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2b193562-ca90-4d19-b35a-75d9609d94f7 tempest-VolumeDependencyTests-1735350708 None] Acquiring lock "cinder-quobyte-5544772f-f6a1-4c5c-a223-cee4807f041e" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:09:40 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2b193562-ca90-4d19-b35a-75d9609d94f7 tempest-VolumeDependencyTests-1735350708 None] Lock "cinder-quobyte-5544772f-f6a1-4c5c-a223-cee4807f041e" acquired by "delete_volume" :: waited 0.016s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:09:40 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[a051d07d-c7ad-4c9c-b460-7eccbe58ca3b]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:09:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2b193562-ca90-4d19-b35a-75d9609d94f7 tempest-VolumeDependencyTests-1735350708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5544772f-f6a1-4c5c-a223-cee4807f041e {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:09:40 devstack sudo[106371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5544772f-f6a1-4c5c-a223-cee4807f041e Sep 04 18:09:40 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:09:40 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root Sep 04 18:09:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2b193562-ca90-4d19-b35a-75d9609d94f7 tempest-VolumeDependencyTests-1735350708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5544772f-f6a1-4c5c-a223-cee4807f041e" returned: 0 in 0.382s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:09:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2b193562-ca90-4d19-b35a-75d9609d94f7 tempest-VolumeDependencyTests-1735350708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5544772f-f6a1-4c5c-a223-cee4807f041e {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:09:41 devstack sudo[106376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5544772f-f6a1-4c5c-a223-cee4807f041e Sep 04 18:09:41 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:09:41 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root Sep 04 18:09:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2b193562-ca90-4d19-b35a-75d9609d94f7 tempest-VolumeDependencyTests-1735350708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5544772f-f6a1-4c5c-a223-cee4807f041e" returned: 0 in 0.278s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:09:41 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2b193562-ca90-4d19-b35a-75d9609d94f7 tempest-VolumeDependencyTests-1735350708 None] Lock "cinder-quobyte-5544772f-f6a1-4c5c-a223-cee4807f041e" released by "delete_volume" :: held 0.702s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:09:41 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-2b193562-ca90-4d19-b35a-75d9609d94f7 tempest-VolumeDependencyTests-1735350708 None] Created reservations ['9a0a4b61-c963-4a38-99cd-3b8f45000e96', '8128221d-3bbd-4165-8e8c-90bccda80af2', '3f4ded7b-6ec6-40d3-a2a5-b6d2978b6111', 'ee3fb7ce-92e3-45ed-887a-8e823b30666e'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:09:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-2b193562-ca90-4d19-b35a-75d9609d94f7 tempest-VolumeDependencyTests-1735350708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:09:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-2b193562-ca90-4d19-b35a-75d9609d94f7 tempest-VolumeDependencyTests-1735350708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:09:41 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-2b193562-ca90-4d19-b35a-75d9609d94f7 tempest-VolumeDependencyTests-1735350708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:09:41 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-2b193562-ca90-4d19-b35a-75d9609d94f7 tempest-VolumeDependencyTests-1735350708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:09:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-2b193562-ca90-4d19-b35a-75d9609d94f7 tempest-VolumeDependencyTests-1735350708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:09:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2b193562-ca90-4d19-b35a-75d9609d94f7 tempest-VolumeDependencyTests-1735350708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:09:41 devstack sudo[106379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:09:41 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:09:41 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root Sep 04 18:09:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2b193562-ca90-4d19-b35a-75d9609d94f7 tempest-VolumeDependencyTests-1735350708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.253s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:09:41 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-2b193562-ca90-4d19-b35a-75d9609d94f7 tempest-VolumeDependencyTests-1735350708 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:09:41 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-2b193562-ca90-4d19-b35a-75d9609d94f7 tempest-VolumeDependencyTests-1735350708 None] Deleted volume successfully. Sep 04 18:09:41 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2b193562-ca90-4d19-b35a-75d9609d94f7 tempest-VolumeDependencyTests-1735350708 None] Lock "cinder-5544772f-f6a1-4c5c-a223-cee4807f041e-delete_volume" released by "delete_volume" :: held 1.166s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:09:45 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9f93c57-3928-4625-8e4a-57377b5b4c59 tempest-ProjectReaderTests-184027869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:09:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a9f93c57-3928-4625-8e4a-57377b5b4c59 tempest-ProjectReaderTests-184027869 None] Flow 'volume_create_manager' (46c2068d-75e0-4abe-bcf2-3004d0c946f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:09:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a9f93c57-3928-4625-8e4a-57377b5b4c59 tempest-ProjectReaderTests-184027869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46977f1c-353a-44d9-a4ec-4f6717a16474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:09:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a9f93c57-3928-4625-8e4a-57377b5b4c59 tempest-ProjectReaderTests-184027869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46977f1c-353a-44d9-a4ec-4f6717a16474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-291590544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eff0731-bd5f-4e0c-b614-cd4f6d81c745,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b94eb27a90554abe89257a4861a23cdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:09:45Z,use_quota=True,user_id='07daa1e90b564afba4495d26fc5c7834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:09:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a9f93c57-3928-4625-8e4a-57377b5b4c59 tempest-ProjectReaderTests-184027869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d590504-d1bf-4f87-a7d6-06e8245d48cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:09:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a9f93c57-3928-4625-8e4a-57377b5b4c59 tempest-ProjectReaderTests-184027869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d590504-d1bf-4f87-a7d6-06e8245d48cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:09:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a9f93c57-3928-4625-8e4a-57377b5b4c59 tempest-ProjectReaderTests-184027869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e855861-de8a-4e80-9923-5835fd613a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:09:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a9f93c57-3928-4625-8e4a-57377b5b4c59 tempest-ProjectReaderTests-184027869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e855861-de8a-4e80-9923-5835fd613a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7eff0731-bd5f-4e0c-b614-cd4f6d81c745', 'volume_name': 'volume-7eff0731-bd5f-4e0c-b614-cd4f6d81c745', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:09:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a9f93c57-3928-4625-8e4a-57377b5b4c59 tempest-ProjectReaderTests-184027869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc2a4eae-f82d-45d8-a109-89b727dee14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:09:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a9f93c57-3928-4625-8e4a-57377b5b4c59 tempest-ProjectReaderTests-184027869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc2a4eae-f82d-45d8-a109-89b727dee14d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:09:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a9f93c57-3928-4625-8e4a-57377b5b4c59 tempest-ProjectReaderTests-184027869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ccdfe1f-fa72-4ea4-8c54-5b89e11308a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:09:45 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-a9f93c57-3928-4625-8e4a-57377b5b4c59 tempest-ProjectReaderTests-184027869 None] Volume 7eff0731-bd5f-4e0c-b614-cd4f6d81c745: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7eff0731-bd5f-4e0c-b614-cd4f6d81c745', 'volume_size': 1} Sep 04 18:09:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a9f93c57-3928-4625-8e4a-57377b5b4c59 tempest-ProjectReaderTests-184027869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:09:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a9f93c57-3928-4625-8e4a-57377b5b4c59 tempest-ProjectReaderTests-184027869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:09:45 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a9f93c57-3928-4625-8e4a-57377b5b4c59 tempest-ProjectReaderTests-184027869 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-291590544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eff0731-bd5f-4e0c-b614-cd4f6d81c745,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b94eb27a90554abe89257a4861a23cdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:09:45Z,use_quota=True,user_id='07daa1e90b564afba4495d26fc5c7834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:09:45 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-a9f93c57-3928-4625-8e4a-57377b5b4c59 tempest-ProjectReaderTests-184027869 None] Creating volume 7eff0731-bd5f-4e0c-b614-cd4f6d81c745 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:09:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a9f93c57-3928-4625-8e4a-57377b5b4c59 tempest-ProjectReaderTests-184027869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:09:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a9f93c57-3928-4625-8e4a-57377b5b4c59 tempest-ProjectReaderTests-184027869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:09:45 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a9f93c57-3928-4625-8e4a-57377b5b4c59 tempest-ProjectReaderTests-184027869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:09:45 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a9f93c57-3928-4625-8e4a-57377b5b4c59 tempest-ProjectReaderTests-184027869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:09:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a9f93c57-3928-4625-8e4a-57377b5b4c59 tempest-ProjectReaderTests-184027869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:09:45 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a9f93c57-3928-4625-8e4a-57377b5b4c59 tempest-ProjectReaderTests-184027869 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:09:45 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-a9f93c57-3928-4625-8e4a-57377b5b4c59 tempest-ProjectReaderTests-184027869 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:09:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a9f93c57-3928-4625-8e4a-57377b5b4c59 tempest-ProjectReaderTests-184027869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7eff0731-bd5f-4e0c-b614-cd4f6d81c745 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:09:45 devstack sudo[106383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7eff0731-bd5f-4e0c-b614-cd4f6d81c745 1073741824 Sep 04 18:09:45 devstack sudo[106383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:09:45 devstack sudo[106383]: pam_unix(sudo:session): session closed for user root Sep 04 18:09:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a9f93c57-3928-4625-8e4a-57377b5b4c59 tempest-ProjectReaderTests-184027869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7eff0731-bd5f-4e0c-b614-cd4f6d81c745 1073741824" returned: 0 in 0.389s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:09:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a9f93c57-3928-4625-8e4a-57377b5b4c59 tempest-ProjectReaderTests-184027869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7eff0731-bd5f-4e0c-b614-cd4f6d81c745 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:09:45 devstack sudo[106388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7eff0731-bd5f-4e0c-b614-cd4f6d81c745 Sep 04 18:09:45 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:09:45 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root Sep 04 18:09:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a9f93c57-3928-4625-8e4a-57377b5b4c59 tempest-ProjectReaderTests-184027869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7eff0731-bd5f-4e0c-b614-cd4f6d81c745" returned: 0 in 0.246s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:09:45 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a9f93c57-3928-4625-8e4a-57377b5b4c59 tempest-ProjectReaderTests-184027869 None] <== create_volume: return (677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:09:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a9f93c57-3928-4625-8e4a-57377b5b4c59 tempest-ProjectReaderTests-184027869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.679s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:09:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a9f93c57-3928-4625-8e4a-57377b5b4c59 tempest-ProjectReaderTests-184027869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ccdfe1f-fa72-4ea4-8c54-5b89e11308a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7eff0731-bd5f-4e0c-b614-cd4f6d81c745', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:09:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a9f93c57-3928-4625-8e4a-57377b5b4c59 tempest-ProjectReaderTests-184027869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35550fc4-38d9-47ec-9d34-31ef729054e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:09:45 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-a9f93c57-3928-4625-8e4a-57377b5b4c59 tempest-ProjectReaderTests-184027869 None] Volume volume-7eff0731-bd5f-4e0c-b614-cd4f6d81c745 (7eff0731-bd5f-4e0c-b614-cd4f6d81c745): created successfully Sep 04 18:09:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a9f93c57-3928-4625-8e4a-57377b5b4c59 tempest-ProjectReaderTests-184027869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35550fc4-38d9-47ec-9d34-31ef729054e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:09:45 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a9f93c57-3928-4625-8e4a-57377b5b4c59 tempest-ProjectReaderTests-184027869 None] Flow 'volume_create_manager' (46c2068d-75e0-4abe-bcf2-3004d0c946f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:09:45 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-a9f93c57-3928-4625-8e4a-57377b5b4c59 tempest-ProjectReaderTests-184027869 None] Created volume successfully. Sep 04 18:09:46 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-63c67c94-dd21-40d7-a8f4-535902530cb5 tempest-ProjectReaderTests-184027869 None] Acquiring lock "cinder-7eff0731-bd5f-4e0c-b614-cd4f6d81c745-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:09:46 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-63c67c94-dd21-40d7-a8f4-535902530cb5 tempest-ProjectReaderTests-184027869 None] Lock "cinder-7eff0731-bd5f-4e0c-b614-cd4f6d81c745-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:09:46 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-63c67c94-dd21-40d7-a8f4-535902530cb5 tempest-ProjectReaderTests-184027869 None] Acquiring lock "cinder-quobyte-7eff0731-bd5f-4e0c-b614-cd4f6d81c745" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:09:46 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-63c67c94-dd21-40d7-a8f4-535902530cb5 tempest-ProjectReaderTests-184027869 None] Lock "cinder-quobyte-7eff0731-bd5f-4e0c-b614-cd4f6d81c745" acquired by "delete_volume" :: waited 0.015s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:09:46 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7903a7-db53-4623-bcf8-81bfcc544b33]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:09:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-63c67c94-dd21-40d7-a8f4-535902530cb5 tempest-ProjectReaderTests-184027869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7eff0731-bd5f-4e0c-b614-cd4f6d81c745 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:09:46 devstack sudo[106391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7eff0731-bd5f-4e0c-b614-cd4f6d81c745 Sep 04 18:09:46 devstack sudo[106391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:09:46 devstack sudo[106391]: pam_unix(sudo:session): session closed for user root Sep 04 18:09:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-63c67c94-dd21-40d7-a8f4-535902530cb5 tempest-ProjectReaderTests-184027869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7eff0731-bd5f-4e0c-b614-cd4f6d81c745" returned: 0 in 0.352s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:09:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-63c67c94-dd21-40d7-a8f4-535902530cb5 tempest-ProjectReaderTests-184027869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7eff0731-bd5f-4e0c-b614-cd4f6d81c745 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:09:46 devstack sudo[106396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7eff0731-bd5f-4e0c-b614-cd4f6d81c745 Sep 04 18:09:46 devstack sudo[106396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:09:46 devstack sudo[106396]: pam_unix(sudo:session): session closed for user root Sep 04 18:09:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-63c67c94-dd21-40d7-a8f4-535902530cb5 tempest-ProjectReaderTests-184027869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7eff0731-bd5f-4e0c-b614-cd4f6d81c745" returned: 0 in 0.241s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:09:46 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-63c67c94-dd21-40d7-a8f4-535902530cb5 tempest-ProjectReaderTests-184027869 None] Lock "cinder-quobyte-7eff0731-bd5f-4e0c-b614-cd4f6d81c745" released by "delete_volume" :: held 0.631s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:09:46 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-63c67c94-dd21-40d7-a8f4-535902530cb5 tempest-ProjectReaderTests-184027869 None] Created reservations ['b6c97bc0-1428-40da-8bc9-a0dd1f62857c', 'b1884c37-07f4-4ed9-9785-52db0c0c95ce', '508daa0f-d55a-4f47-95c3-86e24e53e007', 'b018905d-159d-4d51-9ced-1b89a6d0e0bc'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:09:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-63c67c94-dd21-40d7-a8f4-535902530cb5 tempest-ProjectReaderTests-184027869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:09:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-63c67c94-dd21-40d7-a8f4-535902530cb5 tempest-ProjectReaderTests-184027869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:09:47 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-63c67c94-dd21-40d7-a8f4-535902530cb5 tempest-ProjectReaderTests-184027869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:09:47 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-63c67c94-dd21-40d7-a8f4-535902530cb5 tempest-ProjectReaderTests-184027869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:09:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-63c67c94-dd21-40d7-a8f4-535902530cb5 tempest-ProjectReaderTests-184027869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:09:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-63c67c94-dd21-40d7-a8f4-535902530cb5 tempest-ProjectReaderTests-184027869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:09:47 devstack sudo[106399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:09:47 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:09:47 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root Sep 04 18:09:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-63c67c94-dd21-40d7-a8f4-535902530cb5 tempest-ProjectReaderTests-184027869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.245s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:09:47 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-63c67c94-dd21-40d7-a8f4-535902530cb5 tempest-ProjectReaderTests-184027869 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:09:47 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-63c67c94-dd21-40d7-a8f4-535902530cb5 tempest-ProjectReaderTests-184027869 None] Deleted volume successfully. Sep 04 18:09:47 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-63c67c94-dd21-40d7-a8f4-535902530cb5 tempest-ProjectReaderTests-184027869 None] Lock "cinder-7eff0731-bd5f-4e0c-b614-cd4f6d81c745-delete_volume" released by "delete_volume" :: held 1.070s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:09:47 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e607b32-109c-44c6-98bf-9c1f310dc705 tempest-ProjectReaderTests-184027869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:09:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2e607b32-109c-44c6-98bf-9c1f310dc705 tempest-ProjectReaderTests-184027869 None] Flow 'volume_create_manager' (82f7a40e-08d8-4b5d-95e2-ab8fcc80de87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:09:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2e607b32-109c-44c6-98bf-9c1f310dc705 tempest-ProjectReaderTests-184027869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5cf0f87-b3d4-448b-b385-1168cececd91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:09:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2e607b32-109c-44c6-98bf-9c1f310dc705 tempest-ProjectReaderTests-184027869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5cf0f87-b3d4-448b-b385-1168cececd91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1502359291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=392750ba-bd81-42be-8739-48e74f7d8e1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b94eb27a90554abe89257a4861a23cdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:09:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:09:48Z,use_quota=True,user_id='07daa1e90b564afba4495d26fc5c7834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:09:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2e607b32-109c-44c6-98bf-9c1f310dc705 tempest-ProjectReaderTests-184027869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dee494c0-cd40-409c-8f86-09d363447ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:09:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2e607b32-109c-44c6-98bf-9c1f310dc705 tempest-ProjectReaderTests-184027869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dee494c0-cd40-409c-8f86-09d363447ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:09:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2e607b32-109c-44c6-98bf-9c1f310dc705 tempest-ProjectReaderTests-184027869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92d4a8ee-4f7b-4c5b-ab58-40be57ae957c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:09:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2e607b32-109c-44c6-98bf-9c1f310dc705 tempest-ProjectReaderTests-184027869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92d4a8ee-4f7b-4c5b-ab58-40be57ae957c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '392750ba-bd81-42be-8739-48e74f7d8e1c', 'volume_name': 'volume-392750ba-bd81-42be-8739-48e74f7d8e1c', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:09:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2e607b32-109c-44c6-98bf-9c1f310dc705 tempest-ProjectReaderTests-184027869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75073020-6615-4367-8acf-24f8a88aa48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:09:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2e607b32-109c-44c6-98bf-9c1f310dc705 tempest-ProjectReaderTests-184027869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75073020-6615-4367-8acf-24f8a88aa48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:09:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2e607b32-109c-44c6-98bf-9c1f310dc705 tempest-ProjectReaderTests-184027869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbe3dc86-2f25-4ec2-8c55-0d7410659a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:09:47 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-2e607b32-109c-44c6-98bf-9c1f310dc705 tempest-ProjectReaderTests-184027869 None] Volume 392750ba-bd81-42be-8739-48e74f7d8e1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-392750ba-bd81-42be-8739-48e74f7d8e1c', 'volume_size': 1} Sep 04 18:09:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-2e607b32-109c-44c6-98bf-9c1f310dc705 tempest-ProjectReaderTests-184027869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:09:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-2e607b32-109c-44c6-98bf-9c1f310dc705 tempest-ProjectReaderTests-184027869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:09:47 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-2e607b32-109c-44c6-98bf-9c1f310dc705 tempest-ProjectReaderTests-184027869 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1502359291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=392750ba-bd81-42be-8739-48e74f7d8e1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b94eb27a90554abe89257a4861a23cdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:09:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:09:48Z,use_quota=True,user_id='07daa1e90b564afba4495d26fc5c7834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:09:47 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-2e607b32-109c-44c6-98bf-9c1f310dc705 tempest-ProjectReaderTests-184027869 None] Creating volume 392750ba-bd81-42be-8739-48e74f7d8e1c {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:09:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-2e607b32-109c-44c6-98bf-9c1f310dc705 tempest-ProjectReaderTests-184027869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:09:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-2e607b32-109c-44c6-98bf-9c1f310dc705 tempest-ProjectReaderTests-184027869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:09:47 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-2e607b32-109c-44c6-98bf-9c1f310dc705 tempest-ProjectReaderTests-184027869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:09:47 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-2e607b32-109c-44c6-98bf-9c1f310dc705 tempest-ProjectReaderTests-184027869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:09:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-2e607b32-109c-44c6-98bf-9c1f310dc705 tempest-ProjectReaderTests-184027869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:09:47 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-2e607b32-109c-44c6-98bf-9c1f310dc705 tempest-ProjectReaderTests-184027869 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:09:47 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-2e607b32-109c-44c6-98bf-9c1f310dc705 tempest-ProjectReaderTests-184027869 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:09:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2e607b32-109c-44c6-98bf-9c1f310dc705 tempest-ProjectReaderTests-184027869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-392750ba-bd81-42be-8739-48e74f7d8e1c 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:09:47 devstack sudo[106402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-392750ba-bd81-42be-8739-48e74f7d8e1c 1073741824 Sep 04 18:09:47 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:09:48 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root Sep 04 18:09:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2e607b32-109c-44c6-98bf-9c1f310dc705 tempest-ProjectReaderTests-184027869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-392750ba-bd81-42be-8739-48e74f7d8e1c 1073741824" returned: 0 in 0.398s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:09:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2e607b32-109c-44c6-98bf-9c1f310dc705 tempest-ProjectReaderTests-184027869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-392750ba-bd81-42be-8739-48e74f7d8e1c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:09:48 devstack sudo[106407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-392750ba-bd81-42be-8739-48e74f7d8e1c Sep 04 18:09:48 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:09:48 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root Sep 04 18:09:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2e607b32-109c-44c6-98bf-9c1f310dc705 tempest-ProjectReaderTests-184027869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-392750ba-bd81-42be-8739-48e74f7d8e1c" returned: 0 in 0.256s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:09:48 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-2e607b32-109c-44c6-98bf-9c1f310dc705 tempest-ProjectReaderTests-184027869 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:09:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-2e607b32-109c-44c6-98bf-9c1f310dc705 tempest-ProjectReaderTests-184027869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:09:48 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2e607b32-109c-44c6-98bf-9c1f310dc705 tempest-ProjectReaderTests-184027869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbe3dc86-2f25-4ec2-8c55-0d7410659a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-392750ba-bd81-42be-8739-48e74f7d8e1c', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:09:48 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2e607b32-109c-44c6-98bf-9c1f310dc705 tempest-ProjectReaderTests-184027869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7e81245-f5da-4195-82b4-397d65fdc69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:09:48 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-2e607b32-109c-44c6-98bf-9c1f310dc705 tempest-ProjectReaderTests-184027869 None] Volume volume-392750ba-bd81-42be-8739-48e74f7d8e1c (392750ba-bd81-42be-8739-48e74f7d8e1c): created successfully Sep 04 18:09:48 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2e607b32-109c-44c6-98bf-9c1f310dc705 tempest-ProjectReaderTests-184027869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7e81245-f5da-4195-82b4-397d65fdc69b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:09:48 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2e607b32-109c-44c6-98bf-9c1f310dc705 tempest-ProjectReaderTests-184027869 None] Flow 'volume_create_manager' (82f7a40e-08d8-4b5d-95e2-ab8fcc80de87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:09:48 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-2e607b32-109c-44c6-98bf-9c1f310dc705 tempest-ProjectReaderTests-184027869 None] Created volume successfully. Sep 04 18:09:48 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-214f3cf8-9a55-4f62-b00a-62f5549b94bf tempest-ProjectReaderTests-184027869 None] Acquiring lock "cinder-392750ba-bd81-42be-8739-48e74f7d8e1c-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:09:48 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-214f3cf8-9a55-4f62-b00a-62f5549b94bf tempest-ProjectReaderTests-184027869 None] Lock "cinder-392750ba-bd81-42be-8739-48e74f7d8e1c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:09:48 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-214f3cf8-9a55-4f62-b00a-62f5549b94bf tempest-ProjectReaderTests-184027869 None] Acquiring lock "cinder-quobyte-392750ba-bd81-42be-8739-48e74f7d8e1c" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:09:48 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-214f3cf8-9a55-4f62-b00a-62f5549b94bf tempest-ProjectReaderTests-184027869 None] Lock "cinder-quobyte-392750ba-bd81-42be-8739-48e74f7d8e1c" acquired by "delete_volume" :: waited 0.013s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:09:49 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9cdaf4f-8334-487a-9c84-11a786b08a08]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:09:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-214f3cf8-9a55-4f62-b00a-62f5549b94bf tempest-ProjectReaderTests-184027869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-392750ba-bd81-42be-8739-48e74f7d8e1c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:09:49 devstack sudo[106424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-392750ba-bd81-42be-8739-48e74f7d8e1c Sep 04 18:09:49 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:09:49 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root Sep 04 18:09:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-214f3cf8-9a55-4f62-b00a-62f5549b94bf tempest-ProjectReaderTests-184027869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-392750ba-bd81-42be-8739-48e74f7d8e1c" returned: 0 in 0.368s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:09:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-214f3cf8-9a55-4f62-b00a-62f5549b94bf tempest-ProjectReaderTests-184027869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-392750ba-bd81-42be-8739-48e74f7d8e1c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:09:49 devstack sudo[106451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-392750ba-bd81-42be-8739-48e74f7d8e1c Sep 04 18:09:49 devstack sudo[106451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:09:49 devstack sudo[106451]: pam_unix(sudo:session): session closed for user root Sep 04 18:09:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-214f3cf8-9a55-4f62-b00a-62f5549b94bf tempest-ProjectReaderTests-184027869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-392750ba-bd81-42be-8739-48e74f7d8e1c" returned: 0 in 0.246s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:09:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-214f3cf8-9a55-4f62-b00a-62f5549b94bf tempest-ProjectReaderTests-184027869 None] Lock "cinder-quobyte-392750ba-bd81-42be-8739-48e74f7d8e1c" released by "delete_volume" :: held 0.652s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:09:49 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-214f3cf8-9a55-4f62-b00a-62f5549b94bf tempest-ProjectReaderTests-184027869 None] Created reservations ['e73cdfaa-a5d6-4c10-b3b5-e89847b2e59b', 'ee9d44a4-9085-4373-ba5d-7a07e27c0166', '55d93fe8-36e0-45a5-997a-d090f4641e51', '8bd12a47-8f43-4650-b661-580c7cda619c'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:09:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-214f3cf8-9a55-4f62-b00a-62f5549b94bf tempest-ProjectReaderTests-184027869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:09:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-214f3cf8-9a55-4f62-b00a-62f5549b94bf tempest-ProjectReaderTests-184027869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:09:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-214f3cf8-9a55-4f62-b00a-62f5549b94bf tempest-ProjectReaderTests-184027869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:09:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-214f3cf8-9a55-4f62-b00a-62f5549b94bf tempest-ProjectReaderTests-184027869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:09:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-214f3cf8-9a55-4f62-b00a-62f5549b94bf tempest-ProjectReaderTests-184027869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:09:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-214f3cf8-9a55-4f62-b00a-62f5549b94bf tempest-ProjectReaderTests-184027869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:09:49 devstack sudo[106454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:09:49 devstack sudo[106454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:09:49 devstack sudo[106454]: pam_unix(sudo:session): session closed for user root Sep 04 18:09:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-214f3cf8-9a55-4f62-b00a-62f5549b94bf tempest-ProjectReaderTests-184027869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.232s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:09:49 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-214f3cf8-9a55-4f62-b00a-62f5549b94bf tempest-ProjectReaderTests-184027869 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:09:50 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-214f3cf8-9a55-4f62-b00a-62f5549b94bf tempest-ProjectReaderTests-184027869 None] Deleted volume successfully. Sep 04 18:09:50 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-214f3cf8-9a55-4f62-b00a-62f5549b94bf tempest-ProjectReaderTests-184027869 None] Lock "cinder-392750ba-bd81-42be-8739-48e74f7d8e1c-delete_volume" released by "delete_volume" :: held 1.092s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:09:59 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=52,cinder:UPDATE=62,cinder:INSERT=21,cinder:DELETE=7 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 18:10:00 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=51,cinder:INSERT=19,cinder:UPDATE=65,cinder:DELETE=4 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 18:10:02 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-c06ac5f8-43c5-468b-89aa-33e7c24f8b1b tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:10:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c06ac5f8-43c5-468b-89aa-33e7c24f8b1b tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Flow 'volume_create_manager' (16dd7713-a7b1-4e22-b424-3ed08f6e6292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:10:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c06ac5f8-43c5-468b-89aa-33e7c24f8b1b tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf343ceb-0377-44d1-a852-d72a88937268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c06ac5f8-43c5-468b-89aa-33e7c24f8b1b tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf343ceb-0377-44d1-a852-d72a88937268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:10:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-535426346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=218d531f-138f-4f3a-a327-f1bb654c69ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0be16266f0164d518c63d9215ed86bed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:10:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:10:02Z,use_quota=True,user_id='250cc4a672bd4b098c98a6de1b292cdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c06ac5f8-43c5-468b-89aa-33e7c24f8b1b tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (005fdbd1-1944-4f19-afe6-5886c5acb895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c06ac5f8-43c5-468b-89aa-33e7c24f8b1b tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (005fdbd1-1944-4f19-afe6-5886c5acb895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c06ac5f8-43c5-468b-89aa-33e7c24f8b1b tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1586c3fa-7d42-4145-b114-5755deecde3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c06ac5f8-43c5-468b-89aa-33e7c24f8b1b tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1586c3fa-7d42-4145-b114-5755deecde3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '218d531f-138f-4f3a-a327-f1bb654c69ee', 'volume_name': 'volume-218d531f-138f-4f3a-a327-f1bb654c69ee', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c06ac5f8-43c5-468b-89aa-33e7c24f8b1b tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec518f6d-2dc3-471b-9a79-0c81dde84702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c06ac5f8-43c5-468b-89aa-33e7c24f8b1b tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec518f6d-2dc3-471b-9a79-0c81dde84702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c06ac5f8-43c5-468b-89aa-33e7c24f8b1b tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5739aaf8-fe7d-4b24-b006-8656a848bd97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:02 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-c06ac5f8-43c5-468b-89aa-33e7c24f8b1b tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Volume 218d531f-138f-4f3a-a327-f1bb654c69ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-218d531f-138f-4f3a-a327-f1bb654c69ee', 'volume_size': 1} Sep 04 18:10:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c06ac5f8-43c5-468b-89aa-33e7c24f8b1b tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c06ac5f8-43c5-468b-89aa-33e7c24f8b1b tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:02 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c06ac5f8-43c5-468b-89aa-33e7c24f8b1b tempest-CreateVolumesFromSourceVolumeTest-211536695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:10:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-535426346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=218d531f-138f-4f3a-a327-f1bb654c69ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0be16266f0164d518c63d9215ed86bed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:10:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:10:02Z,use_quota=True,user_id='250cc4a672bd4b098c98a6de1b292cdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:10:02 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-c06ac5f8-43c5-468b-89aa-33e7c24f8b1b tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Creating volume 218d531f-138f-4f3a-a327-f1bb654c69ee {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:10:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c06ac5f8-43c5-468b-89aa-33e7c24f8b1b tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c06ac5f8-43c5-468b-89aa-33e7c24f8b1b tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:02 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c06ac5f8-43c5-468b-89aa-33e7c24f8b1b tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:10:02 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c06ac5f8-43c5-468b-89aa-33e7c24f8b1b tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:10:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c06ac5f8-43c5-468b-89aa-33e7c24f8b1b tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:02 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c06ac5f8-43c5-468b-89aa-33e7c24f8b1b tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:10:02 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-c06ac5f8-43c5-468b-89aa-33e7c24f8b1b tempest-CreateVolumesFromSourceVolumeTest-211536695 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:10:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c06ac5f8-43c5-468b-89aa-33e7c24f8b1b tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-218d531f-138f-4f3a-a327-f1bb654c69ee 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:02 devstack sudo[106503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-218d531f-138f-4f3a-a327-f1bb654c69ee 1073741824 Sep 04 18:10:02 devstack sudo[106503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:02 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-80bc12d6-8492-4582-a8dc-9bad1bbae5a3 tempest-CreateVolumesFromImageTest-131712280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:10:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-80bc12d6-8492-4582-a8dc-9bad1bbae5a3 tempest-CreateVolumesFromImageTest-131712280 None] Flow 'volume_create_manager' (bb87e754-e363-41a1-9abb-598b725f5d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:10:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-80bc12d6-8492-4582-a8dc-9bad1bbae5a3 tempest-CreateVolumesFromImageTest-131712280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e43b961d-aa0a-42aa-be50-5864699c31f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-80bc12d6-8492-4582-a8dc-9bad1bbae5a3 tempest-CreateVolumesFromImageTest-131712280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e43b961d-aa0a-42aa-be50-5864699c31f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:10:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1863776989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3436742b-ea0f-4b61-bc64-c0f3e966be88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4daea33775ac4789beb09961919185cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:10:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:10:02Z,use_quota=True,user_id='c446408afd1e458b971bb03a337d921d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-80bc12d6-8492-4582-a8dc-9bad1bbae5a3 tempest-CreateVolumesFromImageTest-131712280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (698cc634-f80a-44dc-ab85-dfc48e19a8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-80bc12d6-8492-4582-a8dc-9bad1bbae5a3 tempest-CreateVolumesFromImageTest-131712280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (698cc634-f80a-44dc-ab85-dfc48e19a8d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-80bc12d6-8492-4582-a8dc-9bad1bbae5a3 tempest-CreateVolumesFromImageTest-131712280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (244d2797-6084-445e-aed4-29aa82d6a686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-80bc12d6-8492-4582-a8dc-9bad1bbae5a3 tempest-CreateVolumesFromImageTest-131712280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (244d2797-6084-445e-aed4-29aa82d6a686) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3436742b-ea0f-4b61-bc64-c0f3e966be88', 'volume_name': 'volume-3436742b-ea0f-4b61-bc64-c0f3e966be88', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-80bc12d6-8492-4582-a8dc-9bad1bbae5a3 tempest-CreateVolumesFromImageTest-131712280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57559cfe-cb7c-447d-b28d-138876d13b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-80bc12d6-8492-4582-a8dc-9bad1bbae5a3 tempest-CreateVolumesFromImageTest-131712280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57559cfe-cb7c-447d-b28d-138876d13b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-80bc12d6-8492-4582-a8dc-9bad1bbae5a3 tempest-CreateVolumesFromImageTest-131712280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a5cea2e-4e58-4b1f-a41a-ac77c845c6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:02 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-80bc12d6-8492-4582-a8dc-9bad1bbae5a3 tempest-CreateVolumesFromImageTest-131712280 None] Volume 3436742b-ea0f-4b61-bc64-c0f3e966be88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3436742b-ea0f-4b61-bc64-c0f3e966be88', 'volume_size': 1} Sep 04 18:10:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-80bc12d6-8492-4582-a8dc-9bad1bbae5a3 tempest-CreateVolumesFromImageTest-131712280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:02 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9a1aea9-8256-4155-8b19-eec94a9f74ce tempest-CreateVolumesFromImageTest-131712280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:10:02 devstack sudo[106503]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f9a1aea9-8256-4155-8b19-eec94a9f74ce tempest-CreateVolumesFromImageTest-131712280 None] Flow 'volume_create_manager' (551ba902-9a88-4166-9f92-ff0bdcabcae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:10:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f9a1aea9-8256-4155-8b19-eec94a9f74ce tempest-CreateVolumesFromImageTest-131712280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (673c08d3-5011-4201-b81e-b913775c11b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c06ac5f8-43c5-468b-89aa-33e7c24f8b1b tempest-CreateVolumesFromSourceVolumeTest-211536695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-218d531f-138f-4f3a-a327-f1bb654c69ee 1073741824" returned: 0 in 0.772s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f9a1aea9-8256-4155-8b19-eec94a9f74ce tempest-CreateVolumesFromImageTest-131712280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (673c08d3-5011-4201-b81e-b913775c11b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:10:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-285464818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec784cf2-65b3-4539-a24f-6d59903c8f64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4daea33775ac4789beb09961919185cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:10:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:10:03Z,use_quota=True,user_id='c446408afd1e458b971bb03a337d921d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f9a1aea9-8256-4155-8b19-eec94a9f74ce tempest-CreateVolumesFromImageTest-131712280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed14a3cc-4f36-4231-97e6-04dad84721d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f9a1aea9-8256-4155-8b19-eec94a9f74ce tempest-CreateVolumesFromImageTest-131712280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed14a3cc-4f36-4231-97e6-04dad84721d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f9a1aea9-8256-4155-8b19-eec94a9f74ce tempest-CreateVolumesFromImageTest-131712280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (443d74ff-11d2-4c9d-8e79-fc5dfc5cbd6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f9a1aea9-8256-4155-8b19-eec94a9f74ce tempest-CreateVolumesFromImageTest-131712280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (443d74ff-11d2-4c9d-8e79-fc5dfc5cbd6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec784cf2-65b3-4539-a24f-6d59903c8f64', 'volume_name': 'volume-ec784cf2-65b3-4539-a24f-6d59903c8f64', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f9a1aea9-8256-4155-8b19-eec94a9f74ce tempest-CreateVolumesFromImageTest-131712280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce9fd125-348e-45ba-8999-3d37c4648dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f9a1aea9-8256-4155-8b19-eec94a9f74ce tempest-CreateVolumesFromImageTest-131712280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce9fd125-348e-45ba-8999-3d37c4648dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f9a1aea9-8256-4155-8b19-eec94a9f74ce tempest-CreateVolumesFromImageTest-131712280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38c61714-d78a-4b2c-bc49-789c51168438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:03 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-f9a1aea9-8256-4155-8b19-eec94a9f74ce tempest-CreateVolumesFromImageTest-131712280 None] Volume ec784cf2-65b3-4539-a24f-6d59903c8f64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec784cf2-65b3-4539-a24f-6d59903c8f64', 'volume_size': 1} Sep 04 18:10:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f9a1aea9-8256-4155-8b19-eec94a9f74ce tempest-CreateVolumesFromImageTest-131712280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c06ac5f8-43c5-468b-89aa-33e7c24f8b1b tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-218d531f-138f-4f3a-a327-f1bb654c69ee {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:03 devstack sudo[106513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-218d531f-138f-4f3a-a327-f1bb654c69ee Sep 04 18:10:03 devstack sudo[106513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:03 devstack sudo[106513]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c06ac5f8-43c5-468b-89aa-33e7c24f8b1b tempest-CreateVolumesFromSourceVolumeTest-211536695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-218d531f-138f-4f3a-a327-f1bb654c69ee" returned: 0 in 0.282s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:03 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c06ac5f8-43c5-468b-89aa-33e7c24f8b1b tempest-CreateVolumesFromSourceVolumeTest-211536695 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:10:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c06ac5f8-43c5-468b-89aa-33e7c24f8b1b tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-80bc12d6-8492-4582-a8dc-9bad1bbae5a3 tempest-CreateVolumesFromImageTest-131712280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.864s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:03 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-80bc12d6-8492-4582-a8dc-9bad1bbae5a3 tempest-CreateVolumesFromImageTest-131712280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:10:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1863776989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3436742b-ea0f-4b61-bc64-c0f3e966be88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4daea33775ac4789beb09961919185cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:10:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:10:02Z,use_quota=True,user_id='c446408afd1e458b971bb03a337d921d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:10:03 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-80bc12d6-8492-4582-a8dc-9bad1bbae5a3 tempest-CreateVolumesFromImageTest-131712280 None] Creating volume 3436742b-ea0f-4b61-bc64-c0f3e966be88 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:10:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-80bc12d6-8492-4582-a8dc-9bad1bbae5a3 tempest-CreateVolumesFromImageTest-131712280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-80bc12d6-8492-4582-a8dc-9bad1bbae5a3 tempest-CreateVolumesFromImageTest-131712280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:03 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-80bc12d6-8492-4582-a8dc-9bad1bbae5a3 tempest-CreateVolumesFromImageTest-131712280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:10:03 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-80bc12d6-8492-4582-a8dc-9bad1bbae5a3 tempest-CreateVolumesFromImageTest-131712280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:10:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-80bc12d6-8492-4582-a8dc-9bad1bbae5a3 tempest-CreateVolumesFromImageTest-131712280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:03 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-80bc12d6-8492-4582-a8dc-9bad1bbae5a3 tempest-CreateVolumesFromImageTest-131712280 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:10:03 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-80bc12d6-8492-4582-a8dc-9bad1bbae5a3 tempest-CreateVolumesFromImageTest-131712280 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:10:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-80bc12d6-8492-4582-a8dc-9bad1bbae5a3 tempest-CreateVolumesFromImageTest-131712280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3436742b-ea0f-4b61-bc64-c0f3e966be88 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:03 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a08023d-d95f-43b1-a17c-e21ec3b8c28c tempest-CreateVolumesFromImageTest-131712280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:10:03 devstack sudo[106516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3436742b-ea0f-4b61-bc64-c0f3e966be88 1073741824 Sep 04 18:10:03 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4a08023d-d95f-43b1-a17c-e21ec3b8c28c tempest-CreateVolumesFromImageTest-131712280 None] Flow 'volume_create_manager' (fa5b69d8-b3db-4702-a7dd-05a2ae5f9ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:10:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4a08023d-d95f-43b1-a17c-e21ec3b8c28c tempest-CreateVolumesFromImageTest-131712280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c0c3777-5692-44d7-a402-b21c21b8ca9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c06ac5f8-43c5-468b-89aa-33e7c24f8b1b tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5739aaf8-fe7d-4b24-b006-8656a848bd97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-218d531f-138f-4f3a-a327-f1bb654c69ee', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c06ac5f8-43c5-468b-89aa-33e7c24f8b1b tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4943ebe-4c88-418e-915b-b08bfadef4a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4a08023d-d95f-43b1-a17c-e21ec3b8c28c tempest-CreateVolumesFromImageTest-131712280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c0c3777-5692-44d7-a402-b21c21b8ca9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:10:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1633444620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d841cf2-b896-4970-8538-d1ebd9c6617b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4daea33775ac4789beb09961919185cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:10:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:10:03Z,use_quota=True,user_id='c446408afd1e458b971bb03a337d921d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4a08023d-d95f-43b1-a17c-e21ec3b8c28c tempest-CreateVolumesFromImageTest-131712280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdf1f35e-9ba3-441e-b84b-4d5643612629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4a08023d-d95f-43b1-a17c-e21ec3b8c28c tempest-CreateVolumesFromImageTest-131712280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdf1f35e-9ba3-441e-b84b-4d5643612629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4a08023d-d95f-43b1-a17c-e21ec3b8c28c tempest-CreateVolumesFromImageTest-131712280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (383e1304-f48b-473a-8aca-ef94bdc949cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4a08023d-d95f-43b1-a17c-e21ec3b8c28c tempest-CreateVolumesFromImageTest-131712280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (383e1304-f48b-473a-8aca-ef94bdc949cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d841cf2-b896-4970-8538-d1ebd9c6617b', 'volume_name': 'volume-0d841cf2-b896-4970-8538-d1ebd9c6617b', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4a08023d-d95f-43b1-a17c-e21ec3b8c28c tempest-CreateVolumesFromImageTest-131712280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d89d4c6-58fc-432d-a5e1-70053c8554c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4a08023d-d95f-43b1-a17c-e21ec3b8c28c tempest-CreateVolumesFromImageTest-131712280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d89d4c6-58fc-432d-a5e1-70053c8554c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4a08023d-d95f-43b1-a17c-e21ec3b8c28c tempest-CreateVolumesFromImageTest-131712280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f826c92-cc0c-4e8e-ab2f-7cb80ee65613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:03 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-4a08023d-d95f-43b1-a17c-e21ec3b8c28c tempest-CreateVolumesFromImageTest-131712280 None] Volume 0d841cf2-b896-4970-8538-d1ebd9c6617b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d841cf2-b896-4970-8538-d1ebd9c6617b', 'volume_size': 1} Sep 04 18:10:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4a08023d-d95f-43b1-a17c-e21ec3b8c28c tempest-CreateVolumesFromImageTest-131712280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:03 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-c06ac5f8-43c5-468b-89aa-33e7c24f8b1b tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Volume volume-218d531f-138f-4f3a-a327-f1bb654c69ee (218d531f-138f-4f3a-a327-f1bb654c69ee): created successfully Sep 04 18:10:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c06ac5f8-43c5-468b-89aa-33e7c24f8b1b tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4943ebe-4c88-418e-915b-b08bfadef4a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c06ac5f8-43c5-468b-89aa-33e7c24f8b1b tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Flow 'volume_create_manager' (16dd7713-a7b1-4e22-b424-3ed08f6e6292) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:10:03 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-c06ac5f8-43c5-468b-89aa-33e7c24f8b1b tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Created volume successfully. Sep 04 18:10:03 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b0bae19-3090-40e7-8462-f1cc82acbbb7 tempest-CreateVolumesFromImageTest-131712280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:10:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8b0bae19-3090-40e7-8462-f1cc82acbbb7 tempest-CreateVolumesFromImageTest-131712280 None] Flow 'volume_create_manager' (41ccb162-219a-4656-9cea-c4a4e59c36e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:10:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8b0bae19-3090-40e7-8462-f1cc82acbbb7 tempest-CreateVolumesFromImageTest-131712280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0318bed-de8e-4fb2-91b3-39722a276676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8b0bae19-3090-40e7-8462-f1cc82acbbb7 tempest-CreateVolumesFromImageTest-131712280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0318bed-de8e-4fb2-91b3-39722a276676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:10:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-746398782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46cbc014-5964-4e88-b89d-e9beeac6d110,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4daea33775ac4789beb09961919185cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:10:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:10:04Z,use_quota=True,user_id='c446408afd1e458b971bb03a337d921d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8b0bae19-3090-40e7-8462-f1cc82acbbb7 tempest-CreateVolumesFromImageTest-131712280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78b4fcbb-06b1-4c23-bf1c-a2939958b56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8b0bae19-3090-40e7-8462-f1cc82acbbb7 tempest-CreateVolumesFromImageTest-131712280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78b4fcbb-06b1-4c23-bf1c-a2939958b56f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8b0bae19-3090-40e7-8462-f1cc82acbbb7 tempest-CreateVolumesFromImageTest-131712280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d734494-0611-403f-9fce-980e4fa4ffb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8b0bae19-3090-40e7-8462-f1cc82acbbb7 tempest-CreateVolumesFromImageTest-131712280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d734494-0611-403f-9fce-980e4fa4ffb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46cbc014-5964-4e88-b89d-e9beeac6d110', 'volume_name': 'volume-46cbc014-5964-4e88-b89d-e9beeac6d110', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8b0bae19-3090-40e7-8462-f1cc82acbbb7 tempest-CreateVolumesFromImageTest-131712280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (951eacfd-1ac6-4cc7-b10a-fa1523f06a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8b0bae19-3090-40e7-8462-f1cc82acbbb7 tempest-CreateVolumesFromImageTest-131712280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (951eacfd-1ac6-4cc7-b10a-fa1523f06a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8b0bae19-3090-40e7-8462-f1cc82acbbb7 tempest-CreateVolumesFromImageTest-131712280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (304d7539-15ac-4468-843c-a0aaa385bd6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:03 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-8b0bae19-3090-40e7-8462-f1cc82acbbb7 tempest-CreateVolumesFromImageTest-131712280 None] Volume 46cbc014-5964-4e88-b89d-e9beeac6d110: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46cbc014-5964-4e88-b89d-e9beeac6d110', 'volume_size': 1} Sep 04 18:10:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8b0bae19-3090-40e7-8462-f1cc82acbbb7 tempest-CreateVolumesFromImageTest-131712280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:04 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-80bc12d6-8492-4582-a8dc-9bad1bbae5a3 tempest-CreateVolumesFromImageTest-131712280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3436742b-ea0f-4b61-bc64-c0f3e966be88 1073741824" returned: 0 in 0.737s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-80bc12d6-8492-4582-a8dc-9bad1bbae5a3 tempest-CreateVolumesFromImageTest-131712280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3436742b-ea0f-4b61-bc64-c0f3e966be88 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:04 devstack sudo[106523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3436742b-ea0f-4b61-bc64-c0f3e966be88 Sep 04 18:10:04 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:04 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cb680b5-f58d-4f59-a8d3-642c87f5ca1d tempest-CreateVolumesFromImageTest-131712280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:10:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0cb680b5-f58d-4f59-a8d3-642c87f5ca1d tempest-CreateVolumesFromImageTest-131712280 None] Flow 'volume_create_manager' (6f46f4ca-5f95-4322-b336-4fb2fb9ea39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:10:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0cb680b5-f58d-4f59-a8d3-642c87f5ca1d tempest-CreateVolumesFromImageTest-131712280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f293358-73cf-42f3-bade-0411f2d692cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0cb680b5-f58d-4f59-a8d3-642c87f5ca1d tempest-CreateVolumesFromImageTest-131712280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f293358-73cf-42f3-bade-0411f2d692cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:10:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1553211448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1e15e86-3f25-4036-ac53-b7aa95ecc2c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4daea33775ac4789beb09961919185cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:10:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:10:04Z,use_quota=True,user_id='c446408afd1e458b971bb03a337d921d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0cb680b5-f58d-4f59-a8d3-642c87f5ca1d tempest-CreateVolumesFromImageTest-131712280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1c20145-247d-472f-9ef1-8bdf8c4faa05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0cb680b5-f58d-4f59-a8d3-642c87f5ca1d tempest-CreateVolumesFromImageTest-131712280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1c20145-247d-472f-9ef1-8bdf8c4faa05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0cb680b5-f58d-4f59-a8d3-642c87f5ca1d tempest-CreateVolumesFromImageTest-131712280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e942016-6539-4fb3-9002-9b7264bfdbbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0cb680b5-f58d-4f59-a8d3-642c87f5ca1d tempest-CreateVolumesFromImageTest-131712280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e942016-6539-4fb3-9002-9b7264bfdbbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1e15e86-3f25-4036-ac53-b7aa95ecc2c9', 'volume_name': 'volume-d1e15e86-3f25-4036-ac53-b7aa95ecc2c9', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0cb680b5-f58d-4f59-a8d3-642c87f5ca1d tempest-CreateVolumesFromImageTest-131712280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (683cba56-4b55-4159-818b-f905894ae2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0cb680b5-f58d-4f59-a8d3-642c87f5ca1d tempest-CreateVolumesFromImageTest-131712280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (683cba56-4b55-4159-818b-f905894ae2c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0cb680b5-f58d-4f59-a8d3-642c87f5ca1d tempest-CreateVolumesFromImageTest-131712280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30453d08-c00e-4327-bf42-d44632aaae7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:04 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-0cb680b5-f58d-4f59-a8d3-642c87f5ca1d tempest-CreateVolumesFromImageTest-131712280 None] Volume d1e15e86-3f25-4036-ac53-b7aa95ecc2c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1e15e86-3f25-4036-ac53-b7aa95ecc2c9', 'volume_size': 1} Sep 04 18:10:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0cb680b5-f58d-4f59-a8d3-642c87f5ca1d tempest-CreateVolumesFromImageTest-131712280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:04 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-80bc12d6-8492-4582-a8dc-9bad1bbae5a3 tempest-CreateVolumesFromImageTest-131712280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3436742b-ea0f-4b61-bc64-c0f3e966be88" returned: 0 in 0.370s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:04 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-80bc12d6-8492-4582-a8dc-9bad1bbae5a3 tempest-CreateVolumesFromImageTest-131712280 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:10:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-80bc12d6-8492-4582-a8dc-9bad1bbae5a3 tempest-CreateVolumesFromImageTest-131712280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.170s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f9a1aea9-8256-4155-8b19-eec94a9f74ce tempest-CreateVolumesFromImageTest-131712280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.496s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:04 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f9a1aea9-8256-4155-8b19-eec94a9f74ce tempest-CreateVolumesFromImageTest-131712280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:10:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-285464818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec784cf2-65b3-4539-a24f-6d59903c8f64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4daea33775ac4789beb09961919185cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:10:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:10:03Z,use_quota=True,user_id='c446408afd1e458b971bb03a337d921d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:10:04 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-f9a1aea9-8256-4155-8b19-eec94a9f74ce tempest-CreateVolumesFromImageTest-131712280 None] Creating volume ec784cf2-65b3-4539-a24f-6d59903c8f64 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:10:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f9a1aea9-8256-4155-8b19-eec94a9f74ce tempest-CreateVolumesFromImageTest-131712280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f9a1aea9-8256-4155-8b19-eec94a9f74ce tempest-CreateVolumesFromImageTest-131712280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:04 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f9a1aea9-8256-4155-8b19-eec94a9f74ce tempest-CreateVolumesFromImageTest-131712280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:10:04 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f9a1aea9-8256-4155-8b19-eec94a9f74ce tempest-CreateVolumesFromImageTest-131712280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:10:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f9a1aea9-8256-4155-8b19-eec94a9f74ce tempest-CreateVolumesFromImageTest-131712280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:04 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f9a1aea9-8256-4155-8b19-eec94a9f74ce tempest-CreateVolumesFromImageTest-131712280 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:10:04 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-f9a1aea9-8256-4155-8b19-eec94a9f74ce tempest-CreateVolumesFromImageTest-131712280 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:10:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f9a1aea9-8256-4155-8b19-eec94a9f74ce tempest-CreateVolumesFromImageTest-131712280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ec784cf2-65b3-4539-a24f-6d59903c8f64 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:04 devstack sudo[106526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ec784cf2-65b3-4539-a24f-6d59903c8f64 1073741824 Sep 04 18:10:04 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-80bc12d6-8492-4582-a8dc-9bad1bbae5a3 tempest-CreateVolumesFromImageTest-131712280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a5cea2e-4e58-4b1f-a41a-ac77c845c6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3436742b-ea0f-4b61-bc64-c0f3e966be88', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-80bc12d6-8492-4582-a8dc-9bad1bbae5a3 tempest-CreateVolumesFromImageTest-131712280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab514f21-aadf-4ca7-b75d-d30dcda22fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:04 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-80bc12d6-8492-4582-a8dc-9bad1bbae5a3 tempest-CreateVolumesFromImageTest-131712280 None] Volume volume-3436742b-ea0f-4b61-bc64-c0f3e966be88 (3436742b-ea0f-4b61-bc64-c0f3e966be88): created successfully Sep 04 18:10:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-80bc12d6-8492-4582-a8dc-9bad1bbae5a3 tempest-CreateVolumesFromImageTest-131712280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab514f21-aadf-4ca7-b75d-d30dcda22fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-80bc12d6-8492-4582-a8dc-9bad1bbae5a3 tempest-CreateVolumesFromImageTest-131712280 None] Flow 'volume_create_manager' (bb87e754-e363-41a1-9abb-598b725f5d59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:10:04 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-80bc12d6-8492-4582-a8dc-9bad1bbae5a3 tempest-CreateVolumesFromImageTest-131712280 None] Created volume successfully. Sep 04 18:10:04 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea798151-1b35-4491-8651-4090ba04fb68 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:10:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ea798151-1b35-4491-8651-4090ba04fb68 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Flow 'volume_create_manager' (aa00482a-a174-445f-b3c6-e7a668ed1d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:10:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ea798151-1b35-4491-8651-4090ba04fb68 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3553490-6449-4485-9c67-0f2e1ea7c0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ea798151-1b35-4491-8651-4090ba04fb68 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3553490-6449-4485-9c67-0f2e1ea7c0d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:10:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2035474244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3ed2c2f-32b8-430d-93da-8377dc4415f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0be16266f0164d518c63d9215ed86bed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:10:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:10:05Z,use_quota=True,user_id='250cc4a672bd4b098c98a6de1b292cdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ea798151-1b35-4491-8651-4090ba04fb68 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67feb623-d9a8-4b23-a76c-acabe8a121b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ea798151-1b35-4491-8651-4090ba04fb68 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67feb623-d9a8-4b23-a76c-acabe8a121b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ea798151-1b35-4491-8651-4090ba04fb68 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (239e1eba-e416-4156-9b58-815c7dc28867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ea798151-1b35-4491-8651-4090ba04fb68 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (239e1eba-e416-4156-9b58-815c7dc28867) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3ed2c2f-32b8-430d-93da-8377dc4415f1', 'volume_name': 'volume-b3ed2c2f-32b8-430d-93da-8377dc4415f1', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ea798151-1b35-4491-8651-4090ba04fb68 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (933f32ae-77a8-4bd3-a5e6-f0d4988e9c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ea798151-1b35-4491-8651-4090ba04fb68 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (933f32ae-77a8-4bd3-a5e6-f0d4988e9c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ea798151-1b35-4491-8651-4090ba04fb68 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4550b488-e36e-4d5b-b0a0-e10b9c154902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:05 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-ea798151-1b35-4491-8651-4090ba04fb68 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Volume b3ed2c2f-32b8-430d-93da-8377dc4415f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3ed2c2f-32b8-430d-93da-8377dc4415f1', 'volume_size': 1} Sep 04 18:10:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ea798151-1b35-4491-8651-4090ba04fb68 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:05 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f9a1aea9-8256-4155-8b19-eec94a9f74ce tempest-CreateVolumesFromImageTest-131712280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ec784cf2-65b3-4539-a24f-6d59903c8f64 1073741824" returned: 0 in 0.591s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f9a1aea9-8256-4155-8b19-eec94a9f74ce tempest-CreateVolumesFromImageTest-131712280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ec784cf2-65b3-4539-a24f-6d59903c8f64 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:05 devstack sudo[106532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ec784cf2-65b3-4539-a24f-6d59903c8f64 Sep 04 18:10:05 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:05 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-aabbe70e-fa9d-40d0-b6b7-195d72ce36f0 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:10:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aabbe70e-fa9d-40d0-b6b7-195d72ce36f0 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Flow 'volume_create_manager' (a58d104e-324c-4252-99f5-6ec563521261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:10:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aabbe70e-fa9d-40d0-b6b7-195d72ce36f0 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45c34b31-d818-4417-9694-8aa58c256ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:05 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aabbe70e-fa9d-40d0-b6b7-195d72ce36f0 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45c34b31-d818-4417-9694-8aa58c256ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:10:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1109227953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65129330-fe9b-45bc-a6a5-eacc20b77c22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0be16266f0164d518c63d9215ed86bed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:10:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:10:05Z,use_quota=True,user_id='250cc4a672bd4b098c98a6de1b292cdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aabbe70e-fa9d-40d0-b6b7-195d72ce36f0 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b25dc1d-6194-4494-93ed-1e35963c9bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aabbe70e-fa9d-40d0-b6b7-195d72ce36f0 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b25dc1d-6194-4494-93ed-1e35963c9bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aabbe70e-fa9d-40d0-b6b7-195d72ce36f0 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a2d4209-41b5-4934-bc2a-38fe9a0588d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aabbe70e-fa9d-40d0-b6b7-195d72ce36f0 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a2d4209-41b5-4934-bc2a-38fe9a0588d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65129330-fe9b-45bc-a6a5-eacc20b77c22', 'volume_name': 'volume-65129330-fe9b-45bc-a6a5-eacc20b77c22', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aabbe70e-fa9d-40d0-b6b7-195d72ce36f0 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bd7c1d6-e1e0-4fef-8dc6-69888a5d061d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aabbe70e-fa9d-40d0-b6b7-195d72ce36f0 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bd7c1d6-e1e0-4fef-8dc6-69888a5d061d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aabbe70e-fa9d-40d0-b6b7-195d72ce36f0 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc262a45-ce83-4d6a-8c7c-578d794e11f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:05 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-aabbe70e-fa9d-40d0-b6b7-195d72ce36f0 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Volume 65129330-fe9b-45bc-a6a5-eacc20b77c22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65129330-fe9b-45bc-a6a5-eacc20b77c22', 'volume_size': 1} Sep 04 18:10:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-aabbe70e-fa9d-40d0-b6b7-195d72ce36f0 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f9a1aea9-8256-4155-8b19-eec94a9f74ce tempest-CreateVolumesFromImageTest-131712280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ec784cf2-65b3-4539-a24f-6d59903c8f64" returned: 0 in 0.389s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:05 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f9a1aea9-8256-4155-8b19-eec94a9f74ce tempest-CreateVolumesFromImageTest-131712280 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:10:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f9a1aea9-8256-4155-8b19-eec94a9f74ce tempest-CreateVolumesFromImageTest-131712280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4a08023d-d95f-43b1-a17c-e21ec3b8c28c tempest-CreateVolumesFromImageTest-131712280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.019s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:05 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4a08023d-d95f-43b1-a17c-e21ec3b8c28c tempest-CreateVolumesFromImageTest-131712280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:10:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1633444620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d841cf2-b896-4970-8538-d1ebd9c6617b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4daea33775ac4789beb09961919185cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:10:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:10:03Z,use_quota=True,user_id='c446408afd1e458b971bb03a337d921d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:10:05 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-4a08023d-d95f-43b1-a17c-e21ec3b8c28c tempest-CreateVolumesFromImageTest-131712280 None] Creating volume 0d841cf2-b896-4970-8538-d1ebd9c6617b {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:10:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4a08023d-d95f-43b1-a17c-e21ec3b8c28c tempest-CreateVolumesFromImageTest-131712280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4a08023d-d95f-43b1-a17c-e21ec3b8c28c tempest-CreateVolumesFromImageTest-131712280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:05 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4a08023d-d95f-43b1-a17c-e21ec3b8c28c tempest-CreateVolumesFromImageTest-131712280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:10:05 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4a08023d-d95f-43b1-a17c-e21ec3b8c28c tempest-CreateVolumesFromImageTest-131712280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:10:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4a08023d-d95f-43b1-a17c-e21ec3b8c28c tempest-CreateVolumesFromImageTest-131712280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:05 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4a08023d-d95f-43b1-a17c-e21ec3b8c28c tempest-CreateVolumesFromImageTest-131712280 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:10:05 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-4a08023d-d95f-43b1-a17c-e21ec3b8c28c tempest-CreateVolumesFromImageTest-131712280 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:10:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4a08023d-d95f-43b1-a17c-e21ec3b8c28c tempest-CreateVolumesFromImageTest-131712280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0d841cf2-b896-4970-8538-d1ebd9c6617b 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f9a1aea9-8256-4155-8b19-eec94a9f74ce tempest-CreateVolumesFromImageTest-131712280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38c61714-d78a-4b2c-bc49-789c51168438) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec784cf2-65b3-4539-a24f-6d59903c8f64', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:05 devstack sudo[106535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0d841cf2-b896-4970-8538-d1ebd9c6617b 1073741824 Sep 04 18:10:05 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f9a1aea9-8256-4155-8b19-eec94a9f74ce tempest-CreateVolumesFromImageTest-131712280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cbefe37-cbf3-424d-86fa-b7cb92a9a58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:05 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-f9a1aea9-8256-4155-8b19-eec94a9f74ce tempest-CreateVolumesFromImageTest-131712280 None] Volume volume-ec784cf2-65b3-4539-a24f-6d59903c8f64 (ec784cf2-65b3-4539-a24f-6d59903c8f64): created successfully Sep 04 18:10:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f9a1aea9-8256-4155-8b19-eec94a9f74ce tempest-CreateVolumesFromImageTest-131712280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cbefe37-cbf3-424d-86fa-b7cb92a9a58a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f9a1aea9-8256-4155-8b19-eec94a9f74ce tempest-CreateVolumesFromImageTest-131712280 None] Flow 'volume_create_manager' (551ba902-9a88-4166-9f92-ff0bdcabcae9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:10:05 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-f9a1aea9-8256-4155-8b19-eec94a9f74ce tempest-CreateVolumesFromImageTest-131712280 None] Created volume successfully. Sep 04 18:10:06 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecab358f-e3b3-4a2f-b153-2f9d8525bf74 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:10:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ecab358f-e3b3-4a2f-b153-2f9d8525bf74 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Flow 'volume_create_manager' (749775a6-f1ff-40b5-abcc-1c7b279f1dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:10:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ecab358f-e3b3-4a2f-b153-2f9d8525bf74 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6b0c359-3dcd-431a-9ddd-2a6e048cb3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ecab358f-e3b3-4a2f-b153-2f9d8525bf74 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6b0c359-3dcd-431a-9ddd-2a6e048cb3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:10:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1447313050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14e5ff0f-7ee2-49fe-ad95-569097647355,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0be16266f0164d518c63d9215ed86bed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:10:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:10:06Z,use_quota=True,user_id='250cc4a672bd4b098c98a6de1b292cdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ecab358f-e3b3-4a2f-b153-2f9d8525bf74 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7580b6cd-97db-4a0b-9650-708071fed476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ecab358f-e3b3-4a2f-b153-2f9d8525bf74 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7580b6cd-97db-4a0b-9650-708071fed476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:06 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ecab358f-e3b3-4a2f-b153-2f9d8525bf74 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fe4ed2e-ebed-446b-86b8-382b19d6d3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ecab358f-e3b3-4a2f-b153-2f9d8525bf74 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fe4ed2e-ebed-446b-86b8-382b19d6d3aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14e5ff0f-7ee2-49fe-ad95-569097647355', 'volume_name': 'volume-14e5ff0f-7ee2-49fe-ad95-569097647355', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ecab358f-e3b3-4a2f-b153-2f9d8525bf74 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60a71b97-42dc-4b77-9d0e-7c1e2618af92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ecab358f-e3b3-4a2f-b153-2f9d8525bf74 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60a71b97-42dc-4b77-9d0e-7c1e2618af92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ecab358f-e3b3-4a2f-b153-2f9d8525bf74 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d558ce7-d881-45fb-860f-23f54fa87d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:06 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-ecab358f-e3b3-4a2f-b153-2f9d8525bf74 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Volume 14e5ff0f-7ee2-49fe-ad95-569097647355: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14e5ff0f-7ee2-49fe-ad95-569097647355', 'volume_size': 1} Sep 04 18:10:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ecab358f-e3b3-4a2f-b153-2f9d8525bf74 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4a08023d-d95f-43b1-a17c-e21ec3b8c28c tempest-CreateVolumesFromImageTest-131712280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0d841cf2-b896-4970-8538-d1ebd9c6617b 1073741824" returned: 0 in 0.713s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4a08023d-d95f-43b1-a17c-e21ec3b8c28c tempest-CreateVolumesFromImageTest-131712280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0d841cf2-b896-4970-8538-d1ebd9c6617b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:06 devstack sudo[106542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0d841cf2-b896-4970-8538-d1ebd9c6617b Sep 04 18:10:06 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:06 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:10:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] Flow 'volume_create_manager' (4324d9ad-cc98-4002-9250-b11e990dfab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:10:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (701ccc8b-2604-4f22-aeb8-30d1be3757a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (701ccc8b-2604-4f22-aeb8-30d1be3757a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:10:06Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ffd19de-20c0-4813-ba4c-b63e1fbae845,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57d28cc49ead47099fe20cf9900b18a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:10:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:10:07Z,use_quota=True,user_id='deb2fa541e5442ee8d3e096021c03251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:06 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18fb2684-7f66-4175-8e77-102c5f6baab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18fb2684-7f66-4175-8e77-102c5f6baab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88ae7267-598e-4670-9065-1ef54dc10548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:06 devstack cinder-volume[87314]: DEBUG cinder.image.glance [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] Creating Keystone auth plugin from conf {{(pid=87314) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 04 18:10:06 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5e6ee18-556b-4b6b-ad8b-6a3235982efa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:10:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f5e6ee18-556b-4b6b-ad8b-6a3235982efa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Flow 'volume_create_manager' (9a8ba774-d31d-461c-bd3d-9990b1ccb21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:10:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f5e6ee18-556b-4b6b-ad8b-6a3235982efa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (961f24fb-ec4e-4811-be22-444aad55fc19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4a08023d-d95f-43b1-a17c-e21ec3b8c28c tempest-CreateVolumesFromImageTest-131712280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0d841cf2-b896-4970-8538-d1ebd9c6617b" returned: 0 in 0.443s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:06 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4a08023d-d95f-43b1-a17c-e21ec3b8c28c tempest-CreateVolumesFromImageTest-131712280 None] <== create_volume: return (1212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:10:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4a08023d-d95f-43b1-a17c-e21ec3b8c28c tempest-CreateVolumesFromImageTest-131712280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.215s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8b0bae19-3090-40e7-8462-f1cc82acbbb7 tempest-CreateVolumesFromImageTest-131712280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.879s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:06 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8b0bae19-3090-40e7-8462-f1cc82acbbb7 tempest-CreateVolumesFromImageTest-131712280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:10:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-746398782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46cbc014-5964-4e88-b89d-e9beeac6d110,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4daea33775ac4789beb09961919185cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:10:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:10:04Z,use_quota=True,user_id='c446408afd1e458b971bb03a337d921d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:10:06 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-8b0bae19-3090-40e7-8462-f1cc82acbbb7 tempest-CreateVolumesFromImageTest-131712280 None] Creating volume 46cbc014-5964-4e88-b89d-e9beeac6d110 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:10:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8b0bae19-3090-40e7-8462-f1cc82acbbb7 tempest-CreateVolumesFromImageTest-131712280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8b0bae19-3090-40e7-8462-f1cc82acbbb7 tempest-CreateVolumesFromImageTest-131712280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:06 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8b0bae19-3090-40e7-8462-f1cc82acbbb7 tempest-CreateVolumesFromImageTest-131712280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:10:06 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8b0bae19-3090-40e7-8462-f1cc82acbbb7 tempest-CreateVolumesFromImageTest-131712280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:10:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8b0bae19-3090-40e7-8462-f1cc82acbbb7 tempest-CreateVolumesFromImageTest-131712280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:06 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8b0bae19-3090-40e7-8462-f1cc82acbbb7 tempest-CreateVolumesFromImageTest-131712280 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:10:06 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-8b0bae19-3090-40e7-8462-f1cc82acbbb7 tempest-CreateVolumesFromImageTest-131712280 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:10:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8b0bae19-3090-40e7-8462-f1cc82acbbb7 tempest-CreateVolumesFromImageTest-131712280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-46cbc014-5964-4e88-b89d-e9beeac6d110 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:06 devstack sudo[106545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-46cbc014-5964-4e88-b89d-e9beeac6d110 1073741824 Sep 04 18:10:06 devstack sudo[106545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f5e6ee18-556b-4b6b-ad8b-6a3235982efa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (961f24fb-ec4e-4811-be22-444aad55fc19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:10:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-577050535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c14b02b8-ca04-40ef-99dd-634955d5665d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0be16266f0164d518c63d9215ed86bed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:10:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:10:07Z,use_quota=True,user_id='250cc4a672bd4b098c98a6de1b292cdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f5e6ee18-556b-4b6b-ad8b-6a3235982efa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccb0fb90-1b52-4027-8b49-6eeb8586ac27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f5e6ee18-556b-4b6b-ad8b-6a3235982efa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccb0fb90-1b52-4027-8b49-6eeb8586ac27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f5e6ee18-556b-4b6b-ad8b-6a3235982efa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56811ba8-aa02-46bc-914a-95fb73406f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f5e6ee18-556b-4b6b-ad8b-6a3235982efa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56811ba8-aa02-46bc-914a-95fb73406f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c14b02b8-ca04-40ef-99dd-634955d5665d', 'volume_name': 'volume-c14b02b8-ca04-40ef-99dd-634955d5665d', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f5e6ee18-556b-4b6b-ad8b-6a3235982efa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6dace67-4502-4e95-b59e-816d9f93f916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f5e6ee18-556b-4b6b-ad8b-6a3235982efa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6dace67-4502-4e95-b59e-816d9f93f916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f5e6ee18-556b-4b6b-ad8b-6a3235982efa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a99afb47-5120-4b85-b2fe-454a279a3e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:06 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-f5e6ee18-556b-4b6b-ad8b-6a3235982efa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Volume c14b02b8-ca04-40ef-99dd-634955d5665d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c14b02b8-ca04-40ef-99dd-634955d5665d', 'volume_size': 1} Sep 04 18:10:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f5e6ee18-556b-4b6b-ad8b-6a3235982efa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4a08023d-d95f-43b1-a17c-e21ec3b8c28c tempest-CreateVolumesFromImageTest-131712280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f826c92-cc0c-4e8e-ab2f-7cb80ee65613) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d841cf2-b896-4970-8538-d1ebd9c6617b', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4a08023d-d95f-43b1-a17c-e21ec3b8c28c tempest-CreateVolumesFromImageTest-131712280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bab6dc6-d69b-40a8-b222-14f1d720a5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:06 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-4a08023d-d95f-43b1-a17c-e21ec3b8c28c tempest-CreateVolumesFromImageTest-131712280 None] Volume volume-0d841cf2-b896-4970-8538-d1ebd9c6617b (0d841cf2-b896-4970-8538-d1ebd9c6617b): created successfully Sep 04 18:10:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4a08023d-d95f-43b1-a17c-e21ec3b8c28c tempest-CreateVolumesFromImageTest-131712280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bab6dc6-d69b-40a8-b222-14f1d720a5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-4a08023d-d95f-43b1-a17c-e21ec3b8c28c tempest-CreateVolumesFromImageTest-131712280 None] Flow 'volume_create_manager' (fa5b69d8-b3db-4702-a7dd-05a2ae5f9ce8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:10:07 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-4a08023d-d95f-43b1-a17c-e21ec3b8c28c tempest-CreateVolumesFromImageTest-131712280 None] Created volume successfully. Sep 04 18:10:07 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-e708e195-3d95-44c5-b1b8-eeb50e9c73ba tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:10:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e708e195-3d95-44c5-b1b8-eeb50e9c73ba tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Flow 'volume_create_manager' (f96d8ee8-9adb-4d05-ae38-2658c0b36080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:10:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e708e195-3d95-44c5-b1b8-eeb50e9c73ba tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44a25896-eeaf-41e8-8363-4d030c15b12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e708e195-3d95-44c5-b1b8-eeb50e9c73ba tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44a25896-eeaf-41e8-8363-4d030c15b12f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:10:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2045552422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8990194-9a5c-45d3-afec-6b8a38430dfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0be16266f0164d518c63d9215ed86bed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:10:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:10:07Z,use_quota=True,user_id='250cc4a672bd4b098c98a6de1b292cdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e708e195-3d95-44c5-b1b8-eeb50e9c73ba tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f9794ab-f7a5-4fef-9fda-6bd70b70f6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e708e195-3d95-44c5-b1b8-eeb50e9c73ba tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f9794ab-f7a5-4fef-9fda-6bd70b70f6fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e708e195-3d95-44c5-b1b8-eeb50e9c73ba tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b73e0b3-830b-495d-893a-24a9008dcef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e708e195-3d95-44c5-b1b8-eeb50e9c73ba tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b73e0b3-830b-495d-893a-24a9008dcef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8990194-9a5c-45d3-afec-6b8a38430dfc', 'volume_name': 'volume-f8990194-9a5c-45d3-afec-6b8a38430dfc', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e708e195-3d95-44c5-b1b8-eeb50e9c73ba tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2ade3f0-ff6c-454d-ba5b-4c5273832daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e708e195-3d95-44c5-b1b8-eeb50e9c73ba tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2ade3f0-ff6c-454d-ba5b-4c5273832daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e708e195-3d95-44c5-b1b8-eeb50e9c73ba tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc26e018-2163-49ad-a731-f2403b954690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:07 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-e708e195-3d95-44c5-b1b8-eeb50e9c73ba tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Volume f8990194-9a5c-45d3-afec-6b8a38430dfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8990194-9a5c-45d3-afec-6b8a38430dfc', 'volume_size': 1} Sep 04 18:10:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e708e195-3d95-44c5-b1b8-eeb50e9c73ba tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88ae7267-598e-4670-9065-1ef54dc10548) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9ffd19de-20c0-4813-ba4c-b63e1fbae845', 'volume_name': 'volume-9ffd19de-20c0-4813-ba4c-b63e1fbae845', 'volume_size': 1, 'image_id': 'e2b54df6-cb58-4461-b6b8-d59ec72d7067', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e2b54df6-cb58-4461-b6b8-d59ec72d7067', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9f6957a53e3142caae83fd43f4542a84', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '57d28cc49ead47099fe20cf9900b18a8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3eda2bb0b5ce859484c20f168f12e1079e558fe5286ce38aec69c5e6bb1119b7636569e6db9a0a41fb9e949d0a764f1ed2af11eee5d690c020f739ea08eb9648', 'id': 'e2b54df6-cb58-4461-b6b8-d59ec72d7067', 'created_at': datetime.datetime(2026, 9, 4, 16, 10, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 16, 10, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e2b54df6-cb58-4461-b6b8-d59ec72d7067/file', 'properties': {}}, 'image_service': }' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1f3a150-afbf-4cf1-b5c3-e5e1f7b18f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1f3a150-afbf-4cf1-b5c3-e5e1f7b18f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55fb17ed-7d9b-4ef8-8aaa-894e583c30e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:07 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] Volume 9ffd19de-20c0-4813-ba4c-b63e1fbae845: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9ffd19de-20c0-4813-ba4c-b63e1fbae845', 'volume_size': 1, 'image_id': 'e2b54df6-cb58-4461-b6b8-d59ec72d7067', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e2b54df6-cb58-4461-b6b8-d59ec72d7067', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9f6957a53e3142caae83fd43f4542a84', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '57d28cc49ead47099fe20cf9900b18a8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3eda2bb0b5ce859484c20f168f12e1079e558fe5286ce38aec69c5e6bb1119b7636569e6db9a0a41fb9e949d0a764f1ed2af11eee5d690c020f739ea08eb9648', 'id': 'e2b54df6-cb58-4461-b6b8-d59ec72d7067', 'created_at': datetime.datetime(2026, 9, 4, 16, 10, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 16, 10, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e2b54df6-cb58-4461-b6b8-d59ec72d7067/file', 'properties': {}}, 'image_service': } Sep 04 18:10:07 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] Trying to clone 9ffd19de-20c0-4813-ba4c-b63e1fbae845 from image e2b54df6-cb58-4461-b6b8-d59ec72d7067 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e2b54df6-cb58-4461-b6b8-d59ec72d7067', 'metadata': {}}]). {{(pid=87314) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 04 18:10:07 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e2b54df6-cb58-4461-b6b8-d59ec72d7067_adehay3odevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87314) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 04 18:10:07 devstack cinder-volume[87314]: INFO cinder.image.image_utils [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] Image download 0.00 MB at 0.00 MB/s Sep 04 18:10:07 devstack sudo[106545]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8b0bae19-3090-40e7-8462-f1cc82acbbb7 tempest-CreateVolumesFromImageTest-131712280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-46cbc014-5964-4e88-b89d-e9beeac6d110 1073741824" returned: 0 in 0.612s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:07 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[498144cd-019b-4cf4-b4f3-271fe24bc1ef]: (4, 'raw') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:10:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e2b54df6-cb58-4461-b6b8-d59ec72d7067_adehay3odevstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8b0bae19-3090-40e7-8462-f1cc82acbbb7 tempest-CreateVolumesFromImageTest-131712280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-46cbc014-5964-4e88-b89d-e9beeac6d110 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:07 devstack sudo[106552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-46cbc014-5964-4e88-b89d-e9beeac6d110 Sep 04 18:10:07 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:07 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:10:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Flow 'volume_create_manager' (2f0bb856-5a24-456c-a5f4-007b88e33822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:10:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1f37f52-5ba2-4ae8-8313-e14e1196266c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:07 devstack sudo[106551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e2b54df6-cb58-4461-b6b8-d59ec72d7067_adehay3odevstack@QuobyteHD Sep 04 18:10:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1f37f52-5ba2-4ae8-8313-e14e1196266c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:10:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48849db3-5906-431b-80ce-3f3554c0e607,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='739b50685e6b4548a4e860ebf7c757b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:10:08Z,use_quota=True,user_id='fc0b0f8ba54047d5ab7d5bdadd2c5319',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e2139da-a0b4-49cb-b37f-c8b9dd5b2dd4),volume_type_id=7e2139da-a0b4-49cb-b37f-c8b9dd5b2dd4)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:07 devstack sudo[106551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (026c4215-c4e4-4ad0-b36f-3705ca6c7d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (026c4215-c4e4-4ad0-b36f-3705ca6c7d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b769c529-e23d-4a7e-b472-ddd486c08b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:07 devstack cinder-volume[87314]: DEBUG cinder.image.glance [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Creating Keystone auth plugin from conf {{(pid=87314) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 04 18:10:07 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8b0bae19-3090-40e7-8462-f1cc82acbbb7 tempest-CreateVolumesFromImageTest-131712280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-46cbc014-5964-4e88-b89d-e9beeac6d110" returned: 0 in 0.280s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:07 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8b0bae19-3090-40e7-8462-f1cc82acbbb7 tempest-CreateVolumesFromImageTest-131712280 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:10:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8b0bae19-3090-40e7-8462-f1cc82acbbb7 tempest-CreateVolumesFromImageTest-131712280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0cb680b5-f58d-4f59-a8d3-642c87f5ca1d tempest-CreateVolumesFromImageTest-131712280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.369s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:07 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0cb680b5-f58d-4f59-a8d3-642c87f5ca1d tempest-CreateVolumesFromImageTest-131712280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:10:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1553211448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1e15e86-3f25-4036-ac53-b7aa95ecc2c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4daea33775ac4789beb09961919185cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:10:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:10:04Z,use_quota=True,user_id='c446408afd1e458b971bb03a337d921d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:10:07 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-0cb680b5-f58d-4f59-a8d3-642c87f5ca1d tempest-CreateVolumesFromImageTest-131712280 None] Creating volume d1e15e86-3f25-4036-ac53-b7aa95ecc2c9 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:10:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0cb680b5-f58d-4f59-a8d3-642c87f5ca1d tempest-CreateVolumesFromImageTest-131712280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0cb680b5-f58d-4f59-a8d3-642c87f5ca1d tempest-CreateVolumesFromImageTest-131712280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:07 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0cb680b5-f58d-4f59-a8d3-642c87f5ca1d tempest-CreateVolumesFromImageTest-131712280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:10:07 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0cb680b5-f58d-4f59-a8d3-642c87f5ca1d tempest-CreateVolumesFromImageTest-131712280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:10:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0cb680b5-f58d-4f59-a8d3-642c87f5ca1d tempest-CreateVolumesFromImageTest-131712280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:07 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0cb680b5-f58d-4f59-a8d3-642c87f5ca1d tempest-CreateVolumesFromImageTest-131712280 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:10:07 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-0cb680b5-f58d-4f59-a8d3-642c87f5ca1d tempest-CreateVolumesFromImageTest-131712280 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:10:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0cb680b5-f58d-4f59-a8d3-642c87f5ca1d tempest-CreateVolumesFromImageTest-131712280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d1e15e86-3f25-4036-ac53-b7aa95ecc2c9 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:07 devstack sudo[106558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d1e15e86-3f25-4036-ac53-b7aa95ecc2c9 1073741824 Sep 04 18:10:07 devstack sudo[106558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:07 devstack sudo[106551]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8b0bae19-3090-40e7-8462-f1cc82acbbb7 tempest-CreateVolumesFromImageTest-131712280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (304d7539-15ac-4468-843c-a0aaa385bd6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46cbc014-5964-4e88-b89d-e9beeac6d110', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8b0bae19-3090-40e7-8462-f1cc82acbbb7 tempest-CreateVolumesFromImageTest-131712280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06080670-adb3-47c5-9e0c-c68289abbbd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b769c529-e23d-4a7e-b472-ddd486c08b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '48849db3-5906-431b-80ce-3f3554c0e607', 'volume_name': 'volume-48849db3-5906-431b-80ce-3f3554c0e607', 'volume_size': 1, 'image_id': '900b99d5-d26a-46eb-ae47-97b6fc6314fe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/900b99d5-d26a-46eb-ae47-97b6fc6314fe', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ca7e0d3171b4d5d92b45319f14e14f0c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '739b50685e6b4548a4e860ebf7c757b0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '65d9c922cbb77346e90d9f950746fcc09668cea6f8f058daef897e4f6ecd23fbecdd2e4108155d34112fcf0fb15d60eabd2ae9d572e772ff985057a0976e7839', 'id': '900b99d5-d26a-46eb-ae47-97b6fc6314fe', 'created_at': datetime.datetime(2026, 9, 4, 16, 10, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 16, 10, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/900b99d5-d26a-46eb-ae47-97b6fc6314fe/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fda4772f-1d16-48b2-b859-a0fcfec7a649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fda4772f-1d16-48b2-b859-a0fcfec7a649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a575c7f-2454-4db6-87ae-680e6d661a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:07 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Volume 48849db3-5906-431b-80ce-3f3554c0e607: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-48849db3-5906-431b-80ce-3f3554c0e607', 'volume_size': 1, 'image_id': '900b99d5-d26a-46eb-ae47-97b6fc6314fe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/900b99d5-d26a-46eb-ae47-97b6fc6314fe', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ca7e0d3171b4d5d92b45319f14e14f0c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '739b50685e6b4548a4e860ebf7c757b0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '65d9c922cbb77346e90d9f950746fcc09668cea6f8f058daef897e4f6ecd23fbecdd2e4108155d34112fcf0fb15d60eabd2ae9d572e772ff985057a0976e7839', 'id': '900b99d5-d26a-46eb-ae47-97b6fc6314fe', 'created_at': datetime.datetime(2026, 9, 4, 16, 10, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 16, 10, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/900b99d5-d26a-46eb-ae47-97b6fc6314fe/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 04 18:10:07 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Trying to clone 48849db3-5906-431b-80ce-3f3554c0e607 from image 900b99d5-d26a-46eb-ae47-97b6fc6314fe at location (None, [{'url': 'file:///opt/stack/data/glance/images/900b99d5-d26a-46eb-ae47-97b6fc6314fe', 'metadata': {}}]). {{(pid=87314) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 04 18:10:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e2b54df6-cb58-4461-b6b8-d59ec72d7067_adehay3odevstack@QuobyteHD" returned: 0 in 0.414s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e2b54df6-cb58-4461-b6b8-d59ec72d7067_adehay3odevstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:07 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-8b0bae19-3090-40e7-8462-f1cc82acbbb7 tempest-CreateVolumesFromImageTest-131712280 None] Volume volume-46cbc014-5964-4e88-b89d-e9beeac6d110 (46cbc014-5964-4e88-b89d-e9beeac6d110): created successfully Sep 04 18:10:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8b0bae19-3090-40e7-8462-f1cc82acbbb7 tempest-CreateVolumesFromImageTest-131712280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06080670-adb3-47c5-9e0c-c68289abbbd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-8b0bae19-3090-40e7-8462-f1cc82acbbb7 tempest-CreateVolumesFromImageTest-131712280 None] Flow 'volume_create_manager' (41ccb162-219a-4656-9cea-c4a4e59c36e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:10:07 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-8b0bae19-3090-40e7-8462-f1cc82acbbb7 tempest-CreateVolumesFromImageTest-131712280 None] Created volume successfully. Sep 04 18:10:08 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_900b99d5-d26a-46eb-ae47-97b6fc6314fe_0hl73dlqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87314) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 04 18:10:08 devstack cinder-volume[87314]: INFO cinder.image.image_utils [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Image download 0.00 MB at 0.00 MB/s Sep 04 18:10:08 devstack sudo[106560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e2b54df6-cb58-4461-b6b8-d59ec72d7067_adehay3odevstack@QuobyteHD Sep 04 18:10:08 devstack sudo[106560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:08 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ffcd8a-6000-449e-973f-6ce8193a56e6]: (4, 'raw') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:10:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_900b99d5-d26a-46eb-ae47-97b6fc6314fe_0hl73dlqdevstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:08 devstack sudo[106565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_900b99d5-d26a-46eb-ae47-97b6fc6314fe_0hl73dlqdevstack@QuobyteHD Sep 04 18:10:08 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:08 devstack sudo[106560]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e2b54df6-cb58-4461-b6b8-d59ec72d7067_adehay3odevstack@QuobyteHD" returned: 1 in 0.383s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e2b54df6-cb58-4461-b6b8-d59ec72d7067_adehay3odevstack@QuobyteHD' failed. Not Retrying. {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 18:10:08 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] Temporary image e2b54df6-cb58-4461-b6b8-d59ec72d7067 is fetched for user deb2fa541e5442ee8d3e096021c03251. {{(pid=87314) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 04 18:10:08 devstack sudo[106558]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0cb680b5-f58d-4f59-a8d3-642c87f5ca1d tempest-CreateVolumesFromImageTest-131712280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d1e15e86-3f25-4036-ac53-b7aa95ecc2c9 1073741824" returned: 0 in 0.469s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0cb680b5-f58d-4f59-a8d3-642c87f5ca1d tempest-CreateVolumesFromImageTest-131712280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d1e15e86-3f25-4036-ac53-b7aa95ecc2c9 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:08 devstack sudo[106570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d1e15e86-3f25-4036-ac53-b7aa95ecc2c9 Sep 04 18:10:08 devstack sudo[106570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:08 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[24764688-b383-48ea-833c-31f3522c6e92]: (4, 'raw') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:10:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e2b54df6-cb58-4461-b6b8-d59ec72d7067_adehay3odevstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:08 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_900b99d5-d26a-46eb-ae47-97b6fc6314fe_0hl73dlqdevstack@QuobyteHD" returned: 0 in 0.418s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_900b99d5-d26a-46eb-ae47-97b6fc6314fe_0hl73dlqdevstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:08 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e2b54df6-cb58-4461-b6b8-d59ec72d7067_adehay3odevstack@QuobyteHD Sep 04 18:10:08 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:08 devstack sudo[106570]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:08 devstack sudo[106575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_900b99d5-d26a-46eb-ae47-97b6fc6314fe_0hl73dlqdevstack@QuobyteHD Sep 04 18:10:08 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0cb680b5-f58d-4f59-a8d3-642c87f5ca1d tempest-CreateVolumesFromImageTest-131712280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d1e15e86-3f25-4036-ac53-b7aa95ecc2c9" returned: 0 in 0.297s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0cb680b5-f58d-4f59-a8d3-642c87f5ca1d tempest-CreateVolumesFromImageTest-131712280 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:10:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0cb680b5-f58d-4f59-a8d3-642c87f5ca1d tempest-CreateVolumesFromImageTest-131712280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ea798151-1b35-4491-8651-4090ba04fb68 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.507s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ea798151-1b35-4491-8651-4090ba04fb68 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:10:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2035474244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3ed2c2f-32b8-430d-93da-8377dc4415f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0be16266f0164d518c63d9215ed86bed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:10:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:10:05Z,use_quota=True,user_id='250cc4a672bd4b098c98a6de1b292cdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:10:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-ea798151-1b35-4491-8651-4090ba04fb68 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Creating volume b3ed2c2f-32b8-430d-93da-8377dc4415f1 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:10:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ea798151-1b35-4491-8651-4090ba04fb68 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ea798151-1b35-4491-8651-4090ba04fb68 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ea798151-1b35-4491-8651-4090ba04fb68 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:10:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ea798151-1b35-4491-8651-4090ba04fb68 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:10:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ea798151-1b35-4491-8651-4090ba04fb68 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ea798151-1b35-4491-8651-4090ba04fb68 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:10:08 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-ea798151-1b35-4491-8651-4090ba04fb68 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:10:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ea798151-1b35-4491-8651-4090ba04fb68 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b3ed2c2f-32b8-430d-93da-8377dc4415f1 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:08 devstack sudo[106579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b3ed2c2f-32b8-430d-93da-8377dc4415f1 1073741824 Sep 04 18:10:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0cb680b5-f58d-4f59-a8d3-642c87f5ca1d tempest-CreateVolumesFromImageTest-131712280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30453d08-c00e-4327-bf42-d44632aaae7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1e15e86-3f25-4036-ac53-b7aa95ecc2c9', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:08 devstack sudo[106579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0cb680b5-f58d-4f59-a8d3-642c87f5ca1d tempest-CreateVolumesFromImageTest-131712280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28bae9f7-4d23-4bc9-8d64-58194db455c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:08 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-0cb680b5-f58d-4f59-a8d3-642c87f5ca1d tempest-CreateVolumesFromImageTest-131712280 None] Volume volume-d1e15e86-3f25-4036-ac53-b7aa95ecc2c9 (d1e15e86-3f25-4036-ac53-b7aa95ecc2c9): created successfully Sep 04 18:10:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0cb680b5-f58d-4f59-a8d3-642c87f5ca1d tempest-CreateVolumesFromImageTest-131712280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28bae9f7-4d23-4bc9-8d64-58194db455c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0cb680b5-f58d-4f59-a8d3-642c87f5ca1d tempest-CreateVolumesFromImageTest-131712280 None] Flow 'volume_create_manager' (6f46f4ca-5f95-4322-b336-4fb2fb9ea39e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:10:08 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-0cb680b5-f58d-4f59-a8d3-642c87f5ca1d tempest-CreateVolumesFromImageTest-131712280 None] Created volume successfully. Sep 04 18:10:08 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e2b54df6-cb58-4461-b6b8-d59ec72d7067_adehay3odevstack@QuobyteHD" returned: 0 in 0.371s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e2b54df6-cb58-4461-b6b8-d59ec72d7067_adehay3odevstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:08 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_900b99d5-d26a-46eb-ae47-97b6fc6314fe_0hl73dlqdevstack@QuobyteHD" returned: 1 in 0.362s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_900b99d5-d26a-46eb-ae47-97b6fc6314fe_0hl73dlqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 18:10:08 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Temporary image 900b99d5-d26a-46eb-ae47-97b6fc6314fe is fetched for user fc0b0f8ba54047d5ab7d5bdadd2c5319. {{(pid=87314) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 04 18:10:08 devstack sudo[106583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e2b54df6-cb58-4461-b6b8-d59ec72d7067_adehay3odevstack@QuobyteHD Sep 04 18:10:08 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:08 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[e340f2fe-73a3-4a91-8c80-5ce3f80eccc0]: (4, 'raw') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:10:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_900b99d5-d26a-46eb-ae47-97b6fc6314fe_0hl73dlqdevstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:09 devstack sudo[106591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_900b99d5-d26a-46eb-ae47-97b6fc6314fe_0hl73dlqdevstack@QuobyteHD Sep 04 18:10:09 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:09 devstack sudo[106579]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ea798151-1b35-4491-8651-4090ba04fb68 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b3ed2c2f-32b8-430d-93da-8377dc4415f1 1073741824" returned: 0 in 0.482s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:09 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e2b54df6-cb58-4461-b6b8-d59ec72d7067_adehay3odevstack@QuobyteHD" returned: 1 in 0.364s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e2b54df6-cb58-4461-b6b8-d59ec72d7067_adehay3odevstack@QuobyteHD' failed. Not Retrying. {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 18:10:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ea798151-1b35-4491-8651-4090ba04fb68 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b3ed2c2f-32b8-430d-93da-8377dc4415f1 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:09 devstack sudo[106597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b3ed2c2f-32b8-430d-93da-8377dc4415f1 Sep 04 18:10:09 devstack sudo[106597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:09 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_900b99d5-d26a-46eb-ae47-97b6fc6314fe_0hl73dlqdevstack@QuobyteHD" returned: 0 in 0.354s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_900b99d5-d26a-46eb-ae47-97b6fc6314fe_0hl73dlqdevstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:09 devstack sudo[106597]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ea798151-1b35-4491-8651-4090ba04fb68 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b3ed2c2f-32b8-430d-93da-8377dc4415f1" returned: 0 in 0.233s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:09 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ea798151-1b35-4491-8651-4090ba04fb68 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:10:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ea798151-1b35-4491-8651-4090ba04fb68 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-aabbe70e-fa9d-40d0-b6b7-195d72ce36f0 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.771s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:09 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-aabbe70e-fa9d-40d0-b6b7-195d72ce36f0 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:10:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1109227953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65129330-fe9b-45bc-a6a5-eacc20b77c22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0be16266f0164d518c63d9215ed86bed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:10:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:10:05Z,use_quota=True,user_id='250cc4a672bd4b098c98a6de1b292cdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:10:09 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-aabbe70e-fa9d-40d0-b6b7-195d72ce36f0 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Creating volume 65129330-fe9b-45bc-a6a5-eacc20b77c22 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:10:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-aabbe70e-fa9d-40d0-b6b7-195d72ce36f0 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-aabbe70e-fa9d-40d0-b6b7-195d72ce36f0 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:09 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-aabbe70e-fa9d-40d0-b6b7-195d72ce36f0 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:10:09 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-aabbe70e-fa9d-40d0-b6b7-195d72ce36f0 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:10:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-aabbe70e-fa9d-40d0-b6b7-195d72ce36f0 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:09 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-aabbe70e-fa9d-40d0-b6b7-195d72ce36f0 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:10:09 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-aabbe70e-fa9d-40d0-b6b7-195d72ce36f0 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:10:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-aabbe70e-fa9d-40d0-b6b7-195d72ce36f0 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-65129330-fe9b-45bc-a6a5-eacc20b77c22 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:09 devstack sudo[106601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_900b99d5-d26a-46eb-ae47-97b6fc6314fe_0hl73dlqdevstack@QuobyteHD Sep 04 18:10:09 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ea798151-1b35-4491-8651-4090ba04fb68 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4550b488-e36e-4d5b-b0a0-e10b9c154902) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3ed2c2f-32b8-430d-93da-8377dc4415f1', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ea798151-1b35-4491-8651-4090ba04fb68 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcd5b993-1d39-4c36-bee6-1d7020e08602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:09 devstack sudo[106603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-65129330-fe9b-45bc-a6a5-eacc20b77c22 1073741824 Sep 04 18:10:09 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:09 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-ea798151-1b35-4491-8651-4090ba04fb68 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Volume volume-b3ed2c2f-32b8-430d-93da-8377dc4415f1 (b3ed2c2f-32b8-430d-93da-8377dc4415f1): created successfully Sep 04 18:10:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ea798151-1b35-4491-8651-4090ba04fb68 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcd5b993-1d39-4c36-bee6-1d7020e08602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ea798151-1b35-4491-8651-4090ba04fb68 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Flow 'volume_create_manager' (aa00482a-a174-445f-b3c6-e7a668ed1d3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:10:09 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-ea798151-1b35-4491-8651-4090ba04fb68 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Created volume successfully. Sep 04 18:10:09 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-67d8d341-c263-47b4-8090-25c803d2b4fc tempest-CreateVolumesFromImageTest-131712280 None] Acquiring lock "cinder-d1e15e86-3f25-4036-ac53-b7aa95ecc2c9-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:10:09 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:09 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-67d8d341-c263-47b4-8090-25c803d2b4fc tempest-CreateVolumesFromImageTest-131712280 None] Lock "cinder-d1e15e86-3f25-4036-ac53-b7aa95ecc2c9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:10:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_900b99d5-d26a-46eb-ae47-97b6fc6314fe_0hl73dlqdevstack@QuobyteHD" returned: 1 in 0.370s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_900b99d5-d26a-46eb-ae47-97b6fc6314fe_0hl73dlqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 18:10:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:09 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-67d8d341-c263-47b4-8090-25c803d2b4fc tempest-CreateVolumesFromImageTest-131712280 None] Acquiring lock "cinder-quobyte-d1e15e86-3f25-4036-ac53-b7aa95ecc2c9" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:10:09 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-67d8d341-c263-47b4-8090-25c803d2b4fc tempest-CreateVolumesFromImageTest-131712280 None] Lock "cinder-quobyte-d1e15e86-3f25-4036-ac53-b7aa95ecc2c9" acquired by "delete_volume" :: waited 0.018s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:10:09 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac605d27-b99b-4610-9a57-6368640876ed]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:10:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-67d8d341-c263-47b4-8090-25c803d2b4fc tempest-CreateVolumesFromImageTest-131712280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d1e15e86-3f25-4036-ac53-b7aa95ecc2c9 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:09 devstack sudo[106612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d1e15e86-3f25-4036-ac53-b7aa95ecc2c9 Sep 04 18:10:09 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:09 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-aabbe70e-fa9d-40d0-b6b7-195d72ce36f0 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-65129330-fe9b-45bc-a6a5-eacc20b77c22 1073741824" returned: 0 in 0.493s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-aabbe70e-fa9d-40d0-b6b7-195d72ce36f0 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-65129330-fe9b-45bc-a6a5-eacc20b77c22 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:09 devstack sudo[106614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-65129330-fe9b-45bc-a6a5-eacc20b77c22 Sep 04 18:10:09 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:10 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-67d8d341-c263-47b4-8090-25c803d2b4fc tempest-CreateVolumesFromImageTest-131712280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d1e15e86-3f25-4036-ac53-b7aa95ecc2c9" returned: 0 in 0.380s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-67d8d341-c263-47b4-8090-25c803d2b4fc tempest-CreateVolumesFromImageTest-131712280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d1e15e86-3f25-4036-ac53-b7aa95ecc2c9 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:10 devstack sudo[106619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d1e15e86-3f25-4036-ac53-b7aa95ecc2c9 Sep 04 18:10:10 devstack sudo[106619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:10 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-aabbe70e-fa9d-40d0-b6b7-195d72ce36f0 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-65129330-fe9b-45bc-a6a5-eacc20b77c22" returned: 0 in 0.270s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:10 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-aabbe70e-fa9d-40d0-b6b7-195d72ce36f0 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:10:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-aabbe70e-fa9d-40d0-b6b7-195d72ce36f0 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ecab358f-e3b3-4a2f-b153-2f9d8525bf74 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.849s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:10 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ecab358f-e3b3-4a2f-b153-2f9d8525bf74 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:10:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1447313050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14e5ff0f-7ee2-49fe-ad95-569097647355,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0be16266f0164d518c63d9215ed86bed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:10:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:10:06Z,use_quota=True,user_id='250cc4a672bd4b098c98a6de1b292cdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:10:10 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-ecab358f-e3b3-4a2f-b153-2f9d8525bf74 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Creating volume 14e5ff0f-7ee2-49fe-ad95-569097647355 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:10:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ecab358f-e3b3-4a2f-b153-2f9d8525bf74 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ecab358f-e3b3-4a2f-b153-2f9d8525bf74 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:10 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ecab358f-e3b3-4a2f-b153-2f9d8525bf74 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:10:10 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ecab358f-e3b3-4a2f-b153-2f9d8525bf74 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:10:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ecab358f-e3b3-4a2f-b153-2f9d8525bf74 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:10 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ecab358f-e3b3-4a2f-b153-2f9d8525bf74 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:10:10 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-ecab358f-e3b3-4a2f-b153-2f9d8525bf74 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:10:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ecab358f-e3b3-4a2f-b153-2f9d8525bf74 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-14e5ff0f-7ee2-49fe-ad95-569097647355 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:10 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aabbe70e-fa9d-40d0-b6b7-195d72ce36f0 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc262a45-ce83-4d6a-8c7c-578d794e11f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65129330-fe9b-45bc-a6a5-eacc20b77c22', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:10 devstack sudo[106622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-14e5ff0f-7ee2-49fe-ad95-569097647355 1073741824 Sep 04 18:10:10 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:10 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aabbe70e-fa9d-40d0-b6b7-195d72ce36f0 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7746acea-946f-4f02-808b-0da0124e6e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:10 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-aabbe70e-fa9d-40d0-b6b7-195d72ce36f0 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Volume volume-65129330-fe9b-45bc-a6a5-eacc20b77c22 (65129330-fe9b-45bc-a6a5-eacc20b77c22): created successfully Sep 04 18:10:10 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aabbe70e-fa9d-40d0-b6b7-195d72ce36f0 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7746acea-946f-4f02-808b-0da0124e6e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:10 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aabbe70e-fa9d-40d0-b6b7-195d72ce36f0 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Flow 'volume_create_manager' (a58d104e-324c-4252-99f5-6ec563521261) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:10:10 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-aabbe70e-fa9d-40d0-b6b7-195d72ce36f0 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Created volume successfully. Sep 04 18:10:10 devstack sudo[106619]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-67d8d341-c263-47b4-8090-25c803d2b4fc tempest-CreateVolumesFromImageTest-131712280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d1e15e86-3f25-4036-ac53-b7aa95ecc2c9" returned: 0 in 0.257s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:10 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-67d8d341-c263-47b4-8090-25c803d2b4fc tempest-CreateVolumesFromImageTest-131712280 None] Lock "cinder-quobyte-d1e15e86-3f25-4036-ac53-b7aa95ecc2c9" released by "delete_volume" :: held 0.673s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:10:10 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-67d8d341-c263-47b4-8090-25c803d2b4fc tempest-CreateVolumesFromImageTest-131712280 None] Created reservations ['3acf992a-5a59-4af9-a06e-6ad3e1bd9e0e', '69f65d76-b652-4a30-8d8c-c5b2003bb699', 'c29b8dcd-998c-4608-95ab-a2fd3b31ed39', 'ad8c47d8-8f0e-49ab-bffc-03a7d83a7ebd'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:10:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-67d8d341-c263-47b4-8090-25c803d2b4fc tempest-CreateVolumesFromImageTest-131712280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-67d8d341-c263-47b4-8090-25c803d2b4fc tempest-CreateVolumesFromImageTest-131712280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:10 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-67d8d341-c263-47b4-8090-25c803d2b4fc tempest-CreateVolumesFromImageTest-131712280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:10:10 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-67d8d341-c263-47b4-8090-25c803d2b4fc tempest-CreateVolumesFromImageTest-131712280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:10:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-67d8d341-c263-47b4-8090-25c803d2b4fc tempest-CreateVolumesFromImageTest-131712280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-67d8d341-c263-47b4-8090-25c803d2b4fc tempest-CreateVolumesFromImageTest-131712280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:10 devstack sudo[106628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:10:10 devstack sudo[106628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:10 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ecab358f-e3b3-4a2f-b153-2f9d8525bf74 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-14e5ff0f-7ee2-49fe-ad95-569097647355 1073741824" returned: 0 in 0.485s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ecab358f-e3b3-4a2f-b153-2f9d8525bf74 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-14e5ff0f-7ee2-49fe-ad95-569097647355 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:10 devstack sudo[106631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-14e5ff0f-7ee2-49fe-ad95-569097647355 Sep 04 18:10:10 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:10 devstack sudo[106628]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-67d8d341-c263-47b4-8090-25c803d2b4fc tempest-CreateVolumesFromImageTest-131712280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.263s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:10 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-67d8d341-c263-47b4-8090-25c803d2b4fc tempest-CreateVolumesFromImageTest-131712280 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:10:10 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-67d8d341-c263-47b4-8090-25c803d2b4fc tempest-CreateVolumesFromImageTest-131712280 None] Deleted volume successfully. Sep 04 18:10:10 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-67d8d341-c263-47b4-8090-25c803d2b4fc tempest-CreateVolumesFromImageTest-131712280 None] Lock "cinder-d1e15e86-3f25-4036-ac53-b7aa95ecc2c9-delete_volume" released by "delete_volume" :: held 1.158s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:10:10 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-de88b2e6-019e-4c7b-ad11-44bbbb39ecb0 tempest-CreateVolumesFromImageTest-131712280 None] Acquiring lock "cinder-46cbc014-5964-4e88-b89d-e9beeac6d110-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:10:10 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-de88b2e6-019e-4c7b-ad11-44bbbb39ecb0 tempest-CreateVolumesFromImageTest-131712280 None] Lock "cinder-46cbc014-5964-4e88-b89d-e9beeac6d110-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:10:10 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-de88b2e6-019e-4c7b-ad11-44bbbb39ecb0 tempest-CreateVolumesFromImageTest-131712280 None] Acquiring lock "cinder-quobyte-46cbc014-5964-4e88-b89d-e9beeac6d110" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:10:10 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-de88b2e6-019e-4c7b-ad11-44bbbb39ecb0 tempest-CreateVolumesFromImageTest-131712280 None] Lock "cinder-quobyte-46cbc014-5964-4e88-b89d-e9beeac6d110" acquired by "delete_volume" :: waited 0.025s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:10:10 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2689d4-e54f-455c-a2be-1ed4bb2c3adc]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:10:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-de88b2e6-019e-4c7b-ad11-44bbbb39ecb0 tempest-CreateVolumesFromImageTest-131712280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-46cbc014-5964-4e88-b89d-e9beeac6d110 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:11 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ecab358f-e3b3-4a2f-b153-2f9d8525bf74 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-14e5ff0f-7ee2-49fe-ad95-569097647355" returned: 0 in 0.306s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ecab358f-e3b3-4a2f-b153-2f9d8525bf74 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:10:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ecab358f-e3b3-4a2f-b153-2f9d8525bf74 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f5e6ee18-556b-4b6b-ad8b-6a3235982efa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.094s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f5e6ee18-556b-4b6b-ad8b-6a3235982efa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:10:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-577050535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c14b02b8-ca04-40ef-99dd-634955d5665d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0be16266f0164d518c63d9215ed86bed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:10:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:10:07Z,use_quota=True,user_id='250cc4a672bd4b098c98a6de1b292cdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:10:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-f5e6ee18-556b-4b6b-ad8b-6a3235982efa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Creating volume c14b02b8-ca04-40ef-99dd-634955d5665d {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:10:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f5e6ee18-556b-4b6b-ad8b-6a3235982efa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f5e6ee18-556b-4b6b-ad8b-6a3235982efa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f5e6ee18-556b-4b6b-ad8b-6a3235982efa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:10:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f5e6ee18-556b-4b6b-ad8b-6a3235982efa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:10:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f5e6ee18-556b-4b6b-ad8b-6a3235982efa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f5e6ee18-556b-4b6b-ad8b-6a3235982efa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:10:11 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-f5e6ee18-556b-4b6b-ad8b-6a3235982efa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:10:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f5e6ee18-556b-4b6b-ad8b-6a3235982efa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c14b02b8-ca04-40ef-99dd-634955d5665d 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ecab358f-e3b3-4a2f-b153-2f9d8525bf74 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d558ce7-d881-45fb-860f-23f54fa87d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14e5ff0f-7ee2-49fe-ad95-569097647355', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:11 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c14b02b8-ca04-40ef-99dd-634955d5665d 1073741824 Sep 04 18:10:11 devstack sudo[106633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-46cbc014-5964-4e88-b89d-e9beeac6d110 Sep 04 18:10:11 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ecab358f-e3b3-4a2f-b153-2f9d8525bf74 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09d86693-fc88-4b39-abc2-d68d5b038b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:11 devstack sudo[106633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:11 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-ecab358f-e3b3-4a2f-b153-2f9d8525bf74 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Volume volume-14e5ff0f-7ee2-49fe-ad95-569097647355 (14e5ff0f-7ee2-49fe-ad95-569097647355): created successfully Sep 04 18:10:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ecab358f-e3b3-4a2f-b153-2f9d8525bf74 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09d86693-fc88-4b39-abc2-d68d5b038b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ecab358f-e3b3-4a2f-b153-2f9d8525bf74 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Flow 'volume_create_manager' (749775a6-f1ff-40b5-abcc-1c7b279f1dd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:10:11 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-ecab358f-e3b3-4a2f-b153-2f9d8525bf74 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Created volume successfully. Sep 04 18:10:11 devstack sudo[106633]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-de88b2e6-019e-4c7b-ad11-44bbbb39ecb0 tempest-CreateVolumesFromImageTest-131712280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-46cbc014-5964-4e88-b89d-e9beeac6d110" returned: 0 in 0.406s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-de88b2e6-019e-4c7b-ad11-44bbbb39ecb0 tempest-CreateVolumesFromImageTest-131712280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-46cbc014-5964-4e88-b89d-e9beeac6d110 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:11 devstack sudo[106644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-46cbc014-5964-4e88-b89d-e9beeac6d110 Sep 04 18:10:11 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:11 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f5e6ee18-556b-4b6b-ad8b-6a3235982efa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c14b02b8-ca04-40ef-99dd-634955d5665d 1073741824" returned: 0 in 0.467s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f5e6ee18-556b-4b6b-ad8b-6a3235982efa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c14b02b8-ca04-40ef-99dd-634955d5665d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:11 devstack sudo[106647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c14b02b8-ca04-40ef-99dd-634955d5665d Sep 04 18:10:11 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:11 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-de88b2e6-019e-4c7b-ad11-44bbbb39ecb0 tempest-CreateVolumesFromImageTest-131712280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-46cbc014-5964-4e88-b89d-e9beeac6d110" returned: 0 in 0.284s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:11 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-de88b2e6-019e-4c7b-ad11-44bbbb39ecb0 tempest-CreateVolumesFromImageTest-131712280 None] Lock "cinder-quobyte-46cbc014-5964-4e88-b89d-e9beeac6d110" released by "delete_volume" :: held 0.741s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:10:11 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-de88b2e6-019e-4c7b-ad11-44bbbb39ecb0 tempest-CreateVolumesFromImageTest-131712280 None] Created reservations ['72fd1b9c-8112-4483-953d-fa3299d8cd6f', '9e6a1058-edfa-4654-b535-428826e30e0f', '0d955c49-3d18-452d-90af-f2e961a3e8cf', '88c5a174-f32c-43dd-b597-8033370e1158'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:10:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-de88b2e6-019e-4c7b-ad11-44bbbb39ecb0 tempest-CreateVolumesFromImageTest-131712280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-de88b2e6-019e-4c7b-ad11-44bbbb39ecb0 tempest-CreateVolumesFromImageTest-131712280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-de88b2e6-019e-4c7b-ad11-44bbbb39ecb0 tempest-CreateVolumesFromImageTest-131712280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:10:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-de88b2e6-019e-4c7b-ad11-44bbbb39ecb0 tempest-CreateVolumesFromImageTest-131712280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:10:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-de88b2e6-019e-4c7b-ad11-44bbbb39ecb0 tempest-CreateVolumesFromImageTest-131712280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-de88b2e6-019e-4c7b-ad11-44bbbb39ecb0 tempest-CreateVolumesFromImageTest-131712280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:11 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f5e6ee18-556b-4b6b-ad8b-6a3235982efa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c14b02b8-ca04-40ef-99dd-634955d5665d" returned: 0 in 0.266s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:11 devstack sudo[106651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:10:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f5e6ee18-556b-4b6b-ad8b-6a3235982efa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:10:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f5e6ee18-556b-4b6b-ad8b-6a3235982efa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:11 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e708e195-3d95-44c5-b1b8-eeb50e9c73ba tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.674s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e708e195-3d95-44c5-b1b8-eeb50e9c73ba tempest-CreateVolumesFromSourceVolumeTest-211536695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:10:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2045552422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8990194-9a5c-45d3-afec-6b8a38430dfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0be16266f0164d518c63d9215ed86bed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:10:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:10:07Z,use_quota=True,user_id='250cc4a672bd4b098c98a6de1b292cdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:10:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-e708e195-3d95-44c5-b1b8-eeb50e9c73ba tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Creating volume f8990194-9a5c-45d3-afec-6b8a38430dfc {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:10:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e708e195-3d95-44c5-b1b8-eeb50e9c73ba tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e708e195-3d95-44c5-b1b8-eeb50e9c73ba tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e708e195-3d95-44c5-b1b8-eeb50e9c73ba tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:10:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e708e195-3d95-44c5-b1b8-eeb50e9c73ba tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:10:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e708e195-3d95-44c5-b1b8-eeb50e9c73ba tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e708e195-3d95-44c5-b1b8-eeb50e9c73ba tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:10:11 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-e708e195-3d95-44c5-b1b8-eeb50e9c73ba tempest-CreateVolumesFromSourceVolumeTest-211536695 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:10:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e708e195-3d95-44c5-b1b8-eeb50e9c73ba tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f8990194-9a5c-45d3-afec-6b8a38430dfc 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f5e6ee18-556b-4b6b-ad8b-6a3235982efa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a99afb47-5120-4b85-b2fe-454a279a3e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c14b02b8-ca04-40ef-99dd-634955d5665d', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:11 devstack sudo[106653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f8990194-9a5c-45d3-afec-6b8a38430dfc 1073741824 Sep 04 18:10:11 devstack sudo[106653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f5e6ee18-556b-4b6b-ad8b-6a3235982efa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57d4169e-dc74-4be2-a479-bc16e13b8497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:11 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-f5e6ee18-556b-4b6b-ad8b-6a3235982efa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Volume volume-c14b02b8-ca04-40ef-99dd-634955d5665d (c14b02b8-ca04-40ef-99dd-634955d5665d): created successfully Sep 04 18:10:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f5e6ee18-556b-4b6b-ad8b-6a3235982efa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57d4169e-dc74-4be2-a479-bc16e13b8497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:11 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f5e6ee18-556b-4b6b-ad8b-6a3235982efa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Flow 'volume_create_manager' (9a8ba774-d31d-461c-bd3d-9990b1ccb21b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:10:11 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-f5e6ee18-556b-4b6b-ad8b-6a3235982efa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Created volume successfully. Sep 04 18:10:12 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e4020494-3662-4b19-8527-a6bc9cec79d1 tempest-CreateVolumesFromImageTest-131712280 None] Acquiring lock "cinder-0d841cf2-b896-4970-8538-d1ebd9c6617b-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:10:12 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:12 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e4020494-3662-4b19-8527-a6bc9cec79d1 tempest-CreateVolumesFromImageTest-131712280 None] Lock "cinder-0d841cf2-b896-4970-8538-d1ebd9c6617b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:10:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-de88b2e6-019e-4c7b-ad11-44bbbb39ecb0 tempest-CreateVolumesFromImageTest-131712280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.305s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:12 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-de88b2e6-019e-4c7b-ad11-44bbbb39ecb0 tempest-CreateVolumesFromImageTest-131712280 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:10:12 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-de88b2e6-019e-4c7b-ad11-44bbbb39ecb0 tempest-CreateVolumesFromImageTest-131712280 None] Deleted volume successfully. Sep 04 18:10:12 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-de88b2e6-019e-4c7b-ad11-44bbbb39ecb0 tempest-CreateVolumesFromImageTest-131712280 None] Lock "cinder-46cbc014-5964-4e88-b89d-e9beeac6d110-delete_volume" released by "delete_volume" :: held 1.280s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:10:12 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e4020494-3662-4b19-8527-a6bc9cec79d1 tempest-CreateVolumesFromImageTest-131712280 None] Acquiring lock "cinder-quobyte-0d841cf2-b896-4970-8538-d1ebd9c6617b" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:10:12 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e4020494-3662-4b19-8527-a6bc9cec79d1 tempest-CreateVolumesFromImageTest-131712280 None] Lock "cinder-quobyte-0d841cf2-b896-4970-8538-d1ebd9c6617b" acquired by "delete_volume" :: waited 0.021s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:10:12 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a110f8-ec37-4250-8387-b20e5b3520aa]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:10:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e4020494-3662-4b19-8527-a6bc9cec79d1 tempest-CreateVolumesFromImageTest-131712280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0d841cf2-b896-4970-8538-d1ebd9c6617b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:12 devstack sudo[106659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0d841cf2-b896-4970-8538-d1ebd9c6617b Sep 04 18:10:12 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:12 devstack sudo[106653]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e708e195-3d95-44c5-b1b8-eeb50e9c73ba tempest-CreateVolumesFromSourceVolumeTest-211536695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f8990194-9a5c-45d3-afec-6b8a38430dfc 1073741824" returned: 0 in 0.499s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e708e195-3d95-44c5-b1b8-eeb50e9c73ba tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f8990194-9a5c-45d3-afec-6b8a38430dfc {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:12 devstack sudo[106662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f8990194-9a5c-45d3-afec-6b8a38430dfc Sep 04 18:10:12 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:12 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e4020494-3662-4b19-8527-a6bc9cec79d1 tempest-CreateVolumesFromImageTest-131712280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0d841cf2-b896-4970-8538-d1ebd9c6617b" returned: 0 in 0.380s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e4020494-3662-4b19-8527-a6bc9cec79d1 tempest-CreateVolumesFromImageTest-131712280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0d841cf2-b896-4970-8538-d1ebd9c6617b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:12 devstack sudo[106667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0d841cf2-b896-4970-8538-d1ebd9c6617b Sep 04 18:10:12 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:12 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e708e195-3d95-44c5-b1b8-eeb50e9c73ba tempest-CreateVolumesFromSourceVolumeTest-211536695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f8990194-9a5c-45d3-afec-6b8a38430dfc" returned: 0 in 0.263s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:12 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e708e195-3d95-44c5-b1b8-eeb50e9c73ba tempest-CreateVolumesFromSourceVolumeTest-211536695 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:10:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e708e195-3d95-44c5-b1b8-eeb50e9c73ba tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.526s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:12 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:10:06Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ffd19de-20c0-4813-ba4c-b63e1fbae845,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57d28cc49ead47099fe20cf9900b18a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:10:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:10:07Z,use_quota=True,user_id='deb2fa541e5442ee8d3e096021c03251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:10:12 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] Creating volume 9ffd19de-20c0-4813-ba4c-b63e1fbae845 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:10:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:12 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:10:12 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:10:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:12 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:10:12 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:10:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9ffd19de-20c0-4813-ba4c-b63e1fbae845 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e708e195-3d95-44c5-b1b8-eeb50e9c73ba tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc26e018-2163-49ad-a731-f2403b954690) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8990194-9a5c-45d3-afec-6b8a38430dfc', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:12 devstack sudo[106670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9ffd19de-20c0-4813-ba4c-b63e1fbae845 1073741824 Sep 04 18:10:12 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e708e195-3d95-44c5-b1b8-eeb50e9c73ba tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41599da5-c9e4-46a0-9a6b-e2e2acd2378f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:12 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-e708e195-3d95-44c5-b1b8-eeb50e9c73ba tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Volume volume-f8990194-9a5c-45d3-afec-6b8a38430dfc (f8990194-9a5c-45d3-afec-6b8a38430dfc): created successfully Sep 04 18:10:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e708e195-3d95-44c5-b1b8-eeb50e9c73ba tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41599da5-c9e4-46a0-9a6b-e2e2acd2378f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:12 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-e708e195-3d95-44c5-b1b8-eeb50e9c73ba tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Flow 'volume_create_manager' (f96d8ee8-9adb-4d05-ae38-2658c0b36080) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:10:12 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-e708e195-3d95-44c5-b1b8-eeb50e9c73ba tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Created volume successfully. Sep 04 18:10:12 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e4020494-3662-4b19-8527-a6bc9cec79d1 tempest-CreateVolumesFromImageTest-131712280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-0d841cf2-b896-4970-8538-d1ebd9c6617b" returned: 0 in 0.279s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:12 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e4020494-3662-4b19-8527-a6bc9cec79d1 tempest-CreateVolumesFromImageTest-131712280 None] Lock "cinder-quobyte-0d841cf2-b896-4970-8538-d1ebd9c6617b" released by "delete_volume" :: held 0.697s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:10:12 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-e4020494-3662-4b19-8527-a6bc9cec79d1 tempest-CreateVolumesFromImageTest-131712280 None] Created reservations ['478a9609-b7a9-4e52-b443-a77cce3c7f44', 'fd730ddb-5e03-4d41-844f-5283e3c657c9', 'b41dc2ab-c42a-4b04-8920-ff1e036c47ee', 'bd95bbda-ed87-4a3e-bb1f-c445fe261045'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:10:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e4020494-3662-4b19-8527-a6bc9cec79d1 tempest-CreateVolumesFromImageTest-131712280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e4020494-3662-4b19-8527-a6bc9cec79d1 tempest-CreateVolumesFromImageTest-131712280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:13 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e4020494-3662-4b19-8527-a6bc9cec79d1 tempest-CreateVolumesFromImageTest-131712280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:10:13 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e4020494-3662-4b19-8527-a6bc9cec79d1 tempest-CreateVolumesFromImageTest-131712280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:10:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e4020494-3662-4b19-8527-a6bc9cec79d1 tempest-CreateVolumesFromImageTest-131712280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e4020494-3662-4b19-8527-a6bc9cec79d1 tempest-CreateVolumesFromImageTest-131712280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:13 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:10:13 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:13 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9ffd19de-20c0-4813-ba4c-b63e1fbae845 1073741824" returned: 0 in 0.487s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9ffd19de-20c0-4813-ba4c-b63e1fbae845 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:13 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9ffd19de-20c0-4813-ba4c-b63e1fbae845 Sep 04 18:10:13 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:13 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-883fe429-7adb-40da-bf85-522bfad5a840 tempest-CreateVolumesFromImageTest-131712280 None] Acquiring lock "cinder-ec784cf2-65b3-4539-a24f-6d59903c8f64-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:10:13 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:13 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-883fe429-7adb-40da-bf85-522bfad5a840 tempest-CreateVolumesFromImageTest-131712280 None] Lock "cinder-ec784cf2-65b3-4539-a24f-6d59903c8f64-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:10:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e4020494-3662-4b19-8527-a6bc9cec79d1 tempest-CreateVolumesFromImageTest-131712280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.270s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:13 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-e4020494-3662-4b19-8527-a6bc9cec79d1 tempest-CreateVolumesFromImageTest-131712280 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:10:13 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-e4020494-3662-4b19-8527-a6bc9cec79d1 tempest-CreateVolumesFromImageTest-131712280 None] Deleted volume successfully. Sep 04 18:10:13 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-883fe429-7adb-40da-bf85-522bfad5a840 tempest-CreateVolumesFromImageTest-131712280 None] Acquiring lock "cinder-quobyte-ec784cf2-65b3-4539-a24f-6d59903c8f64" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:10:13 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e4020494-3662-4b19-8527-a6bc9cec79d1 tempest-CreateVolumesFromImageTest-131712280 None] Lock "cinder-0d841cf2-b896-4970-8538-d1ebd9c6617b-delete_volume" released by "delete_volume" :: held 1.226s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:10:13 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-883fe429-7adb-40da-bf85-522bfad5a840 tempest-CreateVolumesFromImageTest-131712280 None] Lock "cinder-quobyte-ec784cf2-65b3-4539-a24f-6d59903c8f64" acquired by "delete_volume" :: waited 0.015s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:10:13 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a331ef-c88e-48d7-bcee-74a9ea2a4021]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:10:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-883fe429-7adb-40da-bf85-522bfad5a840 tempest-CreateVolumesFromImageTest-131712280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ec784cf2-65b3-4539-a24f-6d59903c8f64 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:13 devstack sudo[106681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ec784cf2-65b3-4539-a24f-6d59903c8f64 Sep 04 18:10:13 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:13 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9ffd19de-20c0-4813-ba4c-b63e1fbae845" returned: 0 in 0.280s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:13 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:10:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.821s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:13 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:10:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48849db3-5906-431b-80ce-3f3554c0e607,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='739b50685e6b4548a4e860ebf7c757b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:10:08Z,use_quota=True,user_id='fc0b0f8ba54047d5ab7d5bdadd2c5319',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e2139da-a0b4-49cb-b37f-c8b9dd5b2dd4),volume_type_id=7e2139da-a0b4-49cb-b37f-c8b9dd5b2dd4)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:10:13 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Creating volume 48849db3-5906-431b-80ce-3f3554c0e607 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:10:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:13 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:10:13 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:10:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:13 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:10:13 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:10:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-48849db3-5906-431b-80ce-3f3554c0e607 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:13 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-48849db3-5906-431b-80ce-3f3554c0e607 1073741824 Sep 04 18:10:13 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:13 devstack cinder-volume[87314]: DEBUG cinder.volume.volume_utils [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] Attempting download of e2b54df6-cb58-4461-b6b8-d59ec72d7067 ((None, [{'url': 'file:///opt/stack/data/glance/images/e2b54df6-cb58-4461-b6b8-d59ec72d7067', 'metadata': {}}])) to volume 9ffd19de-20c0-4813-ba4c-b63e1fbae845. {{(pid=87314) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 04 18:10:13 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8f283e-5e7f-4ac6-b89e-705996455d77]: (4, 'raw') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:10:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e2b54df6-cb58-4461-b6b8-d59ec72d7067_mo406few {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:13 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7a0ea113-6ee1-4b56-b67e-032d09824819 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Acquiring lock "cinder-f8990194-9a5c-45d3-afec-6b8a38430dfc-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:10:13 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7a0ea113-6ee1-4b56-b67e-032d09824819 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Lock "cinder-f8990194-9a5c-45d3-afec-6b8a38430dfc-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:10:13 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7a0ea113-6ee1-4b56-b67e-032d09824819 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Acquiring lock "cinder-quobyte-f8990194-9a5c-45d3-afec-6b8a38430dfc" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:10:13 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7a0ea113-6ee1-4b56-b67e-032d09824819 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Lock "cinder-quobyte-f8990194-9a5c-45d3-afec-6b8a38430dfc" acquired by "delete_volume" :: waited 0.017s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:10:13 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e2b54df6-cb58-4461-b6b8-d59ec72d7067_mo406few Sep 04 18:10:13 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:13 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d60a83-35bf-486e-85ef-96964457607f]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:10:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7a0ea113-6ee1-4b56-b67e-032d09824819 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f8990194-9a5c-45d3-afec-6b8a38430dfc {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:13 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-883fe429-7adb-40da-bf85-522bfad5a840 tempest-CreateVolumesFromImageTest-131712280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ec784cf2-65b3-4539-a24f-6d59903c8f64" returned: 0 in 0.444s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-883fe429-7adb-40da-bf85-522bfad5a840 tempest-CreateVolumesFromImageTest-131712280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ec784cf2-65b3-4539-a24f-6d59903c8f64 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:13 devstack sudo[106695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ec784cf2-65b3-4539-a24f-6d59903c8f64 Sep 04 18:10:13 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:13 devstack sudo[106694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f8990194-9a5c-45d3-afec-6b8a38430dfc Sep 04 18:10:13 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:14 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e2b54df6-cb58-4461-b6b8-d59ec72d7067_mo406few" returned: 0 in 0.456s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e2b54df6-cb58-4461-b6b8-d59ec72d7067_mo406few {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:14 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-48849db3-5906-431b-80ce-3f3554c0e607 1073741824" returned: 0 in 0.577s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-48849db3-5906-431b-80ce-3f3554c0e607 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:14 devstack sudo[106705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-48849db3-5906-431b-80ce-3f3554c0e607 Sep 04 18:10:14 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:14 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-883fe429-7adb-40da-bf85-522bfad5a840 tempest-CreateVolumesFromImageTest-131712280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-ec784cf2-65b3-4539-a24f-6d59903c8f64" returned: 0 in 0.346s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:14 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-883fe429-7adb-40da-bf85-522bfad5a840 tempest-CreateVolumesFromImageTest-131712280 None] Lock "cinder-quobyte-ec784cf2-65b3-4539-a24f-6d59903c8f64" released by "delete_volume" :: held 0.832s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:10:14 devstack sudo[106701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e2b54df6-cb58-4461-b6b8-d59ec72d7067_mo406few Sep 04 18:10:14 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:14 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7a0ea113-6ee1-4b56-b67e-032d09824819 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f8990194-9a5c-45d3-afec-6b8a38430dfc" returned: 0 in 0.442s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7a0ea113-6ee1-4b56-b67e-032d09824819 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f8990194-9a5c-45d3-afec-6b8a38430dfc {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:14 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-883fe429-7adb-40da-bf85-522bfad5a840 tempest-CreateVolumesFromImageTest-131712280 None] Created reservations ['4ad262d1-de04-4a55-9876-199acfac7bb9', 'cb3b6a1e-5672-4656-a094-e4a0331dedfd', 'f4424b1c-ba9b-4b48-8a85-f7784aa9f1ec', '867c0b06-fac2-4e49-aeb4-0ab9504205fa'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:10:14 devstack sudo[106709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f8990194-9a5c-45d3-afec-6b8a38430dfc Sep 04 18:10:14 devstack sudo[106709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-883fe429-7adb-40da-bf85-522bfad5a840 tempest-CreateVolumesFromImageTest-131712280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-883fe429-7adb-40da-bf85-522bfad5a840 tempest-CreateVolumesFromImageTest-131712280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:14 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-883fe429-7adb-40da-bf85-522bfad5a840 tempest-CreateVolumesFromImageTest-131712280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:10:14 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-883fe429-7adb-40da-bf85-522bfad5a840 tempest-CreateVolumesFromImageTest-131712280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:10:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-883fe429-7adb-40da-bf85-522bfad5a840 tempest-CreateVolumesFromImageTest-131712280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-883fe429-7adb-40da-bf85-522bfad5a840 tempest-CreateVolumesFromImageTest-131712280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:14 devstack sudo[106711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:10:14 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:14 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-48849db3-5906-431b-80ce-3f3554c0e607" returned: 0 in 0.320s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:14 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:10:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:14 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e2b54df6-cb58-4461-b6b8-d59ec72d7067_mo406few" returned: 1 in 0.405s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e2b54df6-cb58-4461-b6b8-d59ec72d7067_mo406few' failed. Not Retrying. {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 18:10:14 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[28694479-56bf-426d-8c68-706fa46e09ee]: (4, 'raw') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:10:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e2b54df6-cb58-4461-b6b8-d59ec72d7067_adehay3odevstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:14 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a56411f1-5057-4120-951e-d505cd261bb4 tempest-CreateVolumesFromImageTest-131712280 None] Acquiring lock "cinder-3436742b-ea0f-4b61-bc64-c0f3e966be88-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:10:14 devstack cinder-volume[87314]: DEBUG cinder.volume.volume_utils [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Attempting download of 900b99d5-d26a-46eb-ae47-97b6fc6314fe ((None, [{'url': 'file:///opt/stack/data/glance/images/900b99d5-d26a-46eb-ae47-97b6fc6314fe', 'metadata': {}}])) to volume 48849db3-5906-431b-80ce-3f3554c0e607. {{(pid=87314) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 04 18:10:14 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a56411f1-5057-4120-951e-d505cd261bb4 tempest-CreateVolumesFromImageTest-131712280 None] Lock "cinder-3436742b-ea0f-4b61-bc64-c0f3e966be88-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:10:14 devstack sudo[106709]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:14 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f44f870-a60e-4459-89b7-f06bbde85163]: (4, 'raw') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:10:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_900b99d5-d26a-46eb-ae47-97b6fc6314fe_w2qlcd9q {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7a0ea113-6ee1-4b56-b67e-032d09824819 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f8990194-9a5c-45d3-afec-6b8a38430dfc" returned: 0 in 0.374s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:14 devstack sudo[106716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e2b54df6-cb58-4461-b6b8-d59ec72d7067_adehay3odevstack@QuobyteHD Sep 04 18:10:14 devstack sudo[106716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:14 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7a0ea113-6ee1-4b56-b67e-032d09824819 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Lock "cinder-quobyte-f8990194-9a5c-45d3-afec-6b8a38430dfc" released by "delete_volume" :: held 0.879s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:10:14 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a56411f1-5057-4120-951e-d505cd261bb4 tempest-CreateVolumesFromImageTest-131712280 None] Acquiring lock "cinder-quobyte-3436742b-ea0f-4b61-bc64-c0f3e966be88" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:10:14 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a56411f1-5057-4120-951e-d505cd261bb4 tempest-CreateVolumesFromImageTest-131712280 None] Lock "cinder-quobyte-3436742b-ea0f-4b61-bc64-c0f3e966be88" acquired by "delete_volume" :: waited 0.021s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:10:14 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b33b475-2231-404e-aacf-2fa44264b0de]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:10:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a56411f1-5057-4120-951e-d505cd261bb4 tempest-CreateVolumesFromImageTest-131712280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3436742b-ea0f-4b61-bc64-c0f3e966be88 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:14 devstack sudo[106718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_900b99d5-d26a-46eb-ae47-97b6fc6314fe_w2qlcd9q Sep 04 18:10:14 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:14 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-883fe429-7adb-40da-bf85-522bfad5a840 tempest-CreateVolumesFromImageTest-131712280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.391s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:14 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-883fe429-7adb-40da-bf85-522bfad5a840 tempest-CreateVolumesFromImageTest-131712280 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:10:14 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-883fe429-7adb-40da-bf85-522bfad5a840 tempest-CreateVolumesFromImageTest-131712280 None] Deleted volume successfully. Sep 04 18:10:14 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-7a0ea113-6ee1-4b56-b67e-032d09824819 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Created reservations ['096f4a9c-1d14-4e1d-a9d7-0f8fd8b37a8a', 'c39079d3-b5c0-4db9-8c1b-20c6c70d18de', 'faa803aa-31b8-4c0c-811b-9a9a98b5fcb2', '4a550e78-0ebe-48ae-9b92-be752d335e12'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:10:14 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-883fe429-7adb-40da-bf85-522bfad5a840 tempest-CreateVolumesFromImageTest-131712280 None] Lock "cinder-ec784cf2-65b3-4539-a24f-6d59903c8f64-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:10:14 devstack sudo[106721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3436742b-ea0f-4b61-bc64-c0f3e966be88 Sep 04 18:10:14 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7a0ea113-6ee1-4b56-b67e-032d09824819 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7a0ea113-6ee1-4b56-b67e-032d09824819 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:14 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7a0ea113-6ee1-4b56-b67e-032d09824819 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:10:14 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7a0ea113-6ee1-4b56-b67e-032d09824819 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:10:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7a0ea113-6ee1-4b56-b67e-032d09824819 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:14 devstack sudo[106716]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7a0ea113-6ee1-4b56-b67e-032d09824819 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e2b54df6-cb58-4461-b6b8-d59ec72d7067_adehay3odevstack@QuobyteHD" returned: 0 in 0.488s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e2b54df6-cb58-4461-b6b8-d59ec72d7067_adehay3odevstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:14 devstack sudo[106727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:10:14 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:15 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_900b99d5-d26a-46eb-ae47-97b6fc6314fe_w2qlcd9q" returned: 0 in 0.415s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_900b99d5-d26a-46eb-ae47-97b6fc6314fe_w2qlcd9q {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:15 devstack sudo[106729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e2b54df6-cb58-4461-b6b8-d59ec72d7067_adehay3odevstack@QuobyteHD Sep 04 18:10:15 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:15 devstack sudo[106731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_900b99d5-d26a-46eb-ae47-97b6fc6314fe_w2qlcd9q Sep 04 18:10:15 devstack sudo[106731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:15 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a56411f1-5057-4120-951e-d505cd261bb4 tempest-CreateVolumesFromImageTest-131712280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3436742b-ea0f-4b61-bc64-c0f3e966be88" returned: 0 in 0.471s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a56411f1-5057-4120-951e-d505cd261bb4 tempest-CreateVolumesFromImageTest-131712280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3436742b-ea0f-4b61-bc64-c0f3e966be88 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:15 devstack sudo[106738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3436742b-ea0f-4b61-bc64-c0f3e966be88 Sep 04 18:10:15 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:15 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7a0ea113-6ee1-4b56-b67e-032d09824819 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.297s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:15 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-7a0ea113-6ee1-4b56-b67e-032d09824819 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:10:15 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-7a0ea113-6ee1-4b56-b67e-032d09824819 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Deleted volume successfully. Sep 04 18:10:15 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7a0ea113-6ee1-4b56-b67e-032d09824819 tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Lock "cinder-f8990194-9a5c-45d3-afec-6b8a38430dfc-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:10:15 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e2b54df6-cb58-4461-b6b8-d59ec72d7067_adehay3odevstack@QuobyteHD" returned: 1 in 0.351s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e2b54df6-cb58-4461-b6b8-d59ec72d7067_adehay3odevstack@QuobyteHD' failed. Not Retrying. {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 18:10:15 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] e2b54df6-cb58-4461-b6b8-d59ec72d7067 was raw, converting to qcow2 {{(pid=87314) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 04 18:10:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e2b54df6-cb58-4461-b6b8-d59ec72d7067_adehay3odevstack@QuobyteHD /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9ffd19de-20c0-4813-ba4c-b63e1fbae845 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:15 devstack sudo[106744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e2b54df6-cb58-4461-b6b8-d59ec72d7067_adehay3odevstack@QuobyteHD /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9ffd19de-20c0-4813-ba4c-b63e1fbae845 Sep 04 18:10:15 devstack sudo[106744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:15 devstack sudo[106731]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_900b99d5-d26a-46eb-ae47-97b6fc6314fe_w2qlcd9q" returned: 1 in 0.355s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_900b99d5-d26a-46eb-ae47-97b6fc6314fe_w2qlcd9q' failed. Not Retrying. {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 18:10:15 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[647531f1-3f18-48a8-b7a3-d06b76c52198]: (4, 'raw') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:10:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_900b99d5-d26a-46eb-ae47-97b6fc6314fe_0hl73dlqdevstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:15 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a56411f1-5057-4120-951e-d505cd261bb4 tempest-CreateVolumesFromImageTest-131712280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-3436742b-ea0f-4b61-bc64-c0f3e966be88" returned: 0 in 0.268s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:15 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a56411f1-5057-4120-951e-d505cd261bb4 tempest-CreateVolumesFromImageTest-131712280 None] Lock "cinder-quobyte-3436742b-ea0f-4b61-bc64-c0f3e966be88" released by "delete_volume" :: held 0.784s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:10:15 devstack sudo[106748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_900b99d5-d26a-46eb-ae47-97b6fc6314fe_0hl73dlqdevstack@QuobyteHD Sep 04 18:10:15 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:15 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-a56411f1-5057-4120-951e-d505cd261bb4 tempest-CreateVolumesFromImageTest-131712280 None] Created reservations ['20dd1b3b-a852-4617-9c6c-7906deb9a96e', '3e0f6d3d-fb91-4d1d-8115-a6f4701fdbc8', '69bea2fb-bd71-47a1-a6da-61baeec60cfa', '0ce4654e-0c3d-4b05-867a-2484ad5bc814'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:10:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a56411f1-5057-4120-951e-d505cd261bb4 tempest-CreateVolumesFromImageTest-131712280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a56411f1-5057-4120-951e-d505cd261bb4 tempest-CreateVolumesFromImageTest-131712280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a56411f1-5057-4120-951e-d505cd261bb4 tempest-CreateVolumesFromImageTest-131712280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:10:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a56411f1-5057-4120-951e-d505cd261bb4 tempest-CreateVolumesFromImageTest-131712280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:10:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a56411f1-5057-4120-951e-d505cd261bb4 tempest-CreateVolumesFromImageTest-131712280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a56411f1-5057-4120-951e-d505cd261bb4 tempest-CreateVolumesFromImageTest-131712280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:15 devstack sudo[106754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:10:15 devstack sudo[106754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:15 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_900b99d5-d26a-46eb-ae47-97b6fc6314fe_0hl73dlqdevstack@QuobyteHD" returned: 0 in 0.343s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_900b99d5-d26a-46eb-ae47-97b6fc6314fe_0hl73dlqdevstack@QuobyteHD {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:15 devstack sudo[106744]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e2b54df6-cb58-4461-b6b8-d59ec72d7067_adehay3odevstack@QuobyteHD /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9ffd19de-20c0-4813-ba4c-b63e1fbae845" returned: 0 in 0.502s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:15 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e2b54df6-cb58-4461-b6b8-d59ec72d7067_adehay3odevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9ffd19de-20c0-4813-ba4c-b63e1fbae845 {{(pid=87314) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 18:10:15 devstack cinder-volume[87314]: INFO cinder.image.image_utils [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] Converted 0.00 MB image at 0.00 MB/s Sep 04 18:10:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9ffd19de-20c0-4813-ba4c-b63e1fbae845 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:15 devstack sudo[106759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_900b99d5-d26a-46eb-ae47-97b6fc6314fe_0hl73dlqdevstack@QuobyteHD Sep 04 18:10:15 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:15 devstack sudo[106761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9ffd19de-20c0-4813-ba4c-b63e1fbae845 1G Sep 04 18:10:15 devstack sudo[106761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:15 devstack sudo[106754]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a56411f1-5057-4120-951e-d505cd261bb4 tempest-CreateVolumesFromImageTest-131712280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.300s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:15 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-a56411f1-5057-4120-951e-d505cd261bb4 tempest-CreateVolumesFromImageTest-131712280 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:10:15 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-a56411f1-5057-4120-951e-d505cd261bb4 tempest-CreateVolumesFromImageTest-131712280 None] Deleted volume successfully. Sep 04 18:10:15 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a56411f1-5057-4120-951e-d505cd261bb4 tempest-CreateVolumesFromImageTest-131712280 None] Lock "cinder-3436742b-ea0f-4b61-bc64-c0f3e966be88-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:10:16 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-687c23e3-9051-44cd-bc47-1ead72439efa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Acquiring lock "cinder-c14b02b8-ca04-40ef-99dd-634955d5665d-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:10:16 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-687c23e3-9051-44cd-bc47-1ead72439efa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Lock "cinder-c14b02b8-ca04-40ef-99dd-634955d5665d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:10:16 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-687c23e3-9051-44cd-bc47-1ead72439efa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Acquiring lock "cinder-quobyte-c14b02b8-ca04-40ef-99dd-634955d5665d" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:10:16 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-687c23e3-9051-44cd-bc47-1ead72439efa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Lock "cinder-quobyte-c14b02b8-ca04-40ef-99dd-634955d5665d" acquired by "delete_volume" :: waited 0.021s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:10:16 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_900b99d5-d26a-46eb-ae47-97b6fc6314fe_0hl73dlqdevstack@QuobyteHD" returned: 1 in 0.459s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_900b99d5-d26a-46eb-ae47-97b6fc6314fe_0hl73dlqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 18:10:16 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da2b074-84a3-405a-b41e-cb80320e3d64]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:10:16 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] 900b99d5-d26a-46eb-ae47-97b6fc6314fe was raw, converting to qcow2 {{(pid=87314) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 04 18:10:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_900b99d5-d26a-46eb-ae47-97b6fc6314fe_0hl73dlqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-48849db3-5906-431b-80ce-3f3554c0e607 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-687c23e3-9051-44cd-bc47-1ead72439efa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c14b02b8-ca04-40ef-99dd-634955d5665d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:16 devstack sudo[106767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_900b99d5-d26a-46eb-ae47-97b6fc6314fe_0hl73dlqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-48849db3-5906-431b-80ce-3f3554c0e607 Sep 04 18:10:16 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:16 devstack sudo[106761]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:16 devstack sudo[106769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c14b02b8-ca04-40ef-99dd-634955d5665d Sep 04 18:10:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9ffd19de-20c0-4813-ba4c-b63e1fbae845 1G" returned: 0 in 0.488s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:16 devstack cinder-volume[87314]: DEBUG cinder.volume.volume_utils [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] Downloaded image e2b54df6-cb58-4461-b6b8-d59ec72d7067 ((None, [{'url': 'file:///opt/stack/data/glance/images/e2b54df6-cb58-4461-b6b8-d59ec72d7067', 'metadata': {}}])) to volume 9ffd19de-20c0-4813-ba4c-b63e1fbae845 successfully. {{(pid=87314) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 04 18:10:16 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] Temporary image e2b54df6-cb58-4461-b6b8-d59ec72d7067 for user deb2fa541e5442ee8d3e096021c03251 is deleted. {{(pid=87314) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 04 18:10:16 devstack cinder-volume[87314]: DEBUG cinder.volume.volume_utils [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] Marking volume 9ffd19de-20c0-4813-ba4c-b63e1fbae845 as bootable. {{(pid=87314) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 04 18:10:16 devstack sudo[106769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:16 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] Copying metadata from image e2b54df6-cb58-4461-b6b8-d59ec72d7067 to 9ffd19de-20c0-4813-ba4c-b63e1fbae845. {{(pid=87314) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 04 18:10:16 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] Creating volume glance metadata for volume 9ffd19de-20c0-4813-ba4c-b63e1fbae845 backed by image e2b54df6-cb58-4461-b6b8-d59ec72d7067 with: {'image_id': 'e2b54df6-cb58-4461-b6b8-d59ec72d7067', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '9f6957a53e3142caae83fd43f4542a84', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87314) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 04 18:10:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55fb17ed-7d9b-4ef8-8aaa-894e583c30e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ffd19de-20c0-4813-ba4c-b63e1fbae845', 'volume_size': 1, 'image_id': 'e2b54df6-cb58-4461-b6b8-d59ec72d7067', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e2b54df6-cb58-4461-b6b8-d59ec72d7067', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9f6957a53e3142caae83fd43f4542a84', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '57d28cc49ead47099fe20cf9900b18a8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3eda2bb0b5ce859484c20f168f12e1079e558fe5286ce38aec69c5e6bb1119b7636569e6db9a0a41fb9e949d0a764f1ed2af11eee5d690c020f739ea08eb9648', 'id': 'e2b54df6-cb58-4461-b6b8-d59ec72d7067', 'created_at': datetime.datetime(2026, 9, 4, 16, 10, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 16, 10, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e2b54df6-cb58-4461-b6b8-d59ec72d7067/file', 'properties': {}}, 'image_service': }' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48ee6723-6054-4243-b99b-3149a846135f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:16 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] Volume volume-9ffd19de-20c0-4813-ba4c-b63e1fbae845 (9ffd19de-20c0-4813-ba4c-b63e1fbae845): created successfully Sep 04 18:10:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48ee6723-6054-4243-b99b-3149a846135f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] Flow 'volume_create_manager' (4324d9ad-cc98-4002-9250-b11e990dfab5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:10:16 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-9517cb96-7b68-4ca3-ab17-9f5eddadab70 tempest-VolumeImageDependencyTests-788263180 None] Created volume successfully. Sep 04 18:10:16 devstack sudo[106769]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-687c23e3-9051-44cd-bc47-1ead72439efa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c14b02b8-ca04-40ef-99dd-634955d5665d" returned: 0 in 0.430s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-687c23e3-9051-44cd-bc47-1ead72439efa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c14b02b8-ca04-40ef-99dd-634955d5665d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:16 devstack sudo[106781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c14b02b8-ca04-40ef-99dd-634955d5665d Sep 04 18:10:16 devstack sudo[106781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:16 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_900b99d5-d26a-46eb-ae47-97b6fc6314fe_0hl73dlqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-48849db3-5906-431b-80ce-3f3554c0e607" returned: 0 in 0.516s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:16 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_900b99d5-d26a-46eb-ae47-97b6fc6314fe_0hl73dlqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-48849db3-5906-431b-80ce-3f3554c0e607 {{(pid=87314) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 18:10:16 devstack cinder-volume[87314]: INFO cinder.image.image_utils [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Converted 0.00 MB image at 0.00 MB/s Sep 04 18:10:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-48849db3-5906-431b-80ce-3f3554c0e607 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:16 devstack sudo[106783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-48849db3-5906-431b-80ce-3f3554c0e607 1G Sep 04 18:10:16 devstack sudo[106783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:16 devstack sudo[106781]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-687c23e3-9051-44cd-bc47-1ead72439efa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-c14b02b8-ca04-40ef-99dd-634955d5665d" returned: 0 in 0.286s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:16 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-687c23e3-9051-44cd-bc47-1ead72439efa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Lock "cinder-quobyte-c14b02b8-ca04-40ef-99dd-634955d5665d" released by "delete_volume" :: held 0.799s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:10:17 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-687c23e3-9051-44cd-bc47-1ead72439efa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Created reservations ['0b722c00-a974-46fe-948a-497b3190e127', '9747528e-006d-418b-a980-3b9d18af5e2d', 'ba46a601-c2fd-4102-a1bc-2b4bb63c1015', 'd61583e2-e6bc-4d19-967f-0c1c81dd4384'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:10:17 devstack sudo[106783]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-48849db3-5906-431b-80ce-3f3554c0e607 1G" returned: 0 in 0.401s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:17 devstack cinder-volume[87314]: DEBUG cinder.volume.volume_utils [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Downloaded image 900b99d5-d26a-46eb-ae47-97b6fc6314fe ((None, [{'url': 'file:///opt/stack/data/glance/images/900b99d5-d26a-46eb-ae47-97b6fc6314fe', 'metadata': {}}])) to volume 48849db3-5906-431b-80ce-3f3554c0e607 successfully. {{(pid=87314) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 04 18:10:17 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Temporary image 900b99d5-d26a-46eb-ae47-97b6fc6314fe for user fc0b0f8ba54047d5ab7d5bdadd2c5319 is deleted. {{(pid=87314) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 04 18:10:17 devstack cinder-volume[87314]: DEBUG cinder.volume.volume_utils [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Marking volume 48849db3-5906-431b-80ce-3f3554c0e607 as bootable. {{(pid=87314) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 04 18:10:17 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Copying metadata from image 900b99d5-d26a-46eb-ae47-97b6fc6314fe to 48849db3-5906-431b-80ce-3f3554c0e607. {{(pid=87314) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 04 18:10:17 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Creating volume glance metadata for volume 48849db3-5906-431b-80ce-3f3554c0e607 backed by image 900b99d5-d26a-46eb-ae47-97b6fc6314fe with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '900b99d5-d26a-46eb-ae47-97b6fc6314fe', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'ca7e0d3171b4d5d92b45319f14e14f0c', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87314) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 04 18:10:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-687c23e3-9051-44cd-bc47-1ead72439efa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-687c23e3-9051-44cd-bc47-1ead72439efa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:17 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-687c23e3-9051-44cd-bc47-1ead72439efa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:10:17 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-687c23e3-9051-44cd-bc47-1ead72439efa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:10:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-687c23e3-9051-44cd-bc47-1ead72439efa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-687c23e3-9051-44cd-bc47-1ead72439efa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:17 devstack sudo[106790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:10:17 devstack sudo[106790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:17 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a575c7f-2454-4db6-87ae-680e6d661a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48849db3-5906-431b-80ce-3f3554c0e607', 'volume_size': 1, 'image_id': '900b99d5-d26a-46eb-ae47-97b6fc6314fe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/900b99d5-d26a-46eb-ae47-97b6fc6314fe', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ca7e0d3171b4d5d92b45319f14e14f0c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '739b50685e6b4548a4e860ebf7c757b0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '65d9c922cbb77346e90d9f950746fcc09668cea6f8f058daef897e4f6ecd23fbecdd2e4108155d34112fcf0fb15d60eabd2ae9d572e772ff985057a0976e7839', 'id': '900b99d5-d26a-46eb-ae47-97b6fc6314fe', 'created_at': datetime.datetime(2026, 9, 4, 16, 10, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 16, 10, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/900b99d5-d26a-46eb-ae47-97b6fc6314fe/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:17 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12f9a341-0f02-4c87-88eb-b56e23baf4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:17 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Volume volume-48849db3-5906-431b-80ce-3f3554c0e607 (48849db3-5906-431b-80ce-3f3554c0e607): created successfully Sep 04 18:10:17 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12f9a341-0f02-4c87-88eb-b56e23baf4c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:17 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Flow 'volume_create_manager' (2f0bb856-5a24-456c-a5f4-007b88e33822) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:10:17 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-2637bf15-3772-4a23-af1d-ad74a35dd13c tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Created volume successfully. Sep 04 18:10:17 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0d8d2c57-87d0-45b6-b558-5ffdf092d03a tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Acquiring lock "cinder-14e5ff0f-7ee2-49fe-ad95-569097647355-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:10:17 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0d8d2c57-87d0-45b6-b558-5ffdf092d03a tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Lock "cinder-14e5ff0f-7ee2-49fe-ad95-569097647355-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:10:17 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0d8d2c57-87d0-45b6-b558-5ffdf092d03a tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Acquiring lock "cinder-quobyte-14e5ff0f-7ee2-49fe-ad95-569097647355" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:10:17 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0d8d2c57-87d0-45b6-b558-5ffdf092d03a tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Lock "cinder-quobyte-14e5ff0f-7ee2-49fe-ad95-569097647355" acquired by "delete_volume" :: waited 0.025s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:10:17 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-17afad3e-13ed-4182-96b6-93d401eade93 tempest-VolumeImageDependencyTests-788263180 None] Acquiring lock "cinder-9ffd19de-20c0-4813-ba4c-b63e1fbae845-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:10:17 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[c788faa0-18a6-47a0-b515-fe5ced5fefc9]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:10:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0d8d2c57-87d0-45b6-b558-5ffdf092d03a tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-14e5ff0f-7ee2-49fe-ad95-569097647355 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:17 devstack sudo[106790]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-687c23e3-9051-44cd-bc47-1ead72439efa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.380s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:17 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-687c23e3-9051-44cd-bc47-1ead72439efa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:10:17 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-17afad3e-13ed-4182-96b6-93d401eade93 tempest-VolumeImageDependencyTests-788263180 None] Lock "cinder-9ffd19de-20c0-4813-ba4c-b63e1fbae845-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:10:17 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-687c23e3-9051-44cd-bc47-1ead72439efa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Deleted volume successfully. Sep 04 18:10:17 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-687c23e3-9051-44cd-bc47-1ead72439efa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Lock "cinder-c14b02b8-ca04-40ef-99dd-634955d5665d-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:10:17 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-17afad3e-13ed-4182-96b6-93d401eade93 tempest-VolumeImageDependencyTests-788263180 None] Acquiring lock "cinder-quobyte-9ffd19de-20c0-4813-ba4c-b63e1fbae845" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:10:17 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-17afad3e-13ed-4182-96b6-93d401eade93 tempest-VolumeImageDependencyTests-788263180 None] Lock "cinder-quobyte-9ffd19de-20c0-4813-ba4c-b63e1fbae845" acquired by "delete_volume" :: waited 0.026s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:10:17 devstack sudo[106793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-14e5ff0f-7ee2-49fe-ad95-569097647355 Sep 04 18:10:17 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d5eaf3-9a29-47bd-8e7a-e8ee608020a6]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:10:17 devstack sudo[106793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-17afad3e-13ed-4182-96b6-93d401eade93 tempest-VolumeImageDependencyTests-788263180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9ffd19de-20c0-4813-ba4c-b63e1fbae845 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:17 devstack sudo[106795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9ffd19de-20c0-4813-ba4c-b63e1fbae845 Sep 04 18:10:17 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:18 devstack sudo[106793]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0d8d2c57-87d0-45b6-b558-5ffdf092d03a tempest-CreateVolumesFromSourceVolumeTest-211536695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-14e5ff0f-7ee2-49fe-ad95-569097647355" returned: 0 in 0.507s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0d8d2c57-87d0-45b6-b558-5ffdf092d03a tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-14e5ff0f-7ee2-49fe-ad95-569097647355 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:18 devstack sudo[106802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-14e5ff0f-7ee2-49fe-ad95-569097647355 Sep 04 18:10:18 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:18 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-17afad3e-13ed-4182-96b6-93d401eade93 tempest-VolumeImageDependencyTests-788263180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9ffd19de-20c0-4813-ba4c-b63e1fbae845" returned: 0 in 0.404s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-17afad3e-13ed-4182-96b6-93d401eade93 tempest-VolumeImageDependencyTests-788263180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9ffd19de-20c0-4813-ba4c-b63e1fbae845 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:18 devstack sudo[106805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9ffd19de-20c0-4813-ba4c-b63e1fbae845 Sep 04 18:10:18 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:18 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0d8d2c57-87d0-45b6-b558-5ffdf092d03a tempest-CreateVolumesFromSourceVolumeTest-211536695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-14e5ff0f-7ee2-49fe-ad95-569097647355" returned: 0 in 0.275s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:18 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0d8d2c57-87d0-45b6-b558-5ffdf092d03a tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Lock "cinder-quobyte-14e5ff0f-7ee2-49fe-ad95-569097647355" released by "delete_volume" :: held 0.846s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:10:18 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-17afad3e-13ed-4182-96b6-93d401eade93 tempest-VolumeImageDependencyTests-788263180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9ffd19de-20c0-4813-ba4c-b63e1fbae845" returned: 0 in 0.282s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:18 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-17afad3e-13ed-4182-96b6-93d401eade93 tempest-VolumeImageDependencyTests-788263180 None] Lock "cinder-quobyte-9ffd19de-20c0-4813-ba4c-b63e1fbae845" released by "delete_volume" :: held 0.745s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:10:18 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-0d8d2c57-87d0-45b6-b558-5ffdf092d03a tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Created reservations ['2c2da5c4-4b27-4df5-a738-381c445d5c62', 'e676cd4e-3c5a-436a-b506-1e6c5358f0fd', '356dcd62-3d7b-4f74-8adf-e5de58ab1699', '0eb7aca2-87f3-4ee2-bc38-3da11eb8855a'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:10:18 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fdc2be78-273f-47f6-8ff1-ebcb10549f30 tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Acquiring lock "cinder-48849db3-5906-431b-80ce-3f3554c0e607-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:10:18 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fdc2be78-273f-47f6-8ff1-ebcb10549f30 tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Lock "cinder-48849db3-5906-431b-80ce-3f3554c0e607-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:10:18 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-17afad3e-13ed-4182-96b6-93d401eade93 tempest-VolumeImageDependencyTests-788263180 None] Created reservations ['372b95f8-a351-4ac5-b7f7-aed4d0c5f0ed', '02f2fe1e-5efc-4329-a0ed-d4ee6f6fde25', 'e551f622-daa0-4305-966f-419381d5680a', '27e1383f-727a-4739-b2d6-f39c4611c6a9'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:10:18 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fdc2be78-273f-47f6-8ff1-ebcb10549f30 tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Acquiring lock "cinder-quobyte-48849db3-5906-431b-80ce-3f3554c0e607" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:10:18 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fdc2be78-273f-47f6-8ff1-ebcb10549f30 tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Lock "cinder-quobyte-48849db3-5906-431b-80ce-3f3554c0e607" acquired by "delete_volume" :: waited 0.027s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:10:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0d8d2c57-87d0-45b6-b558-5ffdf092d03a tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0d8d2c57-87d0-45b6-b558-5ffdf092d03a tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:18 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0d8d2c57-87d0-45b6-b558-5ffdf092d03a tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:10:18 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0d8d2c57-87d0-45b6-b558-5ffdf092d03a tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:10:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0d8d2c57-87d0-45b6-b558-5ffdf092d03a tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0d8d2c57-87d0-45b6-b558-5ffdf092d03a tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:18 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[16051563-c4c3-4621-ba9f-deade5d6c65a]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:10:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fdc2be78-273f-47f6-8ff1-ebcb10549f30 tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-48849db3-5906-431b-80ce-3f3554c0e607 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:18 devstack sudo[106809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:10:18 devstack sudo[106809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:18 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e0481e85-9222-410b-a69f-ab0a84a6329d tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Acquiring lock "cinder-65129330-fe9b-45bc-a6a5-eacc20b77c22-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:10:18 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e0481e85-9222-410b-a69f-ab0a84a6329d tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Lock "cinder-65129330-fe9b-45bc-a6a5-eacc20b77c22-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:10:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-17afad3e-13ed-4182-96b6-93d401eade93 tempest-VolumeImageDependencyTests-788263180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-17afad3e-13ed-4182-96b6-93d401eade93 tempest-VolumeImageDependencyTests-788263180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:18 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-17afad3e-13ed-4182-96b6-93d401eade93 tempest-VolumeImageDependencyTests-788263180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:10:18 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-17afad3e-13ed-4182-96b6-93d401eade93 tempest-VolumeImageDependencyTests-788263180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:10:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-17afad3e-13ed-4182-96b6-93d401eade93 tempest-VolumeImageDependencyTests-788263180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-17afad3e-13ed-4182-96b6-93d401eade93 tempest-VolumeImageDependencyTests-788263180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:18 devstack sudo[106812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:10:18 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:18 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e0481e85-9222-410b-a69f-ab0a84a6329d tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Acquiring lock "cinder-quobyte-65129330-fe9b-45bc-a6a5-eacc20b77c22" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:10:18 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e0481e85-9222-410b-a69f-ab0a84a6329d tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Lock "cinder-quobyte-65129330-fe9b-45bc-a6a5-eacc20b77c22" acquired by "delete_volume" :: waited 0.020s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:10:18 devstack sudo[106810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-48849db3-5906-431b-80ce-3f3554c0e607 Sep 04 18:10:18 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c38c17b-1cb9-4649-aff4-1c256d7d51e2]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:10:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e0481e85-9222-410b-a69f-ab0a84a6329d tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-65129330-fe9b-45bc-a6a5-eacc20b77c22 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:18 devstack sudo[106810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:18 devstack sudo[106809]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0d8d2c57-87d0-45b6-b558-5ffdf092d03a tempest-CreateVolumesFromSourceVolumeTest-211536695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.338s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:18 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-0d8d2c57-87d0-45b6-b558-5ffdf092d03a tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:10:18 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-0d8d2c57-87d0-45b6-b558-5ffdf092d03a tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Deleted volume successfully. Sep 04 18:10:19 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0d8d2c57-87d0-45b6-b558-5ffdf092d03a tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Lock "cinder-14e5ff0f-7ee2-49fe-ad95-569097647355-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:10:19 devstack sudo[106815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-65129330-fe9b-45bc-a6a5-eacc20b77c22 Sep 04 18:10:19 devstack sudo[106815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:19 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-17afad3e-13ed-4182-96b6-93d401eade93 tempest-VolumeImageDependencyTests-788263180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.310s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:19 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-17afad3e-13ed-4182-96b6-93d401eade93 tempest-VolumeImageDependencyTests-788263180 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:10:19 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-17afad3e-13ed-4182-96b6-93d401eade93 tempest-VolumeImageDependencyTests-788263180 None] Deleted volume successfully. Sep 04 18:10:19 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-17afad3e-13ed-4182-96b6-93d401eade93 tempest-VolumeImageDependencyTests-788263180 None] Lock "cinder-9ffd19de-20c0-4813-ba4c-b63e1fbae845-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:10:19 devstack sudo[106810]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fdc2be78-273f-47f6-8ff1-ebcb10549f30 tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-48849db3-5906-431b-80ce-3f3554c0e607" returned: 0 in 0.674s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fdc2be78-273f-47f6-8ff1-ebcb10549f30 tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-48849db3-5906-431b-80ce-3f3554c0e607 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:19 devstack sudo[106823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-48849db3-5906-431b-80ce-3f3554c0e607 Sep 04 18:10:19 devstack sudo[106823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:19 devstack sudo[106815]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e0481e85-9222-410b-a69f-ab0a84a6329d tempest-CreateVolumesFromSourceVolumeTest-211536695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-65129330-fe9b-45bc-a6a5-eacc20b77c22" returned: 0 in 0.694s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e0481e85-9222-410b-a69f-ab0a84a6329d tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-65129330-fe9b-45bc-a6a5-eacc20b77c22 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:19 devstack sudo[106828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-65129330-fe9b-45bc-a6a5-eacc20b77c22 Sep 04 18:10:19 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:19 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-923d2653-07ea-4c2c-8364-592ea054701b tempest-VolumeDependencyTests-1358619200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:10:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-923d2653-07ea-4c2c-8364-592ea054701b tempest-VolumeDependencyTests-1358619200 None] Flow 'volume_create_manager' (a9310ede-b4c9-4652-b7fd-96f2055f59d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:10:19 devstack sudo[106823]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-923d2653-07ea-4c2c-8364-592ea054701b tempest-VolumeDependencyTests-1358619200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95cf9434-b15e-4d8a-9b3c-fe4e50219d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fdc2be78-273f-47f6-8ff1-ebcb10549f30 tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-48849db3-5906-431b-80ce-3f3554c0e607" returned: 0 in 0.422s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-923d2653-07ea-4c2c-8364-592ea054701b tempest-VolumeDependencyTests-1358619200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95cf9434-b15e-4d8a-9b3c-fe4e50219d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-575250131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ab18338-603b-495a-97eb-e7122caa15e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9175de99ea23488aaf767bd46cbf869c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:10:20Z,use_quota=True,user_id='4752c5cb154745b190b8ae22e82372d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-923d2653-07ea-4c2c-8364-592ea054701b tempest-VolumeDependencyTests-1358619200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (707f4340-01b6-42bb-9feb-23388624a261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-923d2653-07ea-4c2c-8364-592ea054701b tempest-VolumeDependencyTests-1358619200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (707f4340-01b6-42bb-9feb-23388624a261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-923d2653-07ea-4c2c-8364-592ea054701b tempest-VolumeDependencyTests-1358619200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68d8ebaf-af3f-4b57-a751-688af9f2aaf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-923d2653-07ea-4c2c-8364-592ea054701b tempest-VolumeDependencyTests-1358619200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68d8ebaf-af3f-4b57-a751-688af9f2aaf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ab18338-603b-495a-97eb-e7122caa15e0', 'volume_name': 'volume-5ab18338-603b-495a-97eb-e7122caa15e0', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-923d2653-07ea-4c2c-8364-592ea054701b tempest-VolumeDependencyTests-1358619200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13cf9c52-41bb-4089-a571-f893ab127e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-923d2653-07ea-4c2c-8364-592ea054701b tempest-VolumeDependencyTests-1358619200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13cf9c52-41bb-4089-a571-f893ab127e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:19 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-923d2653-07ea-4c2c-8364-592ea054701b tempest-VolumeDependencyTests-1358619200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c7dcec1-aea6-4458-ad93-03a32748a255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:19 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-923d2653-07ea-4c2c-8364-592ea054701b tempest-VolumeDependencyTests-1358619200 None] Volume 5ab18338-603b-495a-97eb-e7122caa15e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ab18338-603b-495a-97eb-e7122caa15e0', 'volume_size': 1} Sep 04 18:10:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-923d2653-07ea-4c2c-8364-592ea054701b tempest-VolumeDependencyTests-1358619200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-923d2653-07ea-4c2c-8364-592ea054701b tempest-VolumeDependencyTests-1358619200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:19 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-923d2653-07ea-4c2c-8364-592ea054701b tempest-VolumeDependencyTests-1358619200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-575250131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ab18338-603b-495a-97eb-e7122caa15e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9175de99ea23488aaf767bd46cbf869c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:10:20Z,use_quota=True,user_id='4752c5cb154745b190b8ae22e82372d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:10:19 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-923d2653-07ea-4c2c-8364-592ea054701b tempest-VolumeDependencyTests-1358619200 None] Creating volume 5ab18338-603b-495a-97eb-e7122caa15e0 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:10:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-923d2653-07ea-4c2c-8364-592ea054701b tempest-VolumeDependencyTests-1358619200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-923d2653-07ea-4c2c-8364-592ea054701b tempest-VolumeDependencyTests-1358619200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:19 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-923d2653-07ea-4c2c-8364-592ea054701b tempest-VolumeDependencyTests-1358619200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:10:19 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-923d2653-07ea-4c2c-8364-592ea054701b tempest-VolumeDependencyTests-1358619200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:10:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-923d2653-07ea-4c2c-8364-592ea054701b tempest-VolumeDependencyTests-1358619200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:19 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-923d2653-07ea-4c2c-8364-592ea054701b tempest-VolumeDependencyTests-1358619200 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:10:19 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-923d2653-07ea-4c2c-8364-592ea054701b tempest-VolumeDependencyTests-1358619200 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:10:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-923d2653-07ea-4c2c-8364-592ea054701b tempest-VolumeDependencyTests-1358619200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5ab18338-603b-495a-97eb-e7122caa15e0 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:19 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fdc2be78-273f-47f6-8ff1-ebcb10549f30 tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Lock "cinder-quobyte-48849db3-5906-431b-80ce-3f3554c0e607" released by "delete_volume" :: held 1.241s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:10:19 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e0481e85-9222-410b-a69f-ab0a84a6329d tempest-CreateVolumesFromSourceVolumeTest-211536695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-65129330-fe9b-45bc-a6a5-eacc20b77c22" returned: 0 in 0.314s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:19 devstack sudo[106832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5ab18338-603b-495a-97eb-e7122caa15e0 1073741824 Sep 04 18:10:19 devstack sudo[106832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:19 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e0481e85-9222-410b-a69f-ab0a84a6329d tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Lock "cinder-quobyte-65129330-fe9b-45bc-a6a5-eacc20b77c22" released by "delete_volume" :: held 1.076s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:10:19 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-fdc2be78-273f-47f6-8ff1-ebcb10549f30 tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Created reservations ['35ca1094-ee25-44f2-8776-f3c164825c6b', 'd34e4fe5-6428-41fa-b92d-ff3ffb57b45d', '46d74b02-73cf-4db6-ac91-184accd918b5', 'b9b646d1-ae8c-40a9-b668-bbcdacd3cda6'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:10:19 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-e0481e85-9222-410b-a69f-ab0a84a6329d tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Created reservations ['331ffff9-45a4-4bcb-96bd-e195c8bc8e5b', '300987fa-365e-4905-bd48-00d1130db19e', '6fb7a67a-bfc4-4245-bf99-063084cc6d9b', 'fce8bedb-7660-4c99-9435-477c00ddd49f'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:10:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fdc2be78-273f-47f6-8ff1-ebcb10549f30 tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fdc2be78-273f-47f6-8ff1-ebcb10549f30 tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:20 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-fdc2be78-273f-47f6-8ff1-ebcb10549f30 tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:10:20 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-fdc2be78-273f-47f6-8ff1-ebcb10549f30 tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:10:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fdc2be78-273f-47f6-8ff1-ebcb10549f30 tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fdc2be78-273f-47f6-8ff1-ebcb10549f30 tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:20 devstack sudo[106834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:10:20 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e0481e85-9222-410b-a69f-ab0a84a6329d tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e0481e85-9222-410b-a69f-ab0a84a6329d tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:20 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e0481e85-9222-410b-a69f-ab0a84a6329d tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:10:20 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e0481e85-9222-410b-a69f-ab0a84a6329d tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:10:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e0481e85-9222-410b-a69f-ab0a84a6329d tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e0481e85-9222-410b-a69f-ab0a84a6329d tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:20 devstack sudo[106838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:10:20 devstack sudo[106838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:20 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fdc2be78-273f-47f6-8ff1-ebcb10549f30 tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.270s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:20 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-fdc2be78-273f-47f6-8ff1-ebcb10549f30 tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:10:20 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-fdc2be78-273f-47f6-8ff1-ebcb10549f30 tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Deleted volume successfully. Sep 04 18:10:20 devstack sudo[106832]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-923d2653-07ea-4c2c-8364-592ea054701b tempest-VolumeDependencyTests-1358619200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5ab18338-603b-495a-97eb-e7122caa15e0 1073741824" returned: 0 in 0.530s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:20 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fdc2be78-273f-47f6-8ff1-ebcb10549f30 tempest-VolumeAndVolumeTypeFromImageTest-25455925 None] Lock "cinder-48849db3-5906-431b-80ce-3f3554c0e607-delete_volume" released by "delete_volume" :: held 1.874s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:10:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-923d2653-07ea-4c2c-8364-592ea054701b tempest-VolumeDependencyTests-1358619200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5ab18338-603b-495a-97eb-e7122caa15e0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:20 devstack sudo[106844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5ab18338-603b-495a-97eb-e7122caa15e0 Sep 04 18:10:20 devstack sudo[106838]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:20 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e0481e85-9222-410b-a69f-ab0a84a6329d tempest-CreateVolumesFromSourceVolumeTest-211536695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.323s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:20 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-e0481e85-9222-410b-a69f-ab0a84a6329d tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:10:20 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-e0481e85-9222-410b-a69f-ab0a84a6329d tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Deleted volume successfully. Sep 04 18:10:20 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e0481e85-9222-410b-a69f-ab0a84a6329d tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Lock "cinder-65129330-fe9b-45bc-a6a5-eacc20b77c22-delete_volume" released by "delete_volume" :: held 1.749s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:10:20 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-923d2653-07ea-4c2c-8364-592ea054701b tempest-VolumeDependencyTests-1358619200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5ab18338-603b-495a-97eb-e7122caa15e0" returned: 0 in 0.303s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:20 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-923d2653-07ea-4c2c-8364-592ea054701b tempest-VolumeDependencyTests-1358619200 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:10:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-923d2653-07ea-4c2c-8364-592ea054701b tempest-VolumeDependencyTests-1358619200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:20 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-923d2653-07ea-4c2c-8364-592ea054701b tempest-VolumeDependencyTests-1358619200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c7dcec1-aea6-4458-ad93-03a32748a255) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ab18338-603b-495a-97eb-e7122caa15e0', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:20 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-923d2653-07ea-4c2c-8364-592ea054701b tempest-VolumeDependencyTests-1358619200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aff07ce-0f89-45eb-bdcb-665b33dd58a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:20 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-923d2653-07ea-4c2c-8364-592ea054701b tempest-VolumeDependencyTests-1358619200 None] Volume volume-5ab18338-603b-495a-97eb-e7122caa15e0 (5ab18338-603b-495a-97eb-e7122caa15e0): created successfully Sep 04 18:10:20 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-923d2653-07ea-4c2c-8364-592ea054701b tempest-VolumeDependencyTests-1358619200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aff07ce-0f89-45eb-bdcb-665b33dd58a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:20 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-923d2653-07ea-4c2c-8364-592ea054701b tempest-VolumeDependencyTests-1358619200 None] Flow 'volume_create_manager' (a9310ede-b4c9-4652-b7fd-96f2055f59d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:10:20 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-923d2653-07ea-4c2c-8364-592ea054701b tempest-VolumeDependencyTests-1358619200 None] Created volume successfully. Sep 04 18:10:20 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fe73c497-ff47-4341-9a83-1dd20ae19b2b tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Acquiring lock "cinder-b3ed2c2f-32b8-430d-93da-8377dc4415f1-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:10:20 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fe73c497-ff47-4341-9a83-1dd20ae19b2b tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Lock "cinder-b3ed2c2f-32b8-430d-93da-8377dc4415f1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:10:21 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fe73c497-ff47-4341-9a83-1dd20ae19b2b tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Acquiring lock "cinder-quobyte-b3ed2c2f-32b8-430d-93da-8377dc4415f1" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:10:21 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fe73c497-ff47-4341-9a83-1dd20ae19b2b tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Lock "cinder-quobyte-b3ed2c2f-32b8-430d-93da-8377dc4415f1" acquired by "delete_volume" :: waited 0.024s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:10:21 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[54579fae-fc91-4b4b-958d-3a5bd2946671]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:10:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fe73c497-ff47-4341-9a83-1dd20ae19b2b tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b3ed2c2f-32b8-430d-93da-8377dc4415f1 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:21 devstack sudo[106847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b3ed2c2f-32b8-430d-93da-8377dc4415f1 Sep 04 18:10:21 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:21 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 18:10:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:10:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:10:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:21 devstack sudo[106850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:10:21 devstack sudo[106850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:21 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fe73c497-ff47-4341-9a83-1dd20ae19b2b tempest-CreateVolumesFromSourceVolumeTest-211536695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b3ed2c2f-32b8-430d-93da-8377dc4415f1" returned: 0 in 0.429s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fe73c497-ff47-4341-9a83-1dd20ae19b2b tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b3ed2c2f-32b8-430d-93da-8377dc4415f1 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:21 devstack sudo[106854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b3ed2c2f-32b8-430d-93da-8377dc4415f1 Sep 04 18:10:21 devstack sudo[106854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:21 devstack sudo[106850]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.313s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:21 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:10:21 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running periodic task VolumeManager._thread_info {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 18:10:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] thread count: 28 {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 18:10:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] thread info: [<_MainThread(MainThread, started 139900377723008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 18:10:21 devstack sudo[106854]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fe73c497-ff47-4341-9a83-1dd20ae19b2b tempest-CreateVolumesFromSourceVolumeTest-211536695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b3ed2c2f-32b8-430d-93da-8377dc4415f1" returned: 0 in 0.345s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:21 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fe73c497-ff47-4341-9a83-1dd20ae19b2b tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Lock "cinder-quobyte-b3ed2c2f-32b8-430d-93da-8377dc4415f1" released by "delete_volume" :: held 0.826s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:10:21 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-fe73c497-ff47-4341-9a83-1dd20ae19b2b tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Created reservations ['c80a472f-d137-4537-a00e-068e5724164d', '615c7c3e-dcb3-4f00-af00-b5d05af6c7c6', '074a8b65-1274-40c1-a5d3-3ebd5715699d', '2b8cbb8e-e0df-41cb-9143-2c9941d5166b'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:10:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ba53047b-ae39-4d11-b30a-6beb8891b2f7 tempest-VolumeDependencyTests-1358619200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ba53047b-ae39-4d11-b30a-6beb8891b2f7 tempest-VolumeDependencyTests-1358619200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:22 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-ba53047b-ae39-4d11-b30a-6beb8891b2f7 tempest-VolumeDependencyTests-1358619200 None] Creating offline snapshot 86314efe-d1bb-4d87-b9ee-6f96b17dd8c0 of volume 5ab18338-603b-495a-97eb-e7122caa15e0 {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 18:10:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fe73c497-ff47-4341-9a83-1dd20ae19b2b tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fe73c497-ff47-4341-9a83-1dd20ae19b2b tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:22 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-fe73c497-ff47-4341-9a83-1dd20ae19b2b tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:10:22 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-fe73c497-ff47-4341-9a83-1dd20ae19b2b tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:10:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fe73c497-ff47-4341-9a83-1dd20ae19b2b tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fe73c497-ff47-4341-9a83-1dd20ae19b2b tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:22 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55be5a7-e19f-4fb9-b3c4-f0a305af4e4c]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:10:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ba53047b-ae39-4d11-b30a-6beb8891b2f7 tempest-VolumeDependencyTests-1358619200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5ab18338-603b-495a-97eb-e7122caa15e0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:22 devstack sudo[106858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:10:22 devstack sudo[106858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:22 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c7a05ebd-e1a6-4ddc-8f10-4d67aef13afa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Acquiring lock "cinder-218d531f-138f-4f3a-a327-f1bb654c69ee-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:10:22 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c7a05ebd-e1a6-4ddc-8f10-4d67aef13afa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Lock "cinder-218d531f-138f-4f3a-a327-f1bb654c69ee-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:10:22 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c7a05ebd-e1a6-4ddc-8f10-4d67aef13afa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Acquiring lock "cinder-quobyte-218d531f-138f-4f3a-a327-f1bb654c69ee" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:10:22 devstack sudo[106859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5ab18338-603b-495a-97eb-e7122caa15e0 Sep 04 18:10:22 devstack sudo[106859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:22 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c7a05ebd-e1a6-4ddc-8f10-4d67aef13afa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Lock "cinder-quobyte-218d531f-138f-4f3a-a327-f1bb654c69ee" acquired by "delete_volume" :: waited 0.024s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:10:22 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f689f2-b6ad-4bab-940e-cc1a2a5926df]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:10:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c7a05ebd-e1a6-4ddc-8f10-4d67aef13afa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-218d531f-138f-4f3a-a327-f1bb654c69ee {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:22 devstack sudo[106862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-218d531f-138f-4f3a-a327-f1bb654c69ee Sep 04 18:10:22 devstack sudo[106862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:22 devstack sudo[106858]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fe73c497-ff47-4341-9a83-1dd20ae19b2b tempest-CreateVolumesFromSourceVolumeTest-211536695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.433s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:22 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-fe73c497-ff47-4341-9a83-1dd20ae19b2b tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:10:22 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-fe73c497-ff47-4341-9a83-1dd20ae19b2b tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Deleted volume successfully. Sep 04 18:10:22 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-fe73c497-ff47-4341-9a83-1dd20ae19b2b tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Lock "cinder-b3ed2c2f-32b8-430d-93da-8377dc4415f1-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:10:22 devstack sudo[106859]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ba53047b-ae39-4d11-b30a-6beb8891b2f7 tempest-VolumeDependencyTests-1358619200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5ab18338-603b-495a-97eb-e7122caa15e0" returned: 0 in 0.496s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ba53047b-ae39-4d11-b30a-6beb8891b2f7 tempest-VolumeDependencyTests-1358619200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5ab18338-603b-495a-97eb-e7122caa15e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5ab18338-603b-495a-97eb-e7122caa15e0.86314efe-d1bb-4d87-b9ee-6f96b17dd8c0 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:22 devstack sudo[106868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5ab18338-603b-495a-97eb-e7122caa15e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5ab18338-603b-495a-97eb-e7122caa15e0.86314efe-d1bb-4d87-b9ee-6f96b17dd8c0 1G Sep 04 18:10:22 devstack sudo[106868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:22 devstack sudo[106862]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c7a05ebd-e1a6-4ddc-8f10-4d67aef13afa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-218d531f-138f-4f3a-a327-f1bb654c69ee" returned: 0 in 0.510s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c7a05ebd-e1a6-4ddc-8f10-4d67aef13afa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-218d531f-138f-4f3a-a327-f1bb654c69ee {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:22 devstack sudo[106874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-218d531f-138f-4f3a-a327-f1bb654c69ee Sep 04 18:10:22 devstack sudo[106874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:23 devstack sudo[106874]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c7a05ebd-e1a6-4ddc-8f10-4d67aef13afa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-218d531f-138f-4f3a-a327-f1bb654c69ee" returned: 0 in 0.294s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:23 devstack sudo[106868]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ba53047b-ae39-4d11-b30a-6beb8891b2f7 tempest-VolumeDependencyTests-1358619200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5ab18338-603b-495a-97eb-e7122caa15e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5ab18338-603b-495a-97eb-e7122caa15e0.86314efe-d1bb-4d87-b9ee-6f96b17dd8c0 1G" returned: 0 in 0.534s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ba53047b-ae39-4d11-b30a-6beb8891b2f7 tempest-VolumeDependencyTests-1358619200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ab18338-603b-495a-97eb-e7122caa15e0 -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5ab18338-603b-495a-97eb-e7122caa15e0.86314efe-d1bb-4d87-b9ee-6f96b17dd8c0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:23 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c7a05ebd-e1a6-4ddc-8f10-4d67aef13afa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Lock "cinder-quobyte-218d531f-138f-4f3a-a327-f1bb654c69ee" released by "delete_volume" :: held 0.869s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:10:23 devstack sudo[106881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ab18338-603b-495a-97eb-e7122caa15e0 -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5ab18338-603b-495a-97eb-e7122caa15e0.86314efe-d1bb-4d87-b9ee-6f96b17dd8c0 Sep 04 18:10:23 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:23 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-c7a05ebd-e1a6-4ddc-8f10-4d67aef13afa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Created reservations ['a1f26ed0-b36f-45b6-b9c4-fd97096480c9', 'a2ea2bbb-4feb-4614-a6fc-d7a809058f00', '0d23dc67-ae90-461c-b869-a479fa6344b8', '80244eac-119c-4f79-a346-c52fb2f858f2'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:10:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c7a05ebd-e1a6-4ddc-8f10-4d67aef13afa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c7a05ebd-e1a6-4ddc-8f10-4d67aef13afa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:23 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c7a05ebd-e1a6-4ddc-8f10-4d67aef13afa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:10:23 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c7a05ebd-e1a6-4ddc-8f10-4d67aef13afa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:10:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c7a05ebd-e1a6-4ddc-8f10-4d67aef13afa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c7a05ebd-e1a6-4ddc-8f10-4d67aef13afa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:23 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:10:23 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:23 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c7a05ebd-e1a6-4ddc-8f10-4d67aef13afa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.309s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:23 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-c7a05ebd-e1a6-4ddc-8f10-4d67aef13afa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:10:23 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-c7a05ebd-e1a6-4ddc-8f10-4d67aef13afa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Deleted volume successfully. Sep 04 18:10:23 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c7a05ebd-e1a6-4ddc-8f10-4d67aef13afa tempest-CreateVolumesFromSourceVolumeTest-211536695 None] Lock "cinder-218d531f-138f-4f3a-a327-f1bb654c69ee-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:10:23 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ba53047b-ae39-4d11-b30a-6beb8891b2f7 tempest-VolumeDependencyTests-1358619200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ab18338-603b-495a-97eb-e7122caa15e0 -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5ab18338-603b-495a-97eb-e7122caa15e0.86314efe-d1bb-4d87-b9ee-6f96b17dd8c0" returned: 0 in 0.556s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:23 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-ba53047b-ae39-4d11-b30a-6beb8891b2f7 tempest-VolumeDependencyTests-1358619200 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5ab18338-603b-495a-97eb-e7122caa15e0.86314efe-d1bb-4d87-b9ee-6f96b17dd8c0 is being set with open permissions: ugo+rw Sep 04 18:10:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ba53047b-ae39-4d11-b30a-6beb8891b2f7 tempest-VolumeDependencyTests-1358619200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5ab18338-603b-495a-97eb-e7122caa15e0.86314efe-d1bb-4d87-b9ee-6f96b17dd8c0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:23 devstack sudo[106889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5ab18338-603b-495a-97eb-e7122caa15e0.86314efe-d1bb-4d87-b9ee-6f96b17dd8c0 Sep 04 18:10:23 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:24 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ba53047b-ae39-4d11-b30a-6beb8891b2f7 tempest-VolumeDependencyTests-1358619200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5ab18338-603b-495a-97eb-e7122caa15e0.86314efe-d1bb-4d87-b9ee-6f96b17dd8c0" returned: 0 in 0.359s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ba53047b-ae39-4d11-b30a-6beb8891b2f7 tempest-VolumeDependencyTests-1358619200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5ab18338-603b-495a-97eb-e7122caa15e0.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:24 devstack sudo[106893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5ab18338-603b-495a-97eb-e7122caa15e0.info Sep 04 18:10:24 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:24 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ba53047b-ae39-4d11-b30a-6beb8891b2f7 tempest-VolumeDependencyTests-1358619200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5ab18338-603b-495a-97eb-e7122caa15e0.info" returned: 0 in 0.364s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:24 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-ba53047b-ae39-4d11-b30a-6beb8891b2f7 tempest-VolumeDependencyTests-1358619200 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5ab18338-603b-495a-97eb-e7122caa15e0.info is being set with open permissions: ugo+rw Sep 04 18:10:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ba53047b-ae39-4d11-b30a-6beb8891b2f7 tempest-VolumeDependencyTests-1358619200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5ab18338-603b-495a-97eb-e7122caa15e0.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:24 devstack sudo[106896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5ab18338-603b-495a-97eb-e7122caa15e0.info Sep 04 18:10:24 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:24 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ba53047b-ae39-4d11-b30a-6beb8891b2f7 tempest-VolumeDependencyTests-1358619200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5ab18338-603b-495a-97eb-e7122caa15e0.info" returned: 0 in 0.369s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ba53047b-ae39-4d11-b30a-6beb8891b2f7 tempest-VolumeDependencyTests-1358619200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.845s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:24 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-ba53047b-ae39-4d11-b30a-6beb8891b2f7 tempest-VolumeDependencyTests-1358619200 None] Create snapshot completed successfully Sep 04 18:10:25 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-35f60041-0b8d-4369-8df8-dcf38a728193 tempest-VolumeDependencyTests-1358619200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:10:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-35f60041-0b8d-4369-8df8-dcf38a728193 tempest-VolumeDependencyTests-1358619200 None] Flow 'volume_create_manager' (68651b56-0ba5-423d-b9de-4df56a34a80d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:10:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-35f60041-0b8d-4369-8df8-dcf38a728193 tempest-VolumeDependencyTests-1358619200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c31cf64-75a9-495c-afdf-75117afde762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-35f60041-0b8d-4369-8df8-dcf38a728193 tempest-VolumeDependencyTests-1358619200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c31cf64-75a9-495c-afdf-75117afde762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:10:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1394197777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deaa02b5-18e6-4287-aeba-c1750d2ab903,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9175de99ea23488aaf767bd46cbf869c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:10:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=86314efe-d1bb-4d87-b9ee-6f96b17dd8c0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:10:26Z,use_quota=True,user_id='4752c5cb154745b190b8ae22e82372d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-35f60041-0b8d-4369-8df8-dcf38a728193 tempest-VolumeDependencyTests-1358619200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32f29bdb-8152-457e-8bea-6e5366d11211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-35f60041-0b8d-4369-8df8-dcf38a728193 tempest-VolumeDependencyTests-1358619200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32f29bdb-8152-457e-8bea-6e5366d11211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-35f60041-0b8d-4369-8df8-dcf38a728193 tempest-VolumeDependencyTests-1358619200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc145da3-5bfd-4af2-bdcb-bc4c4d1e7646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-35f60041-0b8d-4369-8df8-dcf38a728193 tempest-VolumeDependencyTests-1358619200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc145da3-5bfd-4af2-bdcb-bc4c4d1e7646) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'deaa02b5-18e6-4287-aeba-c1750d2ab903', 'volume_name': 'volume-deaa02b5-18e6-4287-aeba-c1750d2ab903', 'volume_size': 1, 'snapshot_id': '86314efe-d1bb-4d87-b9ee-6f96b17dd8c0'}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-35f60041-0b8d-4369-8df8-dcf38a728193 tempest-VolumeDependencyTests-1358619200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (294c4ea3-34a3-4fab-b371-49fc1ddea599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:25 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-35f60041-0b8d-4369-8df8-dcf38a728193 tempest-VolumeDependencyTests-1358619200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (294c4ea3-34a3-4fab-b371-49fc1ddea599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-35f60041-0b8d-4369-8df8-dcf38a728193 tempest-VolumeDependencyTests-1358619200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (070fab8c-4e17-4d75-9f0d-9b486ff41c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:26 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-35f60041-0b8d-4369-8df8-dcf38a728193 tempest-VolumeDependencyTests-1358619200 None] Volume deaa02b5-18e6-4287-aeba-c1750d2ab903: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-deaa02b5-18e6-4287-aeba-c1750d2ab903', 'volume_size': 1, 'snapshot_id': '86314efe-d1bb-4d87-b9ee-6f96b17dd8c0'} Sep 04 18:10:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-35f60041-0b8d-4369-8df8-dcf38a728193 tempest-VolumeDependencyTests-1358619200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-35f60041-0b8d-4369-8df8-dcf38a728193 tempest-VolumeDependencyTests-1358619200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:26 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-35f60041-0b8d-4369-8df8-dcf38a728193 tempest-VolumeDependencyTests-1358619200 None] Acquiring lock "cinder-quobyte-86314efe-d1bb-4d87-b9ee-6f96b17dd8c0-deaa02b5-18e6-4287-aeba-c1750d2ab903" by "_create_volume_from_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:10:26 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-35f60041-0b8d-4369-8df8-dcf38a728193 tempest-VolumeDependencyTests-1358619200 None] Lock "cinder-quobyte-86314efe-d1bb-4d87-b9ee-6f96b17dd8c0-deaa02b5-18e6-4287-aeba-c1750d2ab903" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:10:26 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-35f60041-0b8d-4369-8df8-dcf38a728193 tempest-VolumeDependencyTests-1358619200 None] Creating volume deaa02b5-18e6-4287-aeba-c1750d2ab903 from snapshot 86314efe-d1bb-4d87-b9ee-6f96b17dd8c0 {{(pid=87314) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 04 18:10:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-35f60041-0b8d-4369-8df8-dcf38a728193 tempest-VolumeDependencyTests-1358619200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-35f60041-0b8d-4369-8df8-dcf38a728193 tempest-VolumeDependencyTests-1358619200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:26 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-35f60041-0b8d-4369-8df8-dcf38a728193 tempest-VolumeDependencyTests-1358619200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:10:26 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-35f60041-0b8d-4369-8df8-dcf38a728193 tempest-VolumeDependencyTests-1358619200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:10:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-35f60041-0b8d-4369-8df8-dcf38a728193 tempest-VolumeDependencyTests-1358619200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:26 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-35f60041-0b8d-4369-8df8-dcf38a728193 tempest-VolumeDependencyTests-1358619200 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:10:26 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-35f60041-0b8d-4369-8df8-dcf38a728193 tempest-VolumeDependencyTests-1358619200 None] Acquiring lock "cinder-quobyte-deaa02b5-18e6-4287-aeba-c1750d2ab903" by "_copy_volume_from_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:10:26 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-35f60041-0b8d-4369-8df8-dcf38a728193 tempest-VolumeDependencyTests-1358619200 None] Lock "cinder-quobyte-deaa02b5-18e6-4287-aeba-c1750d2ab903" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:10:26 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-35f60041-0b8d-4369-8df8-dcf38a728193 tempest-VolumeDependencyTests-1358619200 None] snapshot: 86314efe-d1bb-4d87-b9ee-6f96b17dd8c0, volume: deaa02b5-18e6-4287-aeba-c1750d2ab903, {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 04 18:10:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-35f60041-0b8d-4369-8df8-dcf38a728193 tempest-VolumeDependencyTests-1358619200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-35f60041-0b8d-4369-8df8-dcf38a728193 tempest-VolumeDependencyTests-1358619200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:26 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-35f60041-0b8d-4369-8df8-dcf38a728193 tempest-VolumeDependencyTests-1358619200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:10:26 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-35f60041-0b8d-4369-8df8-dcf38a728193 tempest-VolumeDependencyTests-1358619200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:10:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-35f60041-0b8d-4369-8df8-dcf38a728193 tempest-VolumeDependencyTests-1358619200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:26 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea88672-fddc-47e5-8ff6-827ec0c4087a]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:10:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-35f60041-0b8d-4369-8df8-dcf38a728193 tempest-VolumeDependencyTests-1358619200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5ab18338-603b-495a-97eb-e7122caa15e0.86314efe-d1bb-4d87-b9ee-6f96b17dd8c0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:26 devstack sudo[106899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5ab18338-603b-495a-97eb-e7122caa15e0.86314efe-d1bb-4d87-b9ee-6f96b17dd8c0 Sep 04 18:10:26 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:26 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-35f60041-0b8d-4369-8df8-dcf38a728193 tempest-VolumeDependencyTests-1358619200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5ab18338-603b-495a-97eb-e7122caa15e0.86314efe-d1bb-4d87-b9ee-6f96b17dd8c0" returned: 0 in 0.414s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:26 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-35f60041-0b8d-4369-8df8-dcf38a728193 tempest-VolumeDependencyTests-1358619200 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ab18338-603b-495a-97eb-e7122caa15e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 18:10:26 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe332bc5-4e28-441c-bda2-bbb3c8d05593]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:10:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-35f60041-0b8d-4369-8df8-dcf38a728193 tempest-VolumeDependencyTests-1358619200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5ab18338-603b-495a-97eb-e7122caa15e0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:26 devstack sudo[106905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5ab18338-603b-495a-97eb-e7122caa15e0 Sep 04 18:10:26 devstack sudo[106905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:27 devstack sudo[106905]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-35f60041-0b8d-4369-8df8-dcf38a728193 tempest-VolumeDependencyTests-1358619200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5ab18338-603b-495a-97eb-e7122caa15e0" returned: 0 in 0.496s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:27 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-35f60041-0b8d-4369-8df8-dcf38a728193 tempest-VolumeDependencyTests-1358619200 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5ab18338-603b-495a-97eb-e7122caa15e0 {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 04 18:10:27 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-35f60041-0b8d-4369-8df8-dcf38a728193 tempest-VolumeDependencyTests-1358619200 None] Creating direct copy from snapshot {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 04 18:10:27 devstack cinder-volume[87314]: DEBUG cinder.utils [None req-35f60041-0b8d-4369-8df8-dcf38a728193 tempest-VolumeDependencyTests-1358619200 None] Path /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-deaa02b5-18e6-4287-aeba-c1750d2ab903 not found in is_blk_device check {{(pid=87314) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 04 18:10:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-35f60041-0b8d-4369-8df8-dcf38a728193 tempest-VolumeDependencyTests-1358619200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5ab18338-603b-495a-97eb-e7122caa15e0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-deaa02b5-18e6-4287-aeba-c1750d2ab903 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:27 devstack sudo[106910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5ab18338-603b-495a-97eb-e7122caa15e0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-deaa02b5-18e6-4287-aeba-c1750d2ab903 Sep 04 18:10:27 devstack sudo[106910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:27 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-f55a8d9b-bd20-4149-bce4-d71639a926d8 tempest-CreateVolumesFromSnapshotTest-501804922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:10:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f55a8d9b-bd20-4149-bce4-d71639a926d8 tempest-CreateVolumesFromSnapshotTest-501804922 None] Flow 'volume_create_manager' (206b75b8-43f6-40f4-aa03-fa351677904f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:10:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f55a8d9b-bd20-4149-bce4-d71639a926d8 tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d2a9b4b-f569-4f6c-9c29-04bf8829762e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f55a8d9b-bd20-4149-bce4-d71639a926d8 tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d2a9b4b-f569-4f6c-9c29-04bf8829762e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:10:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-192265952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4bb0533-7194-4476-893e-276e17d7b84b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c5d43c4690a4b6d8cb22dc8b00b3c53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:10:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:10:27Z,use_quota=True,user_id='2ed632630d734466ba1442018a1079b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f55a8d9b-bd20-4149-bce4-d71639a926d8 tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae26da28-5b03-49b0-80de-a5648e37315e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f55a8d9b-bd20-4149-bce4-d71639a926d8 tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae26da28-5b03-49b0-80de-a5648e37315e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f55a8d9b-bd20-4149-bce4-d71639a926d8 tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (459ce27b-84c8-4a25-8983-6ca2a9b65fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f55a8d9b-bd20-4149-bce4-d71639a926d8 tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (459ce27b-84c8-4a25-8983-6ca2a9b65fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4bb0533-7194-4476-893e-276e17d7b84b', 'volume_name': 'volume-f4bb0533-7194-4476-893e-276e17d7b84b', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f55a8d9b-bd20-4149-bce4-d71639a926d8 tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db828a5f-7622-4c8e-8a9d-ebee8394f8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f55a8d9b-bd20-4149-bce4-d71639a926d8 tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db828a5f-7622-4c8e-8a9d-ebee8394f8c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f55a8d9b-bd20-4149-bce4-d71639a926d8 tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4504791c-50dc-4353-917e-62c2c7e0057d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:27 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-f55a8d9b-bd20-4149-bce4-d71639a926d8 tempest-CreateVolumesFromSnapshotTest-501804922 None] Volume f4bb0533-7194-4476-893e-276e17d7b84b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4bb0533-7194-4476-893e-276e17d7b84b', 'volume_size': 1} Sep 04 18:10:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f55a8d9b-bd20-4149-bce4-d71639a926d8 tempest-CreateVolumesFromSnapshotTest-501804922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:28 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-26268df1-db6f-4572-b82e-d3f3a59d1156 tempest-ProjectAdminTests-1062947273 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.743392944336, 'free_capacity_gb': 1773.743392944336, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87314) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 04 18:10:32 devstack sudo[106910]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-35f60041-0b8d-4369-8df8-dcf38a728193 tempest-VolumeDependencyTests-1358619200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5ab18338-603b-495a-97eb-e7122caa15e0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-deaa02b5-18e6-4287-aeba-c1750d2ab903" returned: 0 in 5.064s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:32 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-35f60041-0b8d-4369-8df8-dcf38a728193 tempest-VolumeDependencyTests-1358619200 None] Image conversion details: src /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5ab18338-603b-495a-97eb-e7122caa15e0, size 1024.00 MB, duration 5.06 sec, destination /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-deaa02b5-18e6-4287-aeba-c1750d2ab903 {{(pid=87314) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 18:10:32 devstack cinder-volume[87314]: INFO cinder.image.image_utils [None req-35f60041-0b8d-4369-8df8-dcf38a728193 tempest-VolumeDependencyTests-1358619200 None] Converted 1024.00 MB image at 202.19 MB/s Sep 04 18:10:32 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-35f60041-0b8d-4369-8df8-dcf38a728193 tempest-VolumeDependencyTests-1358619200 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-deaa02b5-18e6-4287-aeba-c1750d2ab903 is being set with open permissions: ugo+rw Sep 04 18:10:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-35f60041-0b8d-4369-8df8-dcf38a728193 tempest-VolumeDependencyTests-1358619200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-deaa02b5-18e6-4287-aeba-c1750d2ab903 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:32 devstack sudo[106923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-deaa02b5-18e6-4287-aeba-c1750d2ab903 Sep 04 18:10:32 devstack sudo[106923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:32 devstack sudo[106923]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-35f60041-0b8d-4369-8df8-dcf38a728193 tempest-VolumeDependencyTests-1358619200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-deaa02b5-18e6-4287-aeba-c1750d2ab903" returned: 0 in 0.290s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:32 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-35f60041-0b8d-4369-8df8-dcf38a728193 tempest-VolumeDependencyTests-1358619200 None] Lock "cinder-quobyte-deaa02b5-18e6-4287-aeba-c1750d2ab903" released by "_copy_volume_from_snapshot" :: held 6.370s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:10:32 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-35f60041-0b8d-4369-8df8-dcf38a728193 tempest-VolumeDependencyTests-1358619200 None] Lock "cinder-quobyte-86314efe-d1bb-4d87-b9ee-6f96b17dd8c0-deaa02b5-18e6-4287-aeba-c1750d2ab903" released by "_create_volume_from_snapshot" :: held 6.451s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:10:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-35f60041-0b8d-4369-8df8-dcf38a728193 tempest-VolumeDependencyTests-1358619200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.470s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f55a8d9b-bd20-4149-bce4-d71639a926d8 tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.975s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:32 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f55a8d9b-bd20-4149-bce4-d71639a926d8 tempest-CreateVolumesFromSnapshotTest-501804922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:10:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-192265952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4bb0533-7194-4476-893e-276e17d7b84b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c5d43c4690a4b6d8cb22dc8b00b3c53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:10:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:10:27Z,use_quota=True,user_id='2ed632630d734466ba1442018a1079b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:10:32 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-f55a8d9b-bd20-4149-bce4-d71639a926d8 tempest-CreateVolumesFromSnapshotTest-501804922 None] Creating volume f4bb0533-7194-4476-893e-276e17d7b84b {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:10:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f55a8d9b-bd20-4149-bce4-d71639a926d8 tempest-CreateVolumesFromSnapshotTest-501804922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f55a8d9b-bd20-4149-bce4-d71639a926d8 tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:32 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f55a8d9b-bd20-4149-bce4-d71639a926d8 tempest-CreateVolumesFromSnapshotTest-501804922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:10:32 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f55a8d9b-bd20-4149-bce4-d71639a926d8 tempest-CreateVolumesFromSnapshotTest-501804922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:10:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f55a8d9b-bd20-4149-bce4-d71639a926d8 tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:32 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f55a8d9b-bd20-4149-bce4-d71639a926d8 tempest-CreateVolumesFromSnapshotTest-501804922 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:10:32 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-f55a8d9b-bd20-4149-bce4-d71639a926d8 tempest-CreateVolumesFromSnapshotTest-501804922 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:10:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f55a8d9b-bd20-4149-bce4-d71639a926d8 tempest-CreateVolumesFromSnapshotTest-501804922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f4bb0533-7194-4476-893e-276e17d7b84b 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:32 devstack sudo[106926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f4bb0533-7194-4476-893e-276e17d7b84b 1073741824 Sep 04 18:10:32 devstack sudo[106926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:32 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-35f60041-0b8d-4369-8df8-dcf38a728193 tempest-VolumeDependencyTests-1358619200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (070fab8c-4e17-4d75-9f0d-9b486ff41c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-deaa02b5-18e6-4287-aeba-c1750d2ab903', 'volume_size': 1, 'snapshot_id': '86314efe-d1bb-4d87-b9ee-6f96b17dd8c0'}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:32 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-35f60041-0b8d-4369-8df8-dcf38a728193 tempest-VolumeDependencyTests-1358619200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (962b0592-0c07-4f2c-9d10-1394c859ab36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:32 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-35f60041-0b8d-4369-8df8-dcf38a728193 tempest-VolumeDependencyTests-1358619200 None] Volume volume-deaa02b5-18e6-4287-aeba-c1750d2ab903 (deaa02b5-18e6-4287-aeba-c1750d2ab903): created successfully Sep 04 18:10:32 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-35f60041-0b8d-4369-8df8-dcf38a728193 tempest-VolumeDependencyTests-1358619200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (962b0592-0c07-4f2c-9d10-1394c859ab36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:32 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-35f60041-0b8d-4369-8df8-dcf38a728193 tempest-VolumeDependencyTests-1358619200 None] Flow 'volume_create_manager' (68651b56-0ba5-423d-b9de-4df56a34a80d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:10:32 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-35f60041-0b8d-4369-8df8-dcf38a728193 tempest-VolumeDependencyTests-1358619200 None] Created volume successfully. Sep 04 18:10:33 devstack sudo[106926]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f55a8d9b-bd20-4149-bce4-d71639a926d8 tempest-CreateVolumesFromSnapshotTest-501804922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f4bb0533-7194-4476-893e-276e17d7b84b 1073741824" returned: 0 in 0.587s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f55a8d9b-bd20-4149-bce4-d71639a926d8 tempest-CreateVolumesFromSnapshotTest-501804922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f4bb0533-7194-4476-893e-276e17d7b84b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:33 devstack sudo[106932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f4bb0533-7194-4476-893e-276e17d7b84b Sep 04 18:10:33 devstack sudo[106932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:33 devstack sudo[106932]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f55a8d9b-bd20-4149-bce4-d71639a926d8 tempest-CreateVolumesFromSnapshotTest-501804922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f4bb0533-7194-4476-893e-276e17d7b84b" returned: 0 in 0.281s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:33 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f55a8d9b-bd20-4149-bce4-d71639a926d8 tempest-CreateVolumesFromSnapshotTest-501804922 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:10:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f55a8d9b-bd20-4149-bce4-d71639a926d8 tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f55a8d9b-bd20-4149-bce4-d71639a926d8 tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4504791c-50dc-4353-917e-62c2c7e0057d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4bb0533-7194-4476-893e-276e17d7b84b', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f55a8d9b-bd20-4149-bce4-d71639a926d8 tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aafe5197-72d6-471c-bb8a-f1ec585f6ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:33 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-f55a8d9b-bd20-4149-bce4-d71639a926d8 tempest-CreateVolumesFromSnapshotTest-501804922 None] Volume volume-f4bb0533-7194-4476-893e-276e17d7b84b (f4bb0533-7194-4476-893e-276e17d7b84b): created successfully Sep 04 18:10:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f55a8d9b-bd20-4149-bce4-d71639a926d8 tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aafe5197-72d6-471c-bb8a-f1ec585f6ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:33 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-f55a8d9b-bd20-4149-bce4-d71639a926d8 tempest-CreateVolumesFromSnapshotTest-501804922 None] Flow 'volume_create_manager' (206b75b8-43f6-40f4-aa03-fa351677904f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:10:33 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-f55a8d9b-bd20-4149-bce4-d71639a926d8 tempest-CreateVolumesFromSnapshotTest-501804922 None] Created volume successfully. Sep 04 18:10:33 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ef4f2156-497d-49d2-984f-1c1e16403cc7 tempest-VolumeDependencyTests-1358619200 None] Acquiring lock "cinder-86314efe-d1bb-4d87-b9ee-6f96b17dd8c0-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:10:33 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ef4f2156-497d-49d2-984f-1c1e16403cc7 tempest-VolumeDependencyTests-1358619200 None] Lock "cinder-86314efe-d1bb-4d87-b9ee-6f96b17dd8c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:10:33 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ef4f2156-497d-49d2-984f-1c1e16403cc7 tempest-VolumeDependencyTests-1358619200 None] Acquiring lock "cinder-quobyte-5ab18338-603b-495a-97eb-e7122caa15e0" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:10:33 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ef4f2156-497d-49d2-984f-1c1e16403cc7 tempest-VolumeDependencyTests-1358619200 None] Lock "cinder-quobyte-5ab18338-603b-495a-97eb-e7122caa15e0" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:10:33 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ef4f2156-497d-49d2-984f-1c1e16403cc7 tempest-VolumeDependencyTests-1358619200 None] Acquiring lock "cinder-quobyte-86314efe-d1bb-4d87-b9ee-6f96b17dd8c0" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:10:33 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ef4f2156-497d-49d2-984f-1c1e16403cc7 tempest-VolumeDependencyTests-1358619200 None] Lock "cinder-quobyte-86314efe-d1bb-4d87-b9ee-6f96b17dd8c0" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:10:33 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-ef4f2156-497d-49d2-984f-1c1e16403cc7 tempest-VolumeDependencyTests-1358619200 None] Deleting offline snapshot 86314efe-d1bb-4d87-b9ee-6f96b17dd8c0 of volume 5ab18338-603b-495a-97eb-e7122caa15e0 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 18:10:33 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-ef4f2156-497d-49d2-984f-1c1e16403cc7 tempest-VolumeDependencyTests-1358619200 None] snapshot_file for this snap is: volume-5ab18338-603b-495a-97eb-e7122caa15e0.86314efe-d1bb-4d87-b9ee-6f96b17dd8c0 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 18:10:33 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[df721f86-1d15-442a-81f9-537da0e44a7d]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:10:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ef4f2156-497d-49d2-984f-1c1e16403cc7 tempest-VolumeDependencyTests-1358619200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5ab18338-603b-495a-97eb-e7122caa15e0.86314efe-d1bb-4d87-b9ee-6f96b17dd8c0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:33 devstack sudo[106935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5ab18338-603b-495a-97eb-e7122caa15e0.86314efe-d1bb-4d87-b9ee-6f96b17dd8c0 Sep 04 18:10:33 devstack sudo[106935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:34 devstack sudo[106935]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ef4f2156-497d-49d2-984f-1c1e16403cc7 tempest-VolumeDependencyTests-1358619200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5ab18338-603b-495a-97eb-e7122caa15e0.86314efe-d1bb-4d87-b9ee-6f96b17dd8c0" returned: 0 in 0.400s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:34 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-ef4f2156-497d-49d2-984f-1c1e16403cc7 tempest-VolumeDependencyTests-1358619200 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ab18338-603b-495a-97eb-e7122caa15e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 18:10:34 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[d610e118-6201-4dae-b6a7-5dadd5a645f0]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:10:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ef4f2156-497d-49d2-984f-1c1e16403cc7 tempest-VolumeDependencyTests-1358619200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5ab18338-603b-495a-97eb-e7122caa15e0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-27660789-668e-4a4a-b19f-dcc987170b5f tempest-CreateVolumesFromSnapshotTest-501804922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-27660789-668e-4a4a-b19f-dcc987170b5f tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:34 devstack sudo[106942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5ab18338-603b-495a-97eb-e7122caa15e0 Sep 04 18:10:34 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:34 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-27660789-668e-4a4a-b19f-dcc987170b5f tempest-CreateVolumesFromSnapshotTest-501804922 None] Creating offline snapshot 25152c17-52cb-49ad-9d63-e86076e6d1d0 of volume f4bb0533-7194-4476-893e-276e17d7b84b {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 18:10:34 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[297f000c-e42b-4031-a8af-e2bf4ee9f89d]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:10:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-27660789-668e-4a4a-b19f-dcc987170b5f tempest-CreateVolumesFromSnapshotTest-501804922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f4bb0533-7194-4476-893e-276e17d7b84b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:34 devstack sudo[106944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f4bb0533-7194-4476-893e-276e17d7b84b Sep 04 18:10:34 devstack sudo[106944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:34 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ef4f2156-497d-49d2-984f-1c1e16403cc7 tempest-VolumeDependencyTests-1358619200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5ab18338-603b-495a-97eb-e7122caa15e0" returned: 0 in 0.667s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ef4f2156-497d-49d2-984f-1c1e16403cc7 tempest-VolumeDependencyTests-1358619200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5ab18338-603b-495a-97eb-e7122caa15e0.86314efe-d1bb-4d87-b9ee-6f96b17dd8c0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:34 devstack sudo[106944]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-27660789-668e-4a4a-b19f-dcc987170b5f tempest-CreateVolumesFromSnapshotTest-501804922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f4bb0533-7194-4476-893e-276e17d7b84b" returned: 0 in 0.513s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:34 devstack sudo[106952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5ab18338-603b-495a-97eb-e7122caa15e0.86314efe-d1bb-4d87-b9ee-6f96b17dd8c0 Sep 04 18:10:34 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-27660789-668e-4a4a-b19f-dcc987170b5f tempest-CreateVolumesFromSnapshotTest-501804922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f4bb0533-7194-4476-893e-276e17d7b84b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f4bb0533-7194-4476-893e-276e17d7b84b.25152c17-52cb-49ad-9d63-e86076e6d1d0 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:35 devstack sudo[106954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f4bb0533-7194-4476-893e-276e17d7b84b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f4bb0533-7194-4476-893e-276e17d7b84b.25152c17-52cb-49ad-9d63-e86076e6d1d0 1G Sep 04 18:10:35 devstack sudo[106954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:35 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ef4f2156-497d-49d2-984f-1c1e16403cc7 tempest-VolumeDependencyTests-1358619200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5ab18338-603b-495a-97eb-e7122caa15e0.86314efe-d1bb-4d87-b9ee-6f96b17dd8c0" returned: 0 in 0.452s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ef4f2156-497d-49d2-984f-1c1e16403cc7 tempest-VolumeDependencyTests-1358619200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5ab18338-603b-495a-97eb-e7122caa15e0.86314efe-d1bb-4d87-b9ee-6f96b17dd8c0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:35 devstack sudo[106962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5ab18338-603b-495a-97eb-e7122caa15e0.86314efe-d1bb-4d87-b9ee-6f96b17dd8c0 Sep 04 18:10:35 devstack sudo[106962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:35 devstack sudo[106954]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-27660789-668e-4a4a-b19f-dcc987170b5f tempest-CreateVolumesFromSnapshotTest-501804922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f4bb0533-7194-4476-893e-276e17d7b84b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f4bb0533-7194-4476-893e-276e17d7b84b.25152c17-52cb-49ad-9d63-e86076e6d1d0 1G" returned: 0 in 0.521s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-27660789-668e-4a4a-b19f-dcc987170b5f tempest-CreateVolumesFromSnapshotTest-501804922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4bb0533-7194-4476-893e-276e17d7b84b -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f4bb0533-7194-4476-893e-276e17d7b84b.25152c17-52cb-49ad-9d63-e86076e6d1d0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:35 devstack sudo[106965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4bb0533-7194-4476-893e-276e17d7b84b -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f4bb0533-7194-4476-893e-276e17d7b84b.25152c17-52cb-49ad-9d63-e86076e6d1d0 Sep 04 18:10:35 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:35 devstack sudo[106962]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ef4f2156-497d-49d2-984f-1c1e16403cc7 tempest-VolumeDependencyTests-1358619200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5ab18338-603b-495a-97eb-e7122caa15e0.86314efe-d1bb-4d87-b9ee-6f96b17dd8c0" returned: 0 in 0.291s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:35 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ef4f2156-497d-49d2-984f-1c1e16403cc7 tempest-VolumeDependencyTests-1358619200 None] Lock "cinder-quobyte-86314efe-d1bb-4d87-b9ee-6f96b17dd8c0" released by "_delete_snapshot" :: held 1.942s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:10:35 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ef4f2156-497d-49d2-984f-1c1e16403cc7 tempest-VolumeDependencyTests-1358619200 None] Lock "cinder-quobyte-5ab18338-603b-495a-97eb-e7122caa15e0" released by "delete_snapshot" :: held 1.966s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:10:35 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-ef4f2156-497d-49d2-984f-1c1e16403cc7 tempest-VolumeDependencyTests-1358619200 None] Created reservations ['34e58583-c8f0-49de-8e2c-8ea04c2b8ee0', '40675f36-fb49-4333-b4d3-6dfb135afc6c', 'ef2e9da9-c441-4d84-9ee8-e7d378c5e06e', 'a1cd7713-2c3d-4126-bf35-fed3bb7cc30c'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:10:35 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-27660789-668e-4a4a-b19f-dcc987170b5f tempest-CreateVolumesFromSnapshotTest-501804922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4bb0533-7194-4476-893e-276e17d7b84b -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f4bb0533-7194-4476-893e-276e17d7b84b.25152c17-52cb-49ad-9d63-e86076e6d1d0" returned: 0 in 0.322s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:35 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-27660789-668e-4a4a-b19f-dcc987170b5f tempest-CreateVolumesFromSnapshotTest-501804922 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f4bb0533-7194-4476-893e-276e17d7b84b.25152c17-52cb-49ad-9d63-e86076e6d1d0 is being set with open permissions: ugo+rw Sep 04 18:10:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-27660789-668e-4a4a-b19f-dcc987170b5f tempest-CreateVolumesFromSnapshotTest-501804922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f4bb0533-7194-4476-893e-276e17d7b84b.25152c17-52cb-49ad-9d63-e86076e6d1d0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:35 devstack sudo[106971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f4bb0533-7194-4476-893e-276e17d7b84b.25152c17-52cb-49ad-9d63-e86076e6d1d0 Sep 04 18:10:35 devstack sudo[106971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:35 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-ef4f2156-497d-49d2-984f-1c1e16403cc7 tempest-VolumeDependencyTests-1358619200 None] Delete snapshot completed successfully. Sep 04 18:10:35 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ef4f2156-497d-49d2-984f-1c1e16403cc7 tempest-VolumeDependencyTests-1358619200 None] Lock "cinder-86314efe-d1bb-4d87-b9ee-6f96b17dd8c0-delete_snapshot" released by "delete_snapshot" :: held 2.168s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:10:35 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-94488398-5b2e-4b31-9902-960aed376b16 tempest-VolumeDependencyTests-1358619200 None] Acquiring lock "cinder-5ab18338-603b-495a-97eb-e7122caa15e0-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:10:35 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-94488398-5b2e-4b31-9902-960aed376b16 tempest-VolumeDependencyTests-1358619200 None] Lock "cinder-5ab18338-603b-495a-97eb-e7122caa15e0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:10:36 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-94488398-5b2e-4b31-9902-960aed376b16 tempest-VolumeDependencyTests-1358619200 None] Acquiring lock "cinder-quobyte-5ab18338-603b-495a-97eb-e7122caa15e0" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:10:36 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-94488398-5b2e-4b31-9902-960aed376b16 tempest-VolumeDependencyTests-1358619200 None] Lock "cinder-quobyte-5ab18338-603b-495a-97eb-e7122caa15e0" acquired by "delete_volume" :: waited 0.016s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:10:36 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ed8f39-f768-4175-a084-36715878e658]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:10:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-94488398-5b2e-4b31-9902-960aed376b16 tempest-VolumeDependencyTests-1358619200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5ab18338-603b-495a-97eb-e7122caa15e0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:36 devstack sudo[106971]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-27660789-668e-4a4a-b19f-dcc987170b5f tempest-CreateVolumesFromSnapshotTest-501804922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f4bb0533-7194-4476-893e-276e17d7b84b.25152c17-52cb-49ad-9d63-e86076e6d1d0" returned: 0 in 0.299s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-27660789-668e-4a4a-b19f-dcc987170b5f tempest-CreateVolumesFromSnapshotTest-501804922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f4bb0533-7194-4476-893e-276e17d7b84b.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:36 devstack sudo[106975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f4bb0533-7194-4476-893e-276e17d7b84b.info Sep 04 18:10:36 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:36 devstack sudo[106974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5ab18338-603b-495a-97eb-e7122caa15e0 Sep 04 18:10:36 devstack sudo[106974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:36 devstack sudo[106974]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-94488398-5b2e-4b31-9902-960aed376b16 tempest-VolumeDependencyTests-1358619200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5ab18338-603b-495a-97eb-e7122caa15e0" returned: 0 in 0.396s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-94488398-5b2e-4b31-9902-960aed376b16 tempest-VolumeDependencyTests-1358619200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5ab18338-603b-495a-97eb-e7122caa15e0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:36 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-27660789-668e-4a4a-b19f-dcc987170b5f tempest-CreateVolumesFromSnapshotTest-501804922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f4bb0533-7194-4476-893e-276e17d7b84b.info" returned: 0 in 0.327s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:36 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-27660789-668e-4a4a-b19f-dcc987170b5f tempest-CreateVolumesFromSnapshotTest-501804922 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f4bb0533-7194-4476-893e-276e17d7b84b.info is being set with open permissions: ugo+rw Sep 04 18:10:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-27660789-668e-4a4a-b19f-dcc987170b5f tempest-CreateVolumesFromSnapshotTest-501804922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f4bb0533-7194-4476-893e-276e17d7b84b.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:36 devstack sudo[106983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5ab18338-603b-495a-97eb-e7122caa15e0 Sep 04 18:10:36 devstack sudo[106983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:36 devstack sudo[106984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f4bb0533-7194-4476-893e-276e17d7b84b.info Sep 04 18:10:36 devstack sudo[106984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:36 devstack sudo[106983]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:36 devstack sudo[106984]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-94488398-5b2e-4b31-9902-960aed376b16 tempest-VolumeDependencyTests-1358619200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5ab18338-603b-495a-97eb-e7122caa15e0" returned: 0 in 0.305s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-27660789-668e-4a4a-b19f-dcc987170b5f tempest-CreateVolumesFromSnapshotTest-501804922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f4bb0533-7194-4476-893e-276e17d7b84b.info" returned: 0 in 0.301s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-27660789-668e-4a4a-b19f-dcc987170b5f tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.409s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:36 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-94488398-5b2e-4b31-9902-960aed376b16 tempest-VolumeDependencyTests-1358619200 None] Lock "cinder-quobyte-5ab18338-603b-495a-97eb-e7122caa15e0" released by "delete_volume" :: held 0.802s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:10:36 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-27660789-668e-4a4a-b19f-dcc987170b5f tempest-CreateVolumesFromSnapshotTest-501804922 None] Create snapshot completed successfully Sep 04 18:10:36 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-94488398-5b2e-4b31-9902-960aed376b16 tempest-VolumeDependencyTests-1358619200 None] Created reservations ['48ff5db5-1b37-4316-af44-b5b051f161b9', 'ca60ebf9-2ea1-4970-8ce3-3937aea40508', 'f913bc68-c8e2-4787-ab23-5087ea92eb76', 'feac6a23-61f9-4f03-a940-7520e77e1a6b'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:10:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-94488398-5b2e-4b31-9902-960aed376b16 tempest-VolumeDependencyTests-1358619200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-94488398-5b2e-4b31-9902-960aed376b16 tempest-VolumeDependencyTests-1358619200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-94488398-5b2e-4b31-9902-960aed376b16 tempest-VolumeDependencyTests-1358619200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:10:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-94488398-5b2e-4b31-9902-960aed376b16 tempest-VolumeDependencyTests-1358619200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:10:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-94488398-5b2e-4b31-9902-960aed376b16 tempest-VolumeDependencyTests-1358619200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-94488398-5b2e-4b31-9902-960aed376b16 tempest-VolumeDependencyTests-1358619200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:37 devstack sudo[106989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:10:37 devstack sudo[106989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-28ac0924-e385-4e18-ad87-8486a515c043 tempest-VolumeDependencyTests-1358619200 None] Acquiring lock "cinder-deaa02b5-18e6-4287-aeba-c1750d2ab903-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:10:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-28ac0924-e385-4e18-ad87-8486a515c043 tempest-VolumeDependencyTests-1358619200 None] Lock "cinder-deaa02b5-18e6-4287-aeba-c1750d2ab903-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:10:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-28ac0924-e385-4e18-ad87-8486a515c043 tempest-VolumeDependencyTests-1358619200 None] Acquiring lock "cinder-quobyte-deaa02b5-18e6-4287-aeba-c1750d2ab903" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:10:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-28ac0924-e385-4e18-ad87-8486a515c043 tempest-VolumeDependencyTests-1358619200 None] Lock "cinder-quobyte-deaa02b5-18e6-4287-aeba-c1750d2ab903" acquired by "delete_volume" :: waited 0.032s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:10:37 devstack sudo[106989]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-94488398-5b2e-4b31-9902-960aed376b16 tempest-VolumeDependencyTests-1358619200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.332s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:37 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-94488398-5b2e-4b31-9902-960aed376b16 tempest-VolumeDependencyTests-1358619200 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:10:37 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-94488398-5b2e-4b31-9902-960aed376b16 tempest-VolumeDependencyTests-1358619200 None] Deleted volume successfully. Sep 04 18:10:37 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b570dc0-6964-4d1f-86c9-5622f4bdcea5]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:10:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-28ac0924-e385-4e18-ad87-8486a515c043 tempest-VolumeDependencyTests-1358619200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-deaa02b5-18e6-4287-aeba-c1750d2ab903 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-94488398-5b2e-4b31-9902-960aed376b16 tempest-VolumeDependencyTests-1358619200 None] Lock "cinder-5ab18338-603b-495a-97eb-e7122caa15e0-delete_volume" released by "delete_volume" :: held 1.397s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:10:37 devstack sudo[106992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-deaa02b5-18e6-4287-aeba-c1750d2ab903 Sep 04 18:10:37 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:37 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-28ac0924-e385-4e18-ad87-8486a515c043 tempest-VolumeDependencyTests-1358619200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-deaa02b5-18e6-4287-aeba-c1750d2ab903" returned: 0 in 0.406s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-28ac0924-e385-4e18-ad87-8486a515c043 tempest-VolumeDependencyTests-1358619200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-deaa02b5-18e6-4287-aeba-c1750d2ab903 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:37 devstack sudo[106997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-deaa02b5-18e6-4287-aeba-c1750d2ab903 Sep 04 18:10:37 devstack sudo[106997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:38 devstack sudo[106997]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-28ac0924-e385-4e18-ad87-8486a515c043 tempest-VolumeDependencyTests-1358619200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-deaa02b5-18e6-4287-aeba-c1750d2ab903" returned: 0 in 0.332s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-28ac0924-e385-4e18-ad87-8486a515c043 tempest-VolumeDependencyTests-1358619200 None] Lock "cinder-quobyte-deaa02b5-18e6-4287-aeba-c1750d2ab903" released by "delete_volume" :: held 0.829s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:10:38 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-b945d383-c887-464a-934d-5dfaa6ff75ea tempest-CreateVolumesFromSnapshotTest-501804922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:10:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b945d383-c887-464a-934d-5dfaa6ff75ea tempest-CreateVolumesFromSnapshotTest-501804922 None] Flow 'volume_create_manager' (3d5bbc76-f14a-4d05-913f-efe8ab7d1e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:10:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b945d383-c887-464a-934d-5dfaa6ff75ea tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28398821-ee0f-48da-8851-7d5370398a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b945d383-c887-464a-934d-5dfaa6ff75ea tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28398821-ee0f-48da-8851-7d5370398a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:10:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-301216679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6071cf2e-ddb3-4ede-b7f1-5f1dc3f9e39a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c5d43c4690a4b6d8cb22dc8b00b3c53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:10:38Z,use_quota=True,user_id='2ed632630d734466ba1442018a1079b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b945d383-c887-464a-934d-5dfaa6ff75ea tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e60aed84-a307-4968-9b3e-f8f721c4f31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b945d383-c887-464a-934d-5dfaa6ff75ea tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e60aed84-a307-4968-9b3e-f8f721c4f31d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b945d383-c887-464a-934d-5dfaa6ff75ea tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91db5534-84ca-4f1c-a01b-f63e866b4b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b945d383-c887-464a-934d-5dfaa6ff75ea tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91db5534-84ca-4f1c-a01b-f63e866b4b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6071cf2e-ddb3-4ede-b7f1-5f1dc3f9e39a', 'volume_name': 'volume-6071cf2e-ddb3-4ede-b7f1-5f1dc3f9e39a', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b945d383-c887-464a-934d-5dfaa6ff75ea tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e5ab6ba-ed2d-49cb-bfec-d27ef452cc60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b945d383-c887-464a-934d-5dfaa6ff75ea tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e5ab6ba-ed2d-49cb-bfec-d27ef452cc60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b945d383-c887-464a-934d-5dfaa6ff75ea tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c7efd3d-a963-43ac-be10-62ce0f995b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:38 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-b945d383-c887-464a-934d-5dfaa6ff75ea tempest-CreateVolumesFromSnapshotTest-501804922 None] Volume 6071cf2e-ddb3-4ede-b7f1-5f1dc3f9e39a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6071cf2e-ddb3-4ede-b7f1-5f1dc3f9e39a', 'volume_size': 1} Sep 04 18:10:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b945d383-c887-464a-934d-5dfaa6ff75ea tempest-CreateVolumesFromSnapshotTest-501804922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b945d383-c887-464a-934d-5dfaa6ff75ea tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:38 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b945d383-c887-464a-934d-5dfaa6ff75ea tempest-CreateVolumesFromSnapshotTest-501804922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:10:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-301216679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6071cf2e-ddb3-4ede-b7f1-5f1dc3f9e39a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c5d43c4690a4b6d8cb22dc8b00b3c53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:10:38Z,use_quota=True,user_id='2ed632630d734466ba1442018a1079b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:10:38 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-b945d383-c887-464a-934d-5dfaa6ff75ea tempest-CreateVolumesFromSnapshotTest-501804922 None] Creating volume 6071cf2e-ddb3-4ede-b7f1-5f1dc3f9e39a {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:10:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b945d383-c887-464a-934d-5dfaa6ff75ea tempest-CreateVolumesFromSnapshotTest-501804922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b945d383-c887-464a-934d-5dfaa6ff75ea tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:38 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b945d383-c887-464a-934d-5dfaa6ff75ea tempest-CreateVolumesFromSnapshotTest-501804922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:10:38 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b945d383-c887-464a-934d-5dfaa6ff75ea tempest-CreateVolumesFromSnapshotTest-501804922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:10:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b945d383-c887-464a-934d-5dfaa6ff75ea tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:38 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b945d383-c887-464a-934d-5dfaa6ff75ea tempest-CreateVolumesFromSnapshotTest-501804922 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:10:38 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-b945d383-c887-464a-934d-5dfaa6ff75ea tempest-CreateVolumesFromSnapshotTest-501804922 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:10:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b945d383-c887-464a-934d-5dfaa6ff75ea tempest-CreateVolumesFromSnapshotTest-501804922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6071cf2e-ddb3-4ede-b7f1-5f1dc3f9e39a 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:38 devstack sudo[107000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6071cf2e-ddb3-4ede-b7f1-5f1dc3f9e39a 1073741824 Sep 04 18:10:38 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:38 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-28ac0924-e385-4e18-ad87-8486a515c043 tempest-VolumeDependencyTests-1358619200 None] Created reservations ['1a96c851-4326-4af2-95ef-6a6bf28cf131', 'c39bd6d8-cdc2-4390-8efb-7aa056c71fd4', '647570ac-e7ca-4a90-abf6-4e310e8b93cb', '9693cc55-9e2f-447f-ba69-b39b700cbdb1'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:10:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-28ac0924-e385-4e18-ad87-8486a515c043 tempest-VolumeDependencyTests-1358619200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-28ac0924-e385-4e18-ad87-8486a515c043 tempest-VolumeDependencyTests-1358619200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:38 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-28ac0924-e385-4e18-ad87-8486a515c043 tempest-VolumeDependencyTests-1358619200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:10:38 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-28ac0924-e385-4e18-ad87-8486a515c043 tempest-VolumeDependencyTests-1358619200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:10:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-28ac0924-e385-4e18-ad87-8486a515c043 tempest-VolumeDependencyTests-1358619200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-28ac0924-e385-4e18-ad87-8486a515c043 tempest-VolumeDependencyTests-1358619200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:38 devstack sudo[107002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:10:38 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:38 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8d53bc3-fbd2-4dfd-8981-6d3cc1d1a544 tempest-CreateVolumesFromSnapshotTest-501804922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:10:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b8d53bc3-fbd2-4dfd-8981-6d3cc1d1a544 tempest-CreateVolumesFromSnapshotTest-501804922 None] Flow 'volume_create_manager' (702400fb-c930-4e52-a119-66f24d6c2c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:10:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b8d53bc3-fbd2-4dfd-8981-6d3cc1d1a544 tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (472b3fd4-b8a3-4fa9-8b04-017a25ffc487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b8d53bc3-fbd2-4dfd-8981-6d3cc1d1a544 tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (472b3fd4-b8a3-4fa9-8b04-017a25ffc487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:10:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-751689036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7460b340-c5df-4753-8dd7-2de52f703f3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c5d43c4690a4b6d8cb22dc8b00b3c53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:10:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:10:39Z,use_quota=True,user_id='2ed632630d734466ba1442018a1079b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b8d53bc3-fbd2-4dfd-8981-6d3cc1d1a544 tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92dd8c4f-4df6-46f9-a69b-9acab1394498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b8d53bc3-fbd2-4dfd-8981-6d3cc1d1a544 tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92dd8c4f-4df6-46f9-a69b-9acab1394498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:38 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b8d53bc3-fbd2-4dfd-8981-6d3cc1d1a544 tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e9f95f9-83ae-49d3-8824-39998e4fad95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b8d53bc3-fbd2-4dfd-8981-6d3cc1d1a544 tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e9f95f9-83ae-49d3-8824-39998e4fad95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7460b340-c5df-4753-8dd7-2de52f703f3d', 'volume_name': 'volume-7460b340-c5df-4753-8dd7-2de52f703f3d', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b8d53bc3-fbd2-4dfd-8981-6d3cc1d1a544 tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aac5706c-0061-4233-b2ca-91b1ebba8cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b8d53bc3-fbd2-4dfd-8981-6d3cc1d1a544 tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aac5706c-0061-4233-b2ca-91b1ebba8cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:38 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b8d53bc3-fbd2-4dfd-8981-6d3cc1d1a544 tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (577199de-d7fe-420d-8954-43541cebe310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:38 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:38 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-b8d53bc3-fbd2-4dfd-8981-6d3cc1d1a544 tempest-CreateVolumesFromSnapshotTest-501804922 None] Volume 7460b340-c5df-4753-8dd7-2de52f703f3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7460b340-c5df-4753-8dd7-2de52f703f3d', 'volume_size': 1} Sep 04 18:10:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b8d53bc3-fbd2-4dfd-8981-6d3cc1d1a544 tempest-CreateVolumesFromSnapshotTest-501804922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b945d383-c887-464a-934d-5dfaa6ff75ea tempest-CreateVolumesFromSnapshotTest-501804922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6071cf2e-ddb3-4ede-b7f1-5f1dc3f9e39a 1073741824" returned: 0 in 0.649s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-28ac0924-e385-4e18-ad87-8486a515c043 tempest-VolumeDependencyTests-1358619200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.411s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:38 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-28ac0924-e385-4e18-ad87-8486a515c043 tempest-VolumeDependencyTests-1358619200 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:10:38 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-28ac0924-e385-4e18-ad87-8486a515c043 tempest-VolumeDependencyTests-1358619200 None] Deleted volume successfully. Sep 04 18:10:39 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-28ac0924-e385-4e18-ad87-8486a515c043 tempest-VolumeDependencyTests-1358619200 None] Lock "cinder-deaa02b5-18e6-4287-aeba-c1750d2ab903-delete_volume" released by "delete_volume" :: held 1.811s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:10:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b945d383-c887-464a-934d-5dfaa6ff75ea tempest-CreateVolumesFromSnapshotTest-501804922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6071cf2e-ddb3-4ede-b7f1-5f1dc3f9e39a {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:39 devstack sudo[107010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6071cf2e-ddb3-4ede-b7f1-5f1dc3f9e39a Sep 04 18:10:39 devstack sudo[107010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:39 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c54d8d4-82ff-49be-a612-5aca5c6e0bf0 tempest-CreateVolumesFromSnapshotTest-501804922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:10:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7c54d8d4-82ff-49be-a612-5aca5c6e0bf0 tempest-CreateVolumesFromSnapshotTest-501804922 None] Flow 'volume_create_manager' (e9d11da0-602e-4e49-b4f2-b5a9b6543f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:10:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7c54d8d4-82ff-49be-a612-5aca5c6e0bf0 tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d444d17e-c3cb-49e2-965f-83c1fa143cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7c54d8d4-82ff-49be-a612-5aca5c6e0bf0 tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d444d17e-c3cb-49e2-965f-83c1fa143cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:10:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-572137340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4284b0a2-6648-4d46-b977-ac45ad73b5d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c5d43c4690a4b6d8cb22dc8b00b3c53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:10:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:10:39Z,use_quota=True,user_id='2ed632630d734466ba1442018a1079b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7c54d8d4-82ff-49be-a612-5aca5c6e0bf0 tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a62c31f3-fb4d-4035-9d1e-3e008c5596f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7c54d8d4-82ff-49be-a612-5aca5c6e0bf0 tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a62c31f3-fb4d-4035-9d1e-3e008c5596f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7c54d8d4-82ff-49be-a612-5aca5c6e0bf0 tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d2c2012-b855-4582-a6d6-fafe67e173ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7c54d8d4-82ff-49be-a612-5aca5c6e0bf0 tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d2c2012-b855-4582-a6d6-fafe67e173ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4284b0a2-6648-4d46-b977-ac45ad73b5d0', 'volume_name': 'volume-4284b0a2-6648-4d46-b977-ac45ad73b5d0', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7c54d8d4-82ff-49be-a612-5aca5c6e0bf0 tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95005e96-b587-4038-bf32-9dba9c3ee2f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7c54d8d4-82ff-49be-a612-5aca5c6e0bf0 tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95005e96-b587-4038-bf32-9dba9c3ee2f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7c54d8d4-82ff-49be-a612-5aca5c6e0bf0 tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c611cd89-3dc1-4a16-b266-77cdcb3db921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:39 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-7c54d8d4-82ff-49be-a612-5aca5c6e0bf0 tempest-CreateVolumesFromSnapshotTest-501804922 None] Volume 4284b0a2-6648-4d46-b977-ac45ad73b5d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4284b0a2-6648-4d46-b977-ac45ad73b5d0', 'volume_size': 1} Sep 04 18:10:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7c54d8d4-82ff-49be-a612-5aca5c6e0bf0 tempest-CreateVolumesFromSnapshotTest-501804922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:39 devstack sudo[107010]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b945d383-c887-464a-934d-5dfaa6ff75ea tempest-CreateVolumesFromSnapshotTest-501804922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6071cf2e-ddb3-4ede-b7f1-5f1dc3f9e39a" returned: 0 in 0.401s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b945d383-c887-464a-934d-5dfaa6ff75ea tempest-CreateVolumesFromSnapshotTest-501804922 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:10:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b945d383-c887-464a-934d-5dfaa6ff75ea tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b8d53bc3-fbd2-4dfd-8981-6d3cc1d1a544 tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.469s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b8d53bc3-fbd2-4dfd-8981-6d3cc1d1a544 tempest-CreateVolumesFromSnapshotTest-501804922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:10:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-751689036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7460b340-c5df-4753-8dd7-2de52f703f3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c5d43c4690a4b6d8cb22dc8b00b3c53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:10:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:10:39Z,use_quota=True,user_id='2ed632630d734466ba1442018a1079b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:10:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-b8d53bc3-fbd2-4dfd-8981-6d3cc1d1a544 tempest-CreateVolumesFromSnapshotTest-501804922 None] Creating volume 7460b340-c5df-4753-8dd7-2de52f703f3d {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:10:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b8d53bc3-fbd2-4dfd-8981-6d3cc1d1a544 tempest-CreateVolumesFromSnapshotTest-501804922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b8d53bc3-fbd2-4dfd-8981-6d3cc1d1a544 tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b8d53bc3-fbd2-4dfd-8981-6d3cc1d1a544 tempest-CreateVolumesFromSnapshotTest-501804922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:10:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b8d53bc3-fbd2-4dfd-8981-6d3cc1d1a544 tempest-CreateVolumesFromSnapshotTest-501804922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:10:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b8d53bc3-fbd2-4dfd-8981-6d3cc1d1a544 tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b8d53bc3-fbd2-4dfd-8981-6d3cc1d1a544 tempest-CreateVolumesFromSnapshotTest-501804922 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:10:39 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-b8d53bc3-fbd2-4dfd-8981-6d3cc1d1a544 tempest-CreateVolumesFromSnapshotTest-501804922 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:10:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b8d53bc3-fbd2-4dfd-8981-6d3cc1d1a544 tempest-CreateVolumesFromSnapshotTest-501804922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7460b340-c5df-4753-8dd7-2de52f703f3d 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b945d383-c887-464a-934d-5dfaa6ff75ea tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c7efd3d-a963-43ac-be10-62ce0f995b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6071cf2e-ddb3-4ede-b7f1-5f1dc3f9e39a', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b945d383-c887-464a-934d-5dfaa6ff75ea tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5310611f-3c80-4615-9366-96626850e3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:39 devstack sudo[107013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7460b340-c5df-4753-8dd7-2de52f703f3d 1073741824 Sep 04 18:10:39 devstack sudo[107013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:39 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-b945d383-c887-464a-934d-5dfaa6ff75ea tempest-CreateVolumesFromSnapshotTest-501804922 None] Volume volume-6071cf2e-ddb3-4ede-b7f1-5f1dc3f9e39a (6071cf2e-ddb3-4ede-b7f1-5f1dc3f9e39a): created successfully Sep 04 18:10:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b945d383-c887-464a-934d-5dfaa6ff75ea tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5310611f-3c80-4615-9366-96626850e3b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b945d383-c887-464a-934d-5dfaa6ff75ea tempest-CreateVolumesFromSnapshotTest-501804922 None] Flow 'volume_create_manager' (3d5bbc76-f14a-4d05-913f-efe8ab7d1e8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:10:39 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-b945d383-c887-464a-934d-5dfaa6ff75ea tempest-CreateVolumesFromSnapshotTest-501804922 None] Created volume successfully. Sep 04 18:10:39 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-b84d1ad0-0856-48e1-9770-2e3af1fdcc19 tempest-CreateVolumesFromSnapshotTest-501804922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:10:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b84d1ad0-0856-48e1-9770-2e3af1fdcc19 tempest-CreateVolumesFromSnapshotTest-501804922 None] Flow 'volume_create_manager' (d2e944eb-41f0-4ed4-a0a8-b7ae939a9edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:10:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b84d1ad0-0856-48e1-9770-2e3af1fdcc19 tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5df5b66-7953-4858-b549-a66a6262fef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b84d1ad0-0856-48e1-9770-2e3af1fdcc19 tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5df5b66-7953-4858-b549-a66a6262fef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:10:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1742394212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95aa5840-74fb-49b8-958e-060092f9b71b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c5d43c4690a4b6d8cb22dc8b00b3c53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:10:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:10:40Z,use_quota=True,user_id='2ed632630d734466ba1442018a1079b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b84d1ad0-0856-48e1-9770-2e3af1fdcc19 tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e04d7cef-8a2a-43df-8a38-c03f16f0d334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b84d1ad0-0856-48e1-9770-2e3af1fdcc19 tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e04d7cef-8a2a-43df-8a38-c03f16f0d334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b84d1ad0-0856-48e1-9770-2e3af1fdcc19 tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e7a362d-746a-4158-a0e5-2ecea4091f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b84d1ad0-0856-48e1-9770-2e3af1fdcc19 tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e7a362d-746a-4158-a0e5-2ecea4091f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95aa5840-74fb-49b8-958e-060092f9b71b', 'volume_name': 'volume-95aa5840-74fb-49b8-958e-060092f9b71b', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b84d1ad0-0856-48e1-9770-2e3af1fdcc19 tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfeac176-524f-4e45-b9be-7d6000c19aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b84d1ad0-0856-48e1-9770-2e3af1fdcc19 tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfeac176-524f-4e45-b9be-7d6000c19aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b84d1ad0-0856-48e1-9770-2e3af1fdcc19 tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b02c6852-b273-4103-9747-5964b88a83eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:39 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-b84d1ad0-0856-48e1-9770-2e3af1fdcc19 tempest-CreateVolumesFromSnapshotTest-501804922 None] Volume 95aa5840-74fb-49b8-958e-060092f9b71b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95aa5840-74fb-49b8-958e-060092f9b71b', 'volume_size': 1} Sep 04 18:10:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b84d1ad0-0856-48e1-9770-2e3af1fdcc19 tempest-CreateVolumesFromSnapshotTest-501804922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:40 devstack sudo[107013]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b8d53bc3-fbd2-4dfd-8981-6d3cc1d1a544 tempest-CreateVolumesFromSnapshotTest-501804922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7460b340-c5df-4753-8dd7-2de52f703f3d 1073741824" returned: 0 in 0.708s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b8d53bc3-fbd2-4dfd-8981-6d3cc1d1a544 tempest-CreateVolumesFromSnapshotTest-501804922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7460b340-c5df-4753-8dd7-2de52f703f3d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:40 devstack sudo[107018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7460b340-c5df-4753-8dd7-2de52f703f3d Sep 04 18:10:40 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:40 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-307754fc-187c-4c44-91ae-0b3538916b88 tempest-CreateVolumesFromSnapshotTest-501804922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:10:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-307754fc-187c-4c44-91ae-0b3538916b88 tempest-CreateVolumesFromSnapshotTest-501804922 None] Flow 'volume_create_manager' (97ea323e-5776-4e7d-b62c-fb7b7fd2d351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:10:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-307754fc-187c-4c44-91ae-0b3538916b88 tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2298633-515f-4bb8-bda3-93d089bb819b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-307754fc-187c-4c44-91ae-0b3538916b88 tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2298633-515f-4bb8-bda3-93d089bb819b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:10:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1196313209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1737719-fd2a-4022-95b2-2d4c73a4b344,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c5d43c4690a4b6d8cb22dc8b00b3c53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:10:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:10:40Z,use_quota=True,user_id='2ed632630d734466ba1442018a1079b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-307754fc-187c-4c44-91ae-0b3538916b88 tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60a742e5-c788-4390-a5cc-a2881ad72b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-307754fc-187c-4c44-91ae-0b3538916b88 tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60a742e5-c788-4390-a5cc-a2881ad72b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-307754fc-187c-4c44-91ae-0b3538916b88 tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9463134c-93c8-433a-907d-9c0ea9dac119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:40 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-307754fc-187c-4c44-91ae-0b3538916b88 tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9463134c-93c8-433a-907d-9c0ea9dac119) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1737719-fd2a-4022-95b2-2d4c73a4b344', 'volume_name': 'volume-a1737719-fd2a-4022-95b2-2d4c73a4b344', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-307754fc-187c-4c44-91ae-0b3538916b88 tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ecff01b-98c8-4dbd-abbb-c349b78f87a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-307754fc-187c-4c44-91ae-0b3538916b88 tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ecff01b-98c8-4dbd-abbb-c349b78f87a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-307754fc-187c-4c44-91ae-0b3538916b88 tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de3bc554-aa9e-46af-9bbc-c252ce846ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:40 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-307754fc-187c-4c44-91ae-0b3538916b88 tempest-CreateVolumesFromSnapshotTest-501804922 None] Volume a1737719-fd2a-4022-95b2-2d4c73a4b344: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1737719-fd2a-4022-95b2-2d4c73a4b344', 'volume_size': 1} Sep 04 18:10:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-307754fc-187c-4c44-91ae-0b3538916b88 tempest-CreateVolumesFromSnapshotTest-501804922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b8d53bc3-fbd2-4dfd-8981-6d3cc1d1a544 tempest-CreateVolumesFromSnapshotTest-501804922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7460b340-c5df-4753-8dd7-2de52f703f3d" returned: 0 in 0.361s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b8d53bc3-fbd2-4dfd-8981-6d3cc1d1a544 tempest-CreateVolumesFromSnapshotTest-501804922 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:10:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b8d53bc3-fbd2-4dfd-8981-6d3cc1d1a544 tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7c54d8d4-82ff-49be-a612-5aca5c6e0bf0 tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.176s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7c54d8d4-82ff-49be-a612-5aca5c6e0bf0 tempest-CreateVolumesFromSnapshotTest-501804922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:10:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-572137340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4284b0a2-6648-4d46-b977-ac45ad73b5d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c5d43c4690a4b6d8cb22dc8b00b3c53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:10:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:10:39Z,use_quota=True,user_id='2ed632630d734466ba1442018a1079b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:10:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-7c54d8d4-82ff-49be-a612-5aca5c6e0bf0 tempest-CreateVolumesFromSnapshotTest-501804922 None] Creating volume 4284b0a2-6648-4d46-b977-ac45ad73b5d0 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:10:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7c54d8d4-82ff-49be-a612-5aca5c6e0bf0 tempest-CreateVolumesFromSnapshotTest-501804922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7c54d8d4-82ff-49be-a612-5aca5c6e0bf0 tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7c54d8d4-82ff-49be-a612-5aca5c6e0bf0 tempest-CreateVolumesFromSnapshotTest-501804922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:10:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7c54d8d4-82ff-49be-a612-5aca5c6e0bf0 tempest-CreateVolumesFromSnapshotTest-501804922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:10:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7c54d8d4-82ff-49be-a612-5aca5c6e0bf0 tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7c54d8d4-82ff-49be-a612-5aca5c6e0bf0 tempest-CreateVolumesFromSnapshotTest-501804922 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:10:40 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-7c54d8d4-82ff-49be-a612-5aca5c6e0bf0 tempest-CreateVolumesFromSnapshotTest-501804922 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:10:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7c54d8d4-82ff-49be-a612-5aca5c6e0bf0 tempest-CreateVolumesFromSnapshotTest-501804922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4284b0a2-6648-4d46-b977-ac45ad73b5d0 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b8d53bc3-fbd2-4dfd-8981-6d3cc1d1a544 tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (577199de-d7fe-420d-8954-43541cebe310) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7460b340-c5df-4753-8dd7-2de52f703f3d', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:40 devstack sudo[107021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4284b0a2-6648-4d46-b977-ac45ad73b5d0 1073741824 Sep 04 18:10:40 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b8d53bc3-fbd2-4dfd-8981-6d3cc1d1a544 tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de8d41c5-4ae9-4b98-a0e8-a91b9f7eb66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:40 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-b8d53bc3-fbd2-4dfd-8981-6d3cc1d1a544 tempest-CreateVolumesFromSnapshotTest-501804922 None] Volume volume-7460b340-c5df-4753-8dd7-2de52f703f3d (7460b340-c5df-4753-8dd7-2de52f703f3d): created successfully Sep 04 18:10:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b8d53bc3-fbd2-4dfd-8981-6d3cc1d1a544 tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de8d41c5-4ae9-4b98-a0e8-a91b9f7eb66c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b8d53bc3-fbd2-4dfd-8981-6d3cc1d1a544 tempest-CreateVolumesFromSnapshotTest-501804922 None] Flow 'volume_create_manager' (702400fb-c930-4e52-a119-66f24d6c2c57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:10:40 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-b8d53bc3-fbd2-4dfd-8981-6d3cc1d1a544 tempest-CreateVolumesFromSnapshotTest-501804922 None] Created volume successfully. Sep 04 18:10:41 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7c54d8d4-82ff-49be-a612-5aca5c6e0bf0 tempest-CreateVolumesFromSnapshotTest-501804922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4284b0a2-6648-4d46-b977-ac45ad73b5d0 1073741824" returned: 0 in 0.599s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7c54d8d4-82ff-49be-a612-5aca5c6e0bf0 tempest-CreateVolumesFromSnapshotTest-501804922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4284b0a2-6648-4d46-b977-ac45ad73b5d0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:41 devstack sudo[107026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4284b0a2-6648-4d46-b977-ac45ad73b5d0 Sep 04 18:10:41 devstack sudo[107026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:41 devstack sudo[107026]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7c54d8d4-82ff-49be-a612-5aca5c6e0bf0 tempest-CreateVolumesFromSnapshotTest-501804922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4284b0a2-6648-4d46-b977-ac45ad73b5d0" returned: 0 in 0.396s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:41 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7c54d8d4-82ff-49be-a612-5aca5c6e0bf0 tempest-CreateVolumesFromSnapshotTest-501804922 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:10:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7c54d8d4-82ff-49be-a612-5aca5c6e0bf0 tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b84d1ad0-0856-48e1-9770-2e3af1fdcc19 tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.696s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:41 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b84d1ad0-0856-48e1-9770-2e3af1fdcc19 tempest-CreateVolumesFromSnapshotTest-501804922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:10:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1742394212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95aa5840-74fb-49b8-958e-060092f9b71b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c5d43c4690a4b6d8cb22dc8b00b3c53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:10:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:10:40Z,use_quota=True,user_id='2ed632630d734466ba1442018a1079b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:10:41 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-b84d1ad0-0856-48e1-9770-2e3af1fdcc19 tempest-CreateVolumesFromSnapshotTest-501804922 None] Creating volume 95aa5840-74fb-49b8-958e-060092f9b71b {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:10:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b84d1ad0-0856-48e1-9770-2e3af1fdcc19 tempest-CreateVolumesFromSnapshotTest-501804922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b84d1ad0-0856-48e1-9770-2e3af1fdcc19 tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:41 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b84d1ad0-0856-48e1-9770-2e3af1fdcc19 tempest-CreateVolumesFromSnapshotTest-501804922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:10:41 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b84d1ad0-0856-48e1-9770-2e3af1fdcc19 tempest-CreateVolumesFromSnapshotTest-501804922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:10:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b84d1ad0-0856-48e1-9770-2e3af1fdcc19 tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:41 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b84d1ad0-0856-48e1-9770-2e3af1fdcc19 tempest-CreateVolumesFromSnapshotTest-501804922 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:10:41 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-b84d1ad0-0856-48e1-9770-2e3af1fdcc19 tempest-CreateVolumesFromSnapshotTest-501804922 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:10:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b84d1ad0-0856-48e1-9770-2e3af1fdcc19 tempest-CreateVolumesFromSnapshotTest-501804922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-95aa5840-74fb-49b8-958e-060092f9b71b 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7c54d8d4-82ff-49be-a612-5aca5c6e0bf0 tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c611cd89-3dc1-4a16-b266-77cdcb3db921) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4284b0a2-6648-4d46-b977-ac45ad73b5d0', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7c54d8d4-82ff-49be-a612-5aca5c6e0bf0 tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d66cf667-0cec-4e91-8e6f-7147dec086f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:41 devstack sudo[107029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-95aa5840-74fb-49b8-958e-060092f9b71b 1073741824 Sep 04 18:10:41 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:41 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-7c54d8d4-82ff-49be-a612-5aca5c6e0bf0 tempest-CreateVolumesFromSnapshotTest-501804922 None] Volume volume-4284b0a2-6648-4d46-b977-ac45ad73b5d0 (4284b0a2-6648-4d46-b977-ac45ad73b5d0): created successfully Sep 04 18:10:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7c54d8d4-82ff-49be-a612-5aca5c6e0bf0 tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d66cf667-0cec-4e91-8e6f-7147dec086f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-7c54d8d4-82ff-49be-a612-5aca5c6e0bf0 tempest-CreateVolumesFromSnapshotTest-501804922 None] Flow 'volume_create_manager' (e9d11da0-602e-4e49-b4f2-b5a9b6543f2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:10:41 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-7c54d8d4-82ff-49be-a612-5aca5c6e0bf0 tempest-CreateVolumesFromSnapshotTest-501804922 None] Created volume successfully. Sep 04 18:10:42 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b84d1ad0-0856-48e1-9770-2e3af1fdcc19 tempest-CreateVolumesFromSnapshotTest-501804922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-95aa5840-74fb-49b8-958e-060092f9b71b 1073741824" returned: 0 in 0.682s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b84d1ad0-0856-48e1-9770-2e3af1fdcc19 tempest-CreateVolumesFromSnapshotTest-501804922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-95aa5840-74fb-49b8-958e-060092f9b71b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:42 devstack sudo[107035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-95aa5840-74fb-49b8-958e-060092f9b71b Sep 04 18:10:42 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:42 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b84d1ad0-0856-48e1-9770-2e3af1fdcc19 tempest-CreateVolumesFromSnapshotTest-501804922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-95aa5840-74fb-49b8-958e-060092f9b71b" returned: 0 in 0.433s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:42 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b84d1ad0-0856-48e1-9770-2e3af1fdcc19 tempest-CreateVolumesFromSnapshotTest-501804922 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:10:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b84d1ad0-0856-48e1-9770-2e3af1fdcc19 tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-307754fc-187c-4c44-91ae-0b3538916b88 tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.259s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:42 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-307754fc-187c-4c44-91ae-0b3538916b88 tempest-CreateVolumesFromSnapshotTest-501804922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:10:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1196313209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1737719-fd2a-4022-95b2-2d4c73a4b344,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c5d43c4690a4b6d8cb22dc8b00b3c53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:10:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:10:40Z,use_quota=True,user_id='2ed632630d734466ba1442018a1079b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:10:42 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-307754fc-187c-4c44-91ae-0b3538916b88 tempest-CreateVolumesFromSnapshotTest-501804922 None] Creating volume a1737719-fd2a-4022-95b2-2d4c73a4b344 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:10:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-307754fc-187c-4c44-91ae-0b3538916b88 tempest-CreateVolumesFromSnapshotTest-501804922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-307754fc-187c-4c44-91ae-0b3538916b88 tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:42 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-307754fc-187c-4c44-91ae-0b3538916b88 tempest-CreateVolumesFromSnapshotTest-501804922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:10:42 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-307754fc-187c-4c44-91ae-0b3538916b88 tempest-CreateVolumesFromSnapshotTest-501804922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:10:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-307754fc-187c-4c44-91ae-0b3538916b88 tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:42 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-307754fc-187c-4c44-91ae-0b3538916b88 tempest-CreateVolumesFromSnapshotTest-501804922 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:10:42 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-307754fc-187c-4c44-91ae-0b3538916b88 tempest-CreateVolumesFromSnapshotTest-501804922 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:10:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-307754fc-187c-4c44-91ae-0b3538916b88 tempest-CreateVolumesFromSnapshotTest-501804922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a1737719-fd2a-4022-95b2-2d4c73a4b344 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:42 devstack sudo[107038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a1737719-fd2a-4022-95b2-2d4c73a4b344 1073741824 Sep 04 18:10:42 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:42 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b84d1ad0-0856-48e1-9770-2e3af1fdcc19 tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b02c6852-b273-4103-9747-5964b88a83eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95aa5840-74fb-49b8-958e-060092f9b71b', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:42 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b84d1ad0-0856-48e1-9770-2e3af1fdcc19 tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e4dd1d1-3f43-4594-96c9-30bc2fca0802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:42 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-b84d1ad0-0856-48e1-9770-2e3af1fdcc19 tempest-CreateVolumesFromSnapshotTest-501804922 None] Volume volume-95aa5840-74fb-49b8-958e-060092f9b71b (95aa5840-74fb-49b8-958e-060092f9b71b): created successfully Sep 04 18:10:42 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b84d1ad0-0856-48e1-9770-2e3af1fdcc19 tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e4dd1d1-3f43-4594-96c9-30bc2fca0802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:42 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b84d1ad0-0856-48e1-9770-2e3af1fdcc19 tempest-CreateVolumesFromSnapshotTest-501804922 None] Flow 'volume_create_manager' (d2e944eb-41f0-4ed4-a0a8-b7ae939a9edb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:10:42 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-b84d1ad0-0856-48e1-9770-2e3af1fdcc19 tempest-CreateVolumesFromSnapshotTest-501804922 None] Created volume successfully. Sep 04 18:10:43 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-307754fc-187c-4c44-91ae-0b3538916b88 tempest-CreateVolumesFromSnapshotTest-501804922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a1737719-fd2a-4022-95b2-2d4c73a4b344 1073741824" returned: 0 in 0.699s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-307754fc-187c-4c44-91ae-0b3538916b88 tempest-CreateVolumesFromSnapshotTest-501804922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a1737719-fd2a-4022-95b2-2d4c73a4b344 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:43 devstack sudo[107044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a1737719-fd2a-4022-95b2-2d4c73a4b344 Sep 04 18:10:43 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:43 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-307754fc-187c-4c44-91ae-0b3538916b88 tempest-CreateVolumesFromSnapshotTest-501804922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a1737719-fd2a-4022-95b2-2d4c73a4b344" returned: 0 in 0.350s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:43 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-307754fc-187c-4c44-91ae-0b3538916b88 tempest-CreateVolumesFromSnapshotTest-501804922 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:10:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-307754fc-187c-4c44-91ae-0b3538916b88 tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:43 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-307754fc-187c-4c44-91ae-0b3538916b88 tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de3bc554-aa9e-46af-9bbc-c252ce846ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1737719-fd2a-4022-95b2-2d4c73a4b344', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:43 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-307754fc-187c-4c44-91ae-0b3538916b88 tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c229e28-43df-4931-bce1-ca028100c042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:44 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-307754fc-187c-4c44-91ae-0b3538916b88 tempest-CreateVolumesFromSnapshotTest-501804922 None] Volume volume-a1737719-fd2a-4022-95b2-2d4c73a4b344 (a1737719-fd2a-4022-95b2-2d4c73a4b344): created successfully Sep 04 18:10:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-307754fc-187c-4c44-91ae-0b3538916b88 tempest-CreateVolumesFromSnapshotTest-501804922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c229e28-43df-4931-bce1-ca028100c042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:44 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-307754fc-187c-4c44-91ae-0b3538916b88 tempest-CreateVolumesFromSnapshotTest-501804922 None] Flow 'volume_create_manager' (97ea323e-5776-4e7d-b62c-fb7b7fd2d351) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:10:44 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-307754fc-187c-4c44-91ae-0b3538916b88 tempest-CreateVolumesFromSnapshotTest-501804922 None] Created volume successfully. Sep 04 18:10:45 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-de72e07e-2214-4edc-963c-0e714936d5fe tempest-CreateVolumesFromSnapshotTest-501804922 None] Acquiring lock "cinder-a1737719-fd2a-4022-95b2-2d4c73a4b344-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:10:45 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-de72e07e-2214-4edc-963c-0e714936d5fe tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "cinder-a1737719-fd2a-4022-95b2-2d4c73a4b344-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:10:45 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-de72e07e-2214-4edc-963c-0e714936d5fe tempest-CreateVolumesFromSnapshotTest-501804922 None] Acquiring lock "cinder-quobyte-a1737719-fd2a-4022-95b2-2d4c73a4b344" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:10:45 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-de72e07e-2214-4edc-963c-0e714936d5fe tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "cinder-quobyte-a1737719-fd2a-4022-95b2-2d4c73a4b344" acquired by "delete_volume" :: waited 0.017s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:10:45 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe17dfd-319c-4b21-85fe-185132c3fe20]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:10:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-de72e07e-2214-4edc-963c-0e714936d5fe tempest-CreateVolumesFromSnapshotTest-501804922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a1737719-fd2a-4022-95b2-2d4c73a4b344 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:45 devstack sudo[107048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a1737719-fd2a-4022-95b2-2d4c73a4b344 Sep 04 18:10:45 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:45 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-de72e07e-2214-4edc-963c-0e714936d5fe tempest-CreateVolumesFromSnapshotTest-501804922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a1737719-fd2a-4022-95b2-2d4c73a4b344" returned: 0 in 0.453s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-de72e07e-2214-4edc-963c-0e714936d5fe tempest-CreateVolumesFromSnapshotTest-501804922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a1737719-fd2a-4022-95b2-2d4c73a4b344 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:45 devstack sudo[107053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a1737719-fd2a-4022-95b2-2d4c73a4b344 Sep 04 18:10:45 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:46 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-de72e07e-2214-4edc-963c-0e714936d5fe tempest-CreateVolumesFromSnapshotTest-501804922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a1737719-fd2a-4022-95b2-2d4c73a4b344" returned: 0 in 0.293s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:46 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-de72e07e-2214-4edc-963c-0e714936d5fe tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "cinder-quobyte-a1737719-fd2a-4022-95b2-2d4c73a4b344" released by "delete_volume" :: held 0.803s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:10:46 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-de72e07e-2214-4edc-963c-0e714936d5fe tempest-CreateVolumesFromSnapshotTest-501804922 None] Created reservations ['88941520-6f7a-49f6-b6ed-d3fea2d9da37', '50b88704-7f23-4456-abc0-a23db070ec1e', '5fefb473-e7b3-4264-b265-524e7544fe0c', 'eccac28d-ef31-4dff-8436-5fb9f6e762a8'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:10:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-de72e07e-2214-4edc-963c-0e714936d5fe tempest-CreateVolumesFromSnapshotTest-501804922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-de72e07e-2214-4edc-963c-0e714936d5fe tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:46 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-de72e07e-2214-4edc-963c-0e714936d5fe tempest-CreateVolumesFromSnapshotTest-501804922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:10:46 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-de72e07e-2214-4edc-963c-0e714936d5fe tempest-CreateVolumesFromSnapshotTest-501804922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:10:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-de72e07e-2214-4edc-963c-0e714936d5fe tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-de72e07e-2214-4edc-963c-0e714936d5fe tempest-CreateVolumesFromSnapshotTest-501804922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:46 devstack sudo[107056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:10:46 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:46 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ee24d362-d413-48a1-9829-4d0d0ab1376d tempest-CreateVolumesFromSnapshotTest-501804922 None] Acquiring lock "cinder-95aa5840-74fb-49b8-958e-060092f9b71b-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:10:46 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ee24d362-d413-48a1-9829-4d0d0ab1376d tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "cinder-95aa5840-74fb-49b8-958e-060092f9b71b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:10:46 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ee24d362-d413-48a1-9829-4d0d0ab1376d tempest-CreateVolumesFromSnapshotTest-501804922 None] Acquiring lock "cinder-quobyte-95aa5840-74fb-49b8-958e-060092f9b71b" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:10:46 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ee24d362-d413-48a1-9829-4d0d0ab1376d tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "cinder-quobyte-95aa5840-74fb-49b8-958e-060092f9b71b" acquired by "delete_volume" :: waited 0.015s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:10:46 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[21df6d7f-c899-421b-bb9b-1e445975c8de]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:10:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ee24d362-d413-48a1-9829-4d0d0ab1376d tempest-CreateVolumesFromSnapshotTest-501804922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-95aa5840-74fb-49b8-958e-060092f9b71b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:46 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-de72e07e-2214-4edc-963c-0e714936d5fe tempest-CreateVolumesFromSnapshotTest-501804922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.415s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:46 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-de72e07e-2214-4edc-963c-0e714936d5fe tempest-CreateVolumesFromSnapshotTest-501804922 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:10:46 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-de72e07e-2214-4edc-963c-0e714936d5fe tempest-CreateVolumesFromSnapshotTest-501804922 None] Deleted volume successfully. Sep 04 18:10:46 devstack sudo[107058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-95aa5840-74fb-49b8-958e-060092f9b71b Sep 04 18:10:46 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:46 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-de72e07e-2214-4edc-963c-0e714936d5fe tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "cinder-a1737719-fd2a-4022-95b2-2d4c73a4b344-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:10:47 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ee24d362-d413-48a1-9829-4d0d0ab1376d tempest-CreateVolumesFromSnapshotTest-501804922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-95aa5840-74fb-49b8-958e-060092f9b71b" returned: 0 in 0.555s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ee24d362-d413-48a1-9829-4d0d0ab1376d tempest-CreateVolumesFromSnapshotTest-501804922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-95aa5840-74fb-49b8-958e-060092f9b71b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:47 devstack sudo[107064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-95aa5840-74fb-49b8-958e-060092f9b71b Sep 04 18:10:47 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:47 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff0355a0-87bc-4457-b256-7e3345c32d70 tempest-ProjectReaderTests-165009307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:10:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ff0355a0-87bc-4457-b256-7e3345c32d70 tempest-ProjectReaderTests-165009307 None] Flow 'volume_create_manager' (64b5e614-2522-4ef4-9972-7cbf0dd81aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:10:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ff0355a0-87bc-4457-b256-7e3345c32d70 tempest-ProjectReaderTests-165009307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb7a26a7-ff08-42d1-9aa4-f9147b89e2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:47 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ee24d362-d413-48a1-9829-4d0d0ab1376d tempest-CreateVolumesFromSnapshotTest-501804922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-95aa5840-74fb-49b8-958e-060092f9b71b" returned: 0 in 0.348s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ff0355a0-87bc-4457-b256-7e3345c32d70 tempest-ProjectReaderTests-165009307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb7a26a7-ff08-42d1-9aa4-f9147b89e2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:10:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1807454427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6fc7207-2906-4ab0-8bc8-ee540fb4c51c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2254891158940bf81044300c7adb7e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:10:47Z,use_quota=True,user_id='35dfe42a94cd45139aca9b499fda11af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ff0355a0-87bc-4457-b256-7e3345c32d70 tempest-ProjectReaderTests-165009307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32b66fc5-8a2f-4b72-8882-8ef4b868fcc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ff0355a0-87bc-4457-b256-7e3345c32d70 tempest-ProjectReaderTests-165009307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32b66fc5-8a2f-4b72-8882-8ef4b868fcc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ff0355a0-87bc-4457-b256-7e3345c32d70 tempest-ProjectReaderTests-165009307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e501c54-578c-404d-8159-d4d906ea7312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ff0355a0-87bc-4457-b256-7e3345c32d70 tempest-ProjectReaderTests-165009307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e501c54-578c-404d-8159-d4d906ea7312) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6fc7207-2906-4ab0-8bc8-ee540fb4c51c', 'volume_name': 'volume-b6fc7207-2906-4ab0-8bc8-ee540fb4c51c', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ff0355a0-87bc-4457-b256-7e3345c32d70 tempest-ProjectReaderTests-165009307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2270c99e-872d-4cb2-abb1-1081f7d0890e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ff0355a0-87bc-4457-b256-7e3345c32d70 tempest-ProjectReaderTests-165009307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2270c99e-872d-4cb2-abb1-1081f7d0890e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ff0355a0-87bc-4457-b256-7e3345c32d70 tempest-ProjectReaderTests-165009307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0d24a98-630f-4b66-8a9c-726b3047e112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:47 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-ff0355a0-87bc-4457-b256-7e3345c32d70 tempest-ProjectReaderTests-165009307 None] Volume b6fc7207-2906-4ab0-8bc8-ee540fb4c51c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6fc7207-2906-4ab0-8bc8-ee540fb4c51c', 'volume_size': 1} Sep 04 18:10:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ff0355a0-87bc-4457-b256-7e3345c32d70 tempest-ProjectReaderTests-165009307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ff0355a0-87bc-4457-b256-7e3345c32d70 tempest-ProjectReaderTests-165009307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:47 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ff0355a0-87bc-4457-b256-7e3345c32d70 tempest-ProjectReaderTests-165009307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:10:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1807454427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6fc7207-2906-4ab0-8bc8-ee540fb4c51c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2254891158940bf81044300c7adb7e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:10:47Z,use_quota=True,user_id='35dfe42a94cd45139aca9b499fda11af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:10:47 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-ff0355a0-87bc-4457-b256-7e3345c32d70 tempest-ProjectReaderTests-165009307 None] Creating volume b6fc7207-2906-4ab0-8bc8-ee540fb4c51c {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:10:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ff0355a0-87bc-4457-b256-7e3345c32d70 tempest-ProjectReaderTests-165009307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ff0355a0-87bc-4457-b256-7e3345c32d70 tempest-ProjectReaderTests-165009307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:47 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ff0355a0-87bc-4457-b256-7e3345c32d70 tempest-ProjectReaderTests-165009307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:10:47 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ff0355a0-87bc-4457-b256-7e3345c32d70 tempest-ProjectReaderTests-165009307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:10:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ff0355a0-87bc-4457-b256-7e3345c32d70 tempest-ProjectReaderTests-165009307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:47 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ff0355a0-87bc-4457-b256-7e3345c32d70 tempest-ProjectReaderTests-165009307 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:10:47 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-ff0355a0-87bc-4457-b256-7e3345c32d70 tempest-ProjectReaderTests-165009307 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:10:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ff0355a0-87bc-4457-b256-7e3345c32d70 tempest-ProjectReaderTests-165009307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b6fc7207-2906-4ab0-8bc8-ee540fb4c51c 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:47 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ee24d362-d413-48a1-9829-4d0d0ab1376d tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "cinder-quobyte-95aa5840-74fb-49b8-958e-060092f9b71b" released by "delete_volume" :: held 1.041s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:10:47 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b6fc7207-2906-4ab0-8bc8-ee540fb4c51c 1073741824 Sep 04 18:10:47 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:47 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-ee24d362-d413-48a1-9829-4d0d0ab1376d tempest-CreateVolumesFromSnapshotTest-501804922 None] Created reservations ['0ba39d4d-f19a-4315-9ec7-8b4d0e9f2aaa', '311493ba-e944-4a21-8859-8f654dc6ccc5', 'a69c9134-5efd-42cc-a41b-900d69ae06ae', 'c457540d-849a-4251-867f-ac8e3d38feb0'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:10:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ee24d362-d413-48a1-9829-4d0d0ab1376d tempest-CreateVolumesFromSnapshotTest-501804922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ee24d362-d413-48a1-9829-4d0d0ab1376d tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:47 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ee24d362-d413-48a1-9829-4d0d0ab1376d tempest-CreateVolumesFromSnapshotTest-501804922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:10:47 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ee24d362-d413-48a1-9829-4d0d0ab1376d tempest-CreateVolumesFromSnapshotTest-501804922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:10:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ee24d362-d413-48a1-9829-4d0d0ab1376d tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ee24d362-d413-48a1-9829-4d0d0ab1376d tempest-CreateVolumesFromSnapshotTest-501804922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:47 devstack sudo[107069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:10:47 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:48 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ee24d362-d413-48a1-9829-4d0d0ab1376d tempest-CreateVolumesFromSnapshotTest-501804922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.313s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:48 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-ee24d362-d413-48a1-9829-4d0d0ab1376d tempest-CreateVolumesFromSnapshotTest-501804922 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:10:48 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-ee24d362-d413-48a1-9829-4d0d0ab1376d tempest-CreateVolumesFromSnapshotTest-501804922 None] Deleted volume successfully. Sep 04 18:10:48 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ee24d362-d413-48a1-9829-4d0d0ab1376d tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "cinder-95aa5840-74fb-49b8-958e-060092f9b71b-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:10:48 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ff0355a0-87bc-4457-b256-7e3345c32d70 tempest-ProjectReaderTests-165009307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b6fc7207-2906-4ab0-8bc8-ee540fb4c51c 1073741824" returned: 0 in 0.634s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ff0355a0-87bc-4457-b256-7e3345c32d70 tempest-ProjectReaderTests-165009307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b6fc7207-2906-4ab0-8bc8-ee540fb4c51c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:48 devstack sudo[107076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b6fc7207-2906-4ab0-8bc8-ee540fb4c51c Sep 04 18:10:48 devstack sudo[107076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:48 devstack sudo[107076]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ff0355a0-87bc-4457-b256-7e3345c32d70 tempest-ProjectReaderTests-165009307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b6fc7207-2906-4ab0-8bc8-ee540fb4c51c" returned: 0 in 0.294s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:48 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ff0355a0-87bc-4457-b256-7e3345c32d70 tempest-ProjectReaderTests-165009307 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:10:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ff0355a0-87bc-4457-b256-7e3345c32d70 tempest-ProjectReaderTests-165009307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:48 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ff0355a0-87bc-4457-b256-7e3345c32d70 tempest-ProjectReaderTests-165009307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0d24a98-630f-4b66-8a9c-726b3047e112) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6fc7207-2906-4ab0-8bc8-ee540fb4c51c', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:48 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ff0355a0-87bc-4457-b256-7e3345c32d70 tempest-ProjectReaderTests-165009307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c436a191-40a1-460a-9459-d1faf70f3ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:48 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-ff0355a0-87bc-4457-b256-7e3345c32d70 tempest-ProjectReaderTests-165009307 None] Volume volume-b6fc7207-2906-4ab0-8bc8-ee540fb4c51c (b6fc7207-2906-4ab0-8bc8-ee540fb4c51c): created successfully Sep 04 18:10:48 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ff0355a0-87bc-4457-b256-7e3345c32d70 tempest-ProjectReaderTests-165009307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c436a191-40a1-460a-9459-d1faf70f3ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:48 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ff0355a0-87bc-4457-b256-7e3345c32d70 tempest-ProjectReaderTests-165009307 None] Flow 'volume_create_manager' (64b5e614-2522-4ef4-9972-7cbf0dd81aeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:10:48 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-ff0355a0-87bc-4457-b256-7e3345c32d70 tempest-ProjectReaderTests-165009307 None] Created volume successfully. Sep 04 18:10:48 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8c5e28c9-e28c-4cde-b70e-d5d486531fff tempest-CreateVolumesFromSnapshotTest-501804922 None] Acquiring lock "cinder-4284b0a2-6648-4d46-b977-ac45ad73b5d0-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:10:48 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8c5e28c9-e28c-4cde-b70e-d5d486531fff tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "cinder-4284b0a2-6648-4d46-b977-ac45ad73b5d0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:10:48 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8c5e28c9-e28c-4cde-b70e-d5d486531fff tempest-CreateVolumesFromSnapshotTest-501804922 None] Acquiring lock "cinder-quobyte-4284b0a2-6648-4d46-b977-ac45ad73b5d0" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:10:48 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8c5e28c9-e28c-4cde-b70e-d5d486531fff tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "cinder-quobyte-4284b0a2-6648-4d46-b977-ac45ad73b5d0" acquired by "delete_volume" :: waited 0.021s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:10:48 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[b761701f-181e-4bb8-92f0-1eb5f0a9e191]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:10:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8c5e28c9-e28c-4cde-b70e-d5d486531fff tempest-CreateVolumesFromSnapshotTest-501804922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4284b0a2-6648-4d46-b977-ac45ad73b5d0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:48 devstack sudo[107079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4284b0a2-6648-4d46-b977-ac45ad73b5d0 Sep 04 18:10:48 devstack sudo[107079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:49 devstack sudo[107079]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8c5e28c9-e28c-4cde-b70e-d5d486531fff tempest-CreateVolumesFromSnapshotTest-501804922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4284b0a2-6648-4d46-b977-ac45ad73b5d0" returned: 0 in 0.384s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8c5e28c9-e28c-4cde-b70e-d5d486531fff tempest-CreateVolumesFromSnapshotTest-501804922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4284b0a2-6648-4d46-b977-ac45ad73b5d0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:49 devstack sudo[107084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4284b0a2-6648-4d46-b977-ac45ad73b5d0 Sep 04 18:10:49 devstack sudo[107084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:49 devstack sudo[107084]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8c5e28c9-e28c-4cde-b70e-d5d486531fff tempest-CreateVolumesFromSnapshotTest-501804922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-4284b0a2-6648-4d46-b977-ac45ad73b5d0" returned: 0 in 0.326s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:49 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8c5e28c9-e28c-4cde-b70e-d5d486531fff tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "cinder-quobyte-4284b0a2-6648-4d46-b977-ac45ad73b5d0" released by "delete_volume" :: held 0.775s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:10:49 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-8c5e28c9-e28c-4cde-b70e-d5d486531fff tempest-CreateVolumesFromSnapshotTest-501804922 None] Created reservations ['c5b2aaa8-8fb0-4e88-b6bc-49d5633ca47c', '6859e739-9d71-4ffa-95a7-15df22d460cd', 'fcedc676-ba96-4cd0-986d-c379ca656ea9', 'bc99c616-e835-47fd-9f4b-8ed11eac3c34'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:10:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8c5e28c9-e28c-4cde-b70e-d5d486531fff tempest-CreateVolumesFromSnapshotTest-501804922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8c5e28c9-e28c-4cde-b70e-d5d486531fff tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8c5e28c9-e28c-4cde-b70e-d5d486531fff tempest-CreateVolumesFromSnapshotTest-501804922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:10:49 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-8c5e28c9-e28c-4cde-b70e-d5d486531fff tempest-CreateVolumesFromSnapshotTest-501804922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:10:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-8c5e28c9-e28c-4cde-b70e-d5d486531fff tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8c5e28c9-e28c-4cde-b70e-d5d486531fff tempest-CreateVolumesFromSnapshotTest-501804922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:49 devstack sudo[107121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:10:49 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:50 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a0bd2b8f-58c9-43fd-9d25-4ff08b48d6b7 tempest-ProjectReaderTests-165009307 None] Acquiring lock "cinder-b6fc7207-2906-4ab0-8bc8-ee540fb4c51c-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:10:50 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-8c5e28c9-e28c-4cde-b70e-d5d486531fff tempest-CreateVolumesFromSnapshotTest-501804922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.320s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:50 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-8c5e28c9-e28c-4cde-b70e-d5d486531fff tempest-CreateVolumesFromSnapshotTest-501804922 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:10:50 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-16fb2e84-d5db-4650-a4de-c66ddd2bb8dc tempest-CreateVolumesFromSnapshotTest-501804922 None] Acquiring lock "cinder-7460b340-c5df-4753-8dd7-2de52f703f3d-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:10:50 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a0bd2b8f-58c9-43fd-9d25-4ff08b48d6b7 tempest-ProjectReaderTests-165009307 None] Lock "cinder-b6fc7207-2906-4ab0-8bc8-ee540fb4c51c-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:10:50 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-8c5e28c9-e28c-4cde-b70e-d5d486531fff tempest-CreateVolumesFromSnapshotTest-501804922 None] Deleted volume successfully. Sep 04 18:10:50 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-16fb2e84-d5db-4650-a4de-c66ddd2bb8dc tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "cinder-7460b340-c5df-4753-8dd7-2de52f703f3d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:10:50 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-8c5e28c9-e28c-4cde-b70e-d5d486531fff tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "cinder-4284b0a2-6648-4d46-b977-ac45ad73b5d0-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:10:50 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a0bd2b8f-58c9-43fd-9d25-4ff08b48d6b7 tempest-ProjectReaderTests-165009307 None] Acquiring lock "cinder-quobyte-b6fc7207-2906-4ab0-8bc8-ee540fb4c51c" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:10:50 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-16fb2e84-d5db-4650-a4de-c66ddd2bb8dc tempest-CreateVolumesFromSnapshotTest-501804922 None] Acquiring lock "cinder-quobyte-7460b340-c5df-4753-8dd7-2de52f703f3d" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:10:50 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a0bd2b8f-58c9-43fd-9d25-4ff08b48d6b7 tempest-ProjectReaderTests-165009307 None] Lock "cinder-quobyte-b6fc7207-2906-4ab0-8bc8-ee540fb4c51c" acquired by "delete_volume" :: waited 0.032s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:10:50 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-16fb2e84-d5db-4650-a4de-c66ddd2bb8dc tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "cinder-quobyte-7460b340-c5df-4753-8dd7-2de52f703f3d" acquired by "delete_volume" :: waited 0.045s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:10:50 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d0d3ca-ec50-4f96-881e-b5ec271293b3]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:10:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a0bd2b8f-58c9-43fd-9d25-4ff08b48d6b7 tempest-ProjectReaderTests-165009307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b6fc7207-2906-4ab0-8bc8-ee540fb4c51c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:50 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a21d438-f316-4087-95fc-5e68e28d9fc1]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:10:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-16fb2e84-d5db-4650-a4de-c66ddd2bb8dc tempest-CreateVolumesFromSnapshotTest-501804922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7460b340-c5df-4753-8dd7-2de52f703f3d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:50 devstack sudo[107129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7460b340-c5df-4753-8dd7-2de52f703f3d Sep 04 18:10:50 devstack sudo[107129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:50 devstack sudo[107128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b6fc7207-2906-4ab0-8bc8-ee540fb4c51c Sep 04 18:10:50 devstack sudo[107128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:50 devstack sudo[107128]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a0bd2b8f-58c9-43fd-9d25-4ff08b48d6b7 tempest-ProjectReaderTests-165009307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b6fc7207-2906-4ab0-8bc8-ee540fb4c51c" returned: 0 in 0.517s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a0bd2b8f-58c9-43fd-9d25-4ff08b48d6b7 tempest-ProjectReaderTests-165009307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b6fc7207-2906-4ab0-8bc8-ee540fb4c51c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:50 devstack sudo[107129]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-16fb2e84-d5db-4650-a4de-c66ddd2bb8dc tempest-CreateVolumesFromSnapshotTest-501804922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7460b340-c5df-4753-8dd7-2de52f703f3d" returned: 0 in 0.509s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-16fb2e84-d5db-4650-a4de-c66ddd2bb8dc tempest-CreateVolumesFromSnapshotTest-501804922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7460b340-c5df-4753-8dd7-2de52f703f3d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:50 devstack sudo[107138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b6fc7207-2906-4ab0-8bc8-ee540fb4c51c Sep 04 18:10:50 devstack sudo[107138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:50 devstack sudo[107139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7460b340-c5df-4753-8dd7-2de52f703f3d Sep 04 18:10:50 devstack sudo[107139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:51 devstack sudo[107138]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a0bd2b8f-58c9-43fd-9d25-4ff08b48d6b7 tempest-ProjectReaderTests-165009307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b6fc7207-2906-4ab0-8bc8-ee540fb4c51c" returned: 0 in 0.324s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:51 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a0bd2b8f-58c9-43fd-9d25-4ff08b48d6b7 tempest-ProjectReaderTests-165009307 None] Lock "cinder-quobyte-b6fc7207-2906-4ab0-8bc8-ee540fb4c51c" released by "delete_volume" :: held 0.930s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:10:51 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-a0bd2b8f-58c9-43fd-9d25-4ff08b48d6b7 tempest-ProjectReaderTests-165009307 None] Created reservations ['a710a935-6aa7-4426-a43d-7d6b8b936f6d', 'c17a30bc-d859-4261-9981-2bf5c3dda787', '8c962bbd-0e9e-44da-9d86-9cf0bfc813d9', 'ebd760e4-cad3-4968-afba-3913694a6930'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:10:51 devstack sudo[107139]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-16fb2e84-d5db-4650-a4de-c66ddd2bb8dc tempest-CreateVolumesFromSnapshotTest-501804922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7460b340-c5df-4753-8dd7-2de52f703f3d" returned: 0 in 0.490s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:51 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-16fb2e84-d5db-4650-a4de-c66ddd2bb8dc tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "cinder-quobyte-7460b340-c5df-4753-8dd7-2de52f703f3d" released by "delete_volume" :: held 1.069s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:10:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a0bd2b8f-58c9-43fd-9d25-4ff08b48d6b7 tempest-ProjectReaderTests-165009307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a0bd2b8f-58c9-43fd-9d25-4ff08b48d6b7 tempest-ProjectReaderTests-165009307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:51 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a0bd2b8f-58c9-43fd-9d25-4ff08b48d6b7 tempest-ProjectReaderTests-165009307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:10:51 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a0bd2b8f-58c9-43fd-9d25-4ff08b48d6b7 tempest-ProjectReaderTests-165009307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:10:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a0bd2b8f-58c9-43fd-9d25-4ff08b48d6b7 tempest-ProjectReaderTests-165009307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a0bd2b8f-58c9-43fd-9d25-4ff08b48d6b7 tempest-ProjectReaderTests-165009307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:51 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:10:51 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:51 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-16fb2e84-d5db-4650-a4de-c66ddd2bb8dc tempest-CreateVolumesFromSnapshotTest-501804922 None] Created reservations ['0e28743b-9dcb-4fb3-a6a9-f38189115697', 'd56dc5a4-8c77-4e51-848f-1c79bc765597', '31ef1d71-4a93-4815-8570-28606125f604', '664204d1-aee1-49d6-89de-db13d4345148'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:10:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-16fb2e84-d5db-4650-a4de-c66ddd2bb8dc tempest-CreateVolumesFromSnapshotTest-501804922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-16fb2e84-d5db-4650-a4de-c66ddd2bb8dc tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:51 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-16fb2e84-d5db-4650-a4de-c66ddd2bb8dc tempest-CreateVolumesFromSnapshotTest-501804922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:10:51 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-16fb2e84-d5db-4650-a4de-c66ddd2bb8dc tempest-CreateVolumesFromSnapshotTest-501804922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:10:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-16fb2e84-d5db-4650-a4de-c66ddd2bb8dc tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-16fb2e84-d5db-4650-a4de-c66ddd2bb8dc tempest-CreateVolumesFromSnapshotTest-501804922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:51 devstack sudo[107146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:10:51 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:51 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a0bd2b8f-58c9-43fd-9d25-4ff08b48d6b7 tempest-ProjectReaderTests-165009307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.277s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:51 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-a0bd2b8f-58c9-43fd-9d25-4ff08b48d6b7 tempest-ProjectReaderTests-165009307 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:10:51 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-a0bd2b8f-58c9-43fd-9d25-4ff08b48d6b7 tempest-ProjectReaderTests-165009307 None] Deleted volume successfully. Sep 04 18:10:51 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a0bd2b8f-58c9-43fd-9d25-4ff08b48d6b7 tempest-ProjectReaderTests-165009307 None] Lock "cinder-b6fc7207-2906-4ab0-8bc8-ee540fb4c51c-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:10:51 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-16fb2e84-d5db-4650-a4de-c66ddd2bb8dc tempest-CreateVolumesFromSnapshotTest-501804922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.258s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:51 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-16fb2e84-d5db-4650-a4de-c66ddd2bb8dc tempest-CreateVolumesFromSnapshotTest-501804922 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:10:51 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-16fb2e84-d5db-4650-a4de-c66ddd2bb8dc tempest-CreateVolumesFromSnapshotTest-501804922 None] Deleted volume successfully. Sep 04 18:10:51 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-16fb2e84-d5db-4650-a4de-c66ddd2bb8dc tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "cinder-7460b340-c5df-4753-8dd7-2de52f703f3d-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:10:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-505fdfa9-aaed-471b-92e4-d2124edf8f27 tempest-CreateVolumesFromSnapshotTest-501804922 None] Acquiring lock "cinder-6071cf2e-ddb3-4ede-b7f1-5f1dc3f9e39a-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:10:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-505fdfa9-aaed-471b-92e4-d2124edf8f27 tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "cinder-6071cf2e-ddb3-4ede-b7f1-5f1dc3f9e39a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:10:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-505fdfa9-aaed-471b-92e4-d2124edf8f27 tempest-CreateVolumesFromSnapshotTest-501804922 None] Acquiring lock "cinder-quobyte-6071cf2e-ddb3-4ede-b7f1-5f1dc3f9e39a" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:10:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-505fdfa9-aaed-471b-92e4-d2124edf8f27 tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "cinder-quobyte-6071cf2e-ddb3-4ede-b7f1-5f1dc3f9e39a" acquired by "delete_volume" :: waited 0.019s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:10:52 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80c42d0-26cf-45f4-81b7-fe3ba3a8bfbe]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:10:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-505fdfa9-aaed-471b-92e4-d2124edf8f27 tempest-CreateVolumesFromSnapshotTest-501804922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6071cf2e-ddb3-4ede-b7f1-5f1dc3f9e39a {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:52 devstack sudo[107150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6071cf2e-ddb3-4ede-b7f1-5f1dc3f9e39a Sep 04 18:10:52 devstack sudo[107150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:53 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a945d20-f370-4b3f-895a-0a2bcbd2ab85 tempest-ProjectReaderTests-165009307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:10:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6a945d20-f370-4b3f-895a-0a2bcbd2ab85 tempest-ProjectReaderTests-165009307 None] Flow 'volume_create_manager' (1944240a-0eb3-4e88-bb14-f801a13105bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:10:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6a945d20-f370-4b3f-895a-0a2bcbd2ab85 tempest-ProjectReaderTests-165009307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0391a52-9fff-4c82-a8ae-95dba69ddc9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6a945d20-f370-4b3f-895a-0a2bcbd2ab85 tempest-ProjectReaderTests-165009307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0391a52-9fff-4c82-a8ae-95dba69ddc9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-290651453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83241228-fda0-4390-8dca-7f7fefc4e53a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2254891158940bf81044300c7adb7e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:10:53Z,use_quota=True,user_id='35dfe42a94cd45139aca9b499fda11af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6a945d20-f370-4b3f-895a-0a2bcbd2ab85 tempest-ProjectReaderTests-165009307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ca0262a-675f-40c8-aea5-d2bb09bc41e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6a945d20-f370-4b3f-895a-0a2bcbd2ab85 tempest-ProjectReaderTests-165009307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ca0262a-675f-40c8-aea5-d2bb09bc41e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6a945d20-f370-4b3f-895a-0a2bcbd2ab85 tempest-ProjectReaderTests-165009307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d88277ca-f1c2-4535-ab9e-df040d0b96a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6a945d20-f370-4b3f-895a-0a2bcbd2ab85 tempest-ProjectReaderTests-165009307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d88277ca-f1c2-4535-ab9e-df040d0b96a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83241228-fda0-4390-8dca-7f7fefc4e53a', 'volume_name': 'volume-83241228-fda0-4390-8dca-7f7fefc4e53a', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6a945d20-f370-4b3f-895a-0a2bcbd2ab85 tempest-ProjectReaderTests-165009307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fff3f9c-284b-4864-9af2-4b4f98c63142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6a945d20-f370-4b3f-895a-0a2bcbd2ab85 tempest-ProjectReaderTests-165009307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fff3f9c-284b-4864-9af2-4b4f98c63142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:53 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6a945d20-f370-4b3f-895a-0a2bcbd2ab85 tempest-ProjectReaderTests-165009307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7945ba15-fc17-4ae3-88ca-f55c46a6fd34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:53 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-6a945d20-f370-4b3f-895a-0a2bcbd2ab85 tempest-ProjectReaderTests-165009307 None] Volume 83241228-fda0-4390-8dca-7f7fefc4e53a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83241228-fda0-4390-8dca-7f7fefc4e53a', 'volume_size': 1} Sep 04 18:10:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6a945d20-f370-4b3f-895a-0a2bcbd2ab85 tempest-ProjectReaderTests-165009307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6a945d20-f370-4b3f-895a-0a2bcbd2ab85 tempest-ProjectReaderTests-165009307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:53 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-6a945d20-f370-4b3f-895a-0a2bcbd2ab85 tempest-ProjectReaderTests-165009307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-290651453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83241228-fda0-4390-8dca-7f7fefc4e53a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2254891158940bf81044300c7adb7e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:10:53Z,use_quota=True,user_id='35dfe42a94cd45139aca9b499fda11af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:10:53 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-6a945d20-f370-4b3f-895a-0a2bcbd2ab85 tempest-ProjectReaderTests-165009307 None] Creating volume 83241228-fda0-4390-8dca-7f7fefc4e53a {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:10:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6a945d20-f370-4b3f-895a-0a2bcbd2ab85 tempest-ProjectReaderTests-165009307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6a945d20-f370-4b3f-895a-0a2bcbd2ab85 tempest-ProjectReaderTests-165009307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:53 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-6a945d20-f370-4b3f-895a-0a2bcbd2ab85 tempest-ProjectReaderTests-165009307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:10:53 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-6a945d20-f370-4b3f-895a-0a2bcbd2ab85 tempest-ProjectReaderTests-165009307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:10:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6a945d20-f370-4b3f-895a-0a2bcbd2ab85 tempest-ProjectReaderTests-165009307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:53 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-6a945d20-f370-4b3f-895a-0a2bcbd2ab85 tempest-ProjectReaderTests-165009307 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:10:53 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-6a945d20-f370-4b3f-895a-0a2bcbd2ab85 tempest-ProjectReaderTests-165009307 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:10:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6a945d20-f370-4b3f-895a-0a2bcbd2ab85 tempest-ProjectReaderTests-165009307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-83241228-fda0-4390-8dca-7f7fefc4e53a 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:53 devstack sudo[107150]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-505fdfa9-aaed-471b-92e4-d2124edf8f27 tempest-CreateVolumesFromSnapshotTest-501804922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6071cf2e-ddb3-4ede-b7f1-5f1dc3f9e39a" returned: 0 in 0.446s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-505fdfa9-aaed-471b-92e4-d2124edf8f27 tempest-CreateVolumesFromSnapshotTest-501804922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6071cf2e-ddb3-4ede-b7f1-5f1dc3f9e39a {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:53 devstack sudo[107155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-83241228-fda0-4390-8dca-7f7fefc4e53a 1073741824 Sep 04 18:10:53 devstack sudo[107155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:53 devstack sudo[107156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6071cf2e-ddb3-4ede-b7f1-5f1dc3f9e39a Sep 04 18:10:53 devstack sudo[107156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:53 devstack sudo[107156]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-505fdfa9-aaed-471b-92e4-d2124edf8f27 tempest-CreateVolumesFromSnapshotTest-501804922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6071cf2e-ddb3-4ede-b7f1-5f1dc3f9e39a" returned: 0 in 0.271s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:53 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-505fdfa9-aaed-471b-92e4-d2124edf8f27 tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "cinder-quobyte-6071cf2e-ddb3-4ede-b7f1-5f1dc3f9e39a" released by "delete_volume" :: held 0.770s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:10:53 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-505fdfa9-aaed-471b-92e4-d2124edf8f27 tempest-CreateVolumesFromSnapshotTest-501804922 None] Created reservations ['775f4d67-e96b-4e7e-a76b-a67ba57e46f6', 'd326efef-65e3-4465-be77-35920b73f01f', 'dd32d515-38d5-4c13-a01c-6bb8f9fae078', 'b5d84e5e-3089-4a8d-87ce-cfa158a4e090'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:10:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-505fdfa9-aaed-471b-92e4-d2124edf8f27 tempest-CreateVolumesFromSnapshotTest-501804922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-505fdfa9-aaed-471b-92e4-d2124edf8f27 tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:53 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-505fdfa9-aaed-471b-92e4-d2124edf8f27 tempest-CreateVolumesFromSnapshotTest-501804922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:10:53 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-505fdfa9-aaed-471b-92e4-d2124edf8f27 tempest-CreateVolumesFromSnapshotTest-501804922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:10:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-505fdfa9-aaed-471b-92e4-d2124edf8f27 tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-505fdfa9-aaed-471b-92e4-d2124edf8f27 tempest-CreateVolumesFromSnapshotTest-501804922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:53 devstack sudo[107164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:10:53 devstack sudo[107164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:53 devstack sudo[107155]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6a945d20-f370-4b3f-895a-0a2bcbd2ab85 tempest-ProjectReaderTests-165009307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-83241228-fda0-4390-8dca-7f7fefc4e53a 1073741824" returned: 0 in 0.555s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6a945d20-f370-4b3f-895a-0a2bcbd2ab85 tempest-ProjectReaderTests-165009307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-83241228-fda0-4390-8dca-7f7fefc4e53a {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:53 devstack sudo[107166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-83241228-fda0-4390-8dca-7f7fefc4e53a Sep 04 18:10:53 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:53 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-466c11ac-46e3-43ca-9ce4-83789e75e808 tempest-CreateVolumesFromSnapshotTest-501804922 None] Acquiring lock "cinder-25152c17-52cb-49ad-9d63-e86076e6d1d0-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:10:53 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-466c11ac-46e3-43ca-9ce4-83789e75e808 tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "cinder-25152c17-52cb-49ad-9d63-e86076e6d1d0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:10:53 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-466c11ac-46e3-43ca-9ce4-83789e75e808 tempest-CreateVolumesFromSnapshotTest-501804922 None] Acquiring lock "cinder-quobyte-f4bb0533-7194-4476-893e-276e17d7b84b" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:10:53 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-466c11ac-46e3-43ca-9ce4-83789e75e808 tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "cinder-quobyte-f4bb0533-7194-4476-893e-276e17d7b84b" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:10:53 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-466c11ac-46e3-43ca-9ce4-83789e75e808 tempest-CreateVolumesFromSnapshotTest-501804922 None] Acquiring lock "cinder-quobyte-25152c17-52cb-49ad-9d63-e86076e6d1d0" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:10:53 devstack sudo[107164]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-505fdfa9-aaed-471b-92e4-d2124edf8f27 tempest-CreateVolumesFromSnapshotTest-501804922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.302s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:53 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-505fdfa9-aaed-471b-92e4-d2124edf8f27 tempest-CreateVolumesFromSnapshotTest-501804922 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:10:53 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-505fdfa9-aaed-471b-92e4-d2124edf8f27 tempest-CreateVolumesFromSnapshotTest-501804922 None] Deleted volume successfully. Sep 04 18:10:53 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-466c11ac-46e3-43ca-9ce4-83789e75e808 tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "cinder-quobyte-25152c17-52cb-49ad-9d63-e86076e6d1d0" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:10:53 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-466c11ac-46e3-43ca-9ce4-83789e75e808 tempest-CreateVolumesFromSnapshotTest-501804922 None] Deleting offline snapshot 25152c17-52cb-49ad-9d63-e86076e6d1d0 of volume f4bb0533-7194-4476-893e-276e17d7b84b {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 18:10:53 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-466c11ac-46e3-43ca-9ce4-83789e75e808 tempest-CreateVolumesFromSnapshotTest-501804922 None] snapshot_file for this snap is: volume-f4bb0533-7194-4476-893e-276e17d7b84b.25152c17-52cb-49ad-9d63-e86076e6d1d0 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 18:10:53 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc22d3c-c983-4fde-9200-e8d0b2e9cfd3]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:10:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-466c11ac-46e3-43ca-9ce4-83789e75e808 tempest-CreateVolumesFromSnapshotTest-501804922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f4bb0533-7194-4476-893e-276e17d7b84b.25152c17-52cb-49ad-9d63-e86076e6d1d0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:54 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-505fdfa9-aaed-471b-92e4-d2124edf8f27 tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "cinder-6071cf2e-ddb3-4ede-b7f1-5f1dc3f9e39a-delete_volume" released by "delete_volume" :: held 1.399s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:10:54 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6a945d20-f370-4b3f-895a-0a2bcbd2ab85 tempest-ProjectReaderTests-165009307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-83241228-fda0-4390-8dca-7f7fefc4e53a" returned: 0 in 0.355s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:54 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-6a945d20-f370-4b3f-895a-0a2bcbd2ab85 tempest-ProjectReaderTests-165009307 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:10:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6a945d20-f370-4b3f-895a-0a2bcbd2ab85 tempest-ProjectReaderTests-165009307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6a945d20-f370-4b3f-895a-0a2bcbd2ab85 tempest-ProjectReaderTests-165009307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7945ba15-fc17-4ae3-88ca-f55c46a6fd34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83241228-fda0-4390-8dca-7f7fefc4e53a', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6a945d20-f370-4b3f-895a-0a2bcbd2ab85 tempest-ProjectReaderTests-165009307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cd287bc-ef9c-4fd3-950b-b84ad8a607c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:54 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-6a945d20-f370-4b3f-895a-0a2bcbd2ab85 tempest-ProjectReaderTests-165009307 None] Volume volume-83241228-fda0-4390-8dca-7f7fefc4e53a (83241228-fda0-4390-8dca-7f7fefc4e53a): created successfully Sep 04 18:10:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6a945d20-f370-4b3f-895a-0a2bcbd2ab85 tempest-ProjectReaderTests-165009307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cd287bc-ef9c-4fd3-950b-b84ad8a607c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-6a945d20-f370-4b3f-895a-0a2bcbd2ab85 tempest-ProjectReaderTests-165009307 None] Flow 'volume_create_manager' (1944240a-0eb3-4e88-bb14-f801a13105bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:10:54 devstack sudo[107170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f4bb0533-7194-4476-893e-276e17d7b84b.25152c17-52cb-49ad-9d63-e86076e6d1d0 Sep 04 18:10:54 devstack sudo[107170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:54 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-6a945d20-f370-4b3f-895a-0a2bcbd2ab85 tempest-ProjectReaderTests-165009307 None] Created volume successfully. Sep 04 18:10:54 devstack sudo[107170]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-466c11ac-46e3-43ca-9ce4-83789e75e808 tempest-CreateVolumesFromSnapshotTest-501804922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f4bb0533-7194-4476-893e-276e17d7b84b.25152c17-52cb-49ad-9d63-e86076e6d1d0" returned: 0 in 0.431s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:54 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-466c11ac-46e3-43ca-9ce4-83789e75e808 tempest-CreateVolumesFromSnapshotTest-501804922 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4bb0533-7194-4476-893e-276e17d7b84b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 18:10:54 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[98375edb-935a-48f8-8bb4-e82a25548a58]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:10:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-466c11ac-46e3-43ca-9ce4-83789e75e808 tempest-CreateVolumesFromSnapshotTest-501804922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f4bb0533-7194-4476-893e-276e17d7b84b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:54 devstack sudo[107177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f4bb0533-7194-4476-893e-276e17d7b84b Sep 04 18:10:54 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:54 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-466c11ac-46e3-43ca-9ce4-83789e75e808 tempest-CreateVolumesFromSnapshotTest-501804922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f4bb0533-7194-4476-893e-276e17d7b84b" returned: 0 in 0.449s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-466c11ac-46e3-43ca-9ce4-83789e75e808 tempest-CreateVolumesFromSnapshotTest-501804922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f4bb0533-7194-4476-893e-276e17d7b84b.25152c17-52cb-49ad-9d63-e86076e6d1d0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:54 devstack sudo[107182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f4bb0533-7194-4476-893e-276e17d7b84b.25152c17-52cb-49ad-9d63-e86076e6d1d0 Sep 04 18:10:54 devstack sudo[107182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:55 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4c64fd28-36fa-4182-b55d-bd41fcd1609b tempest-ProjectReaderTests-165009307 None] Acquiring lock "cinder-83241228-fda0-4390-8dca-7f7fefc4e53a-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:10:55 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4c64fd28-36fa-4182-b55d-bd41fcd1609b tempest-ProjectReaderTests-165009307 None] Lock "cinder-83241228-fda0-4390-8dca-7f7fefc4e53a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:10:55 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4c64fd28-36fa-4182-b55d-bd41fcd1609b tempest-ProjectReaderTests-165009307 None] Acquiring lock "cinder-quobyte-83241228-fda0-4390-8dca-7f7fefc4e53a" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:10:55 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4c64fd28-36fa-4182-b55d-bd41fcd1609b tempest-ProjectReaderTests-165009307 None] Lock "cinder-quobyte-83241228-fda0-4390-8dca-7f7fefc4e53a" acquired by "delete_volume" :: waited 0.018s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:10:55 devstack sudo[107182]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-466c11ac-46e3-43ca-9ce4-83789e75e808 tempest-CreateVolumesFromSnapshotTest-501804922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f4bb0533-7194-4476-893e-276e17d7b84b.25152c17-52cb-49ad-9d63-e86076e6d1d0" returned: 0 in 0.408s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-466c11ac-46e3-43ca-9ce4-83789e75e808 tempest-CreateVolumesFromSnapshotTest-501804922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f4bb0533-7194-4476-893e-276e17d7b84b.25152c17-52cb-49ad-9d63-e86076e6d1d0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:55 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[2161a7eb-872c-4cec-a9d4-be6c8d0d7520]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:10:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4c64fd28-36fa-4182-b55d-bd41fcd1609b tempest-ProjectReaderTests-165009307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-83241228-fda0-4390-8dca-7f7fefc4e53a {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:55 devstack sudo[107188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f4bb0533-7194-4476-893e-276e17d7b84b.25152c17-52cb-49ad-9d63-e86076e6d1d0 Sep 04 18:10:55 devstack sudo[107188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:55 devstack sudo[107189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-83241228-fda0-4390-8dca-7f7fefc4e53a Sep 04 18:10:55 devstack sudo[107189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:55 devstack sudo[107188]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-466c11ac-46e3-43ca-9ce4-83789e75e808 tempest-CreateVolumesFromSnapshotTest-501804922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f4bb0533-7194-4476-893e-276e17d7b84b.25152c17-52cb-49ad-9d63-e86076e6d1d0" returned: 0 in 0.270s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:55 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-466c11ac-46e3-43ca-9ce4-83789e75e808 tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "cinder-quobyte-25152c17-52cb-49ad-9d63-e86076e6d1d0" released by "_delete_snapshot" :: held 1.709s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:10:55 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-466c11ac-46e3-43ca-9ce4-83789e75e808 tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "cinder-quobyte-f4bb0533-7194-4476-893e-276e17d7b84b" released by "delete_snapshot" :: held 1.757s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:10:55 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-466c11ac-46e3-43ca-9ce4-83789e75e808 tempest-CreateVolumesFromSnapshotTest-501804922 None] Created reservations ['2d1927f1-34c4-4893-9aa5-d35f5f0ac2e0', '299b0bc2-f3dd-47dc-8358-3356555480ce', '176744d3-794d-41d9-811e-b4239ece64b7', '76dea973-0442-4fbb-8bf7-1bb1de847c80'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:10:55 devstack sudo[107189]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4c64fd28-36fa-4182-b55d-bd41fcd1609b tempest-ProjectReaderTests-165009307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-83241228-fda0-4390-8dca-7f7fefc4e53a" returned: 0 in 0.472s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4c64fd28-36fa-4182-b55d-bd41fcd1609b tempest-ProjectReaderTests-165009307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-83241228-fda0-4390-8dca-7f7fefc4e53a {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:55 devstack sudo[107196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-83241228-fda0-4390-8dca-7f7fefc4e53a Sep 04 18:10:55 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:55 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-466c11ac-46e3-43ca-9ce4-83789e75e808 tempest-CreateVolumesFromSnapshotTest-501804922 None] Delete snapshot completed successfully. Sep 04 18:10:55 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-466c11ac-46e3-43ca-9ce4-83789e75e808 tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "cinder-25152c17-52cb-49ad-9d63-e86076e6d1d0-delete_snapshot" released by "delete_snapshot" :: held 2.023s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:10:56 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c17c6098-fa79-4828-98e7-4203977eb6b4 tempest-CreateVolumesFromSnapshotTest-501804922 None] Acquiring lock "cinder-f4bb0533-7194-4476-893e-276e17d7b84b-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:10:56 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c17c6098-fa79-4828-98e7-4203977eb6b4 tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "cinder-f4bb0533-7194-4476-893e-276e17d7b84b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:10:56 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c17c6098-fa79-4828-98e7-4203977eb6b4 tempest-CreateVolumesFromSnapshotTest-501804922 None] Acquiring lock "cinder-quobyte-f4bb0533-7194-4476-893e-276e17d7b84b" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:10:56 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c17c6098-fa79-4828-98e7-4203977eb6b4 tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "cinder-quobyte-f4bb0533-7194-4476-893e-276e17d7b84b" acquired by "delete_volume" :: waited 0.048s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:10:56 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:56 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3084b62-649e-4b03-a8c0-63aa6a70f831]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:10:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c17c6098-fa79-4828-98e7-4203977eb6b4 tempest-CreateVolumesFromSnapshotTest-501804922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f4bb0533-7194-4476-893e-276e17d7b84b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4c64fd28-36fa-4182-b55d-bd41fcd1609b tempest-ProjectReaderTests-165009307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-83241228-fda0-4390-8dca-7f7fefc4e53a" returned: 0 in 0.447s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:56 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4c64fd28-36fa-4182-b55d-bd41fcd1609b tempest-ProjectReaderTests-165009307 None] Lock "cinder-quobyte-83241228-fda0-4390-8dca-7f7fefc4e53a" released by "delete_volume" :: held 0.980s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:10:56 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-4c64fd28-36fa-4182-b55d-bd41fcd1609b tempest-ProjectReaderTests-165009307 None] Created reservations ['9831eb56-c0f1-417b-8d67-1f08867de03a', '1ae290f9-6225-440b-8b1c-b6e645530c81', 'ac39e573-df74-4592-af0a-dbe5de328467', 'aca64f22-484d-45dd-af04-39e6fbe5f4f5'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:10:56 devstack sudo[107200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f4bb0533-7194-4476-893e-276e17d7b84b Sep 04 18:10:56 devstack sudo[107200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4c64fd28-36fa-4182-b55d-bd41fcd1609b tempest-ProjectReaderTests-165009307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4c64fd28-36fa-4182-b55d-bd41fcd1609b tempest-ProjectReaderTests-165009307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:56 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4c64fd28-36fa-4182-b55d-bd41fcd1609b tempest-ProjectReaderTests-165009307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:10:56 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-4c64fd28-36fa-4182-b55d-bd41fcd1609b tempest-ProjectReaderTests-165009307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:10:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4c64fd28-36fa-4182-b55d-bd41fcd1609b tempest-ProjectReaderTests-165009307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4c64fd28-36fa-4182-b55d-bd41fcd1609b tempest-ProjectReaderTests-165009307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:56 devstack sudo[107202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:10:56 devstack sudo[107202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:56 devstack sudo[107200]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c17c6098-fa79-4828-98e7-4203977eb6b4 tempest-CreateVolumesFromSnapshotTest-501804922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f4bb0533-7194-4476-893e-276e17d7b84b" returned: 0 in 0.567s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c17c6098-fa79-4828-98e7-4203977eb6b4 tempest-CreateVolumesFromSnapshotTest-501804922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f4bb0533-7194-4476-893e-276e17d7b84b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:56 devstack sudo[107202]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4c64fd28-36fa-4182-b55d-bd41fcd1609b tempest-ProjectReaderTests-165009307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.391s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:56 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-4c64fd28-36fa-4182-b55d-bd41fcd1609b tempest-ProjectReaderTests-165009307 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:10:56 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-4c64fd28-36fa-4182-b55d-bd41fcd1609b tempest-ProjectReaderTests-165009307 None] Deleted volume successfully. Sep 04 18:10:56 devstack sudo[107209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f4bb0533-7194-4476-893e-276e17d7b84b Sep 04 18:10:56 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:56 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-4c64fd28-36fa-4182-b55d-bd41fcd1609b tempest-ProjectReaderTests-165009307 None] Lock "cinder-83241228-fda0-4390-8dca-7f7fefc4e53a-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:10:57 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c17c6098-fa79-4828-98e7-4203977eb6b4 tempest-CreateVolumesFromSnapshotTest-501804922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-f4bb0533-7194-4476-893e-276e17d7b84b" returned: 0 in 0.376s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:57 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c17c6098-fa79-4828-98e7-4203977eb6b4 tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "cinder-quobyte-f4bb0533-7194-4476-893e-276e17d7b84b" released by "delete_volume" :: held 1.043s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:10:57 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-c17c6098-fa79-4828-98e7-4203977eb6b4 tempest-CreateVolumesFromSnapshotTest-501804922 None] Created reservations ['7a5d0b32-3064-47e4-9118-deb4fd3bf8f5', '686f80a5-87c7-4f9b-9127-28498ccd66b8', 'f315a9c8-b617-4126-b1c7-d1eb212c817e', '727c2d31-4ce0-4114-83e5-35ecde248da4'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:10:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c17c6098-fa79-4828-98e7-4203977eb6b4 tempest-CreateVolumesFromSnapshotTest-501804922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c17c6098-fa79-4828-98e7-4203977eb6b4 tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:57 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c17c6098-fa79-4828-98e7-4203977eb6b4 tempest-CreateVolumesFromSnapshotTest-501804922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:10:57 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c17c6098-fa79-4828-98e7-4203977eb6b4 tempest-CreateVolumesFromSnapshotTest-501804922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:10:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c17c6098-fa79-4828-98e7-4203977eb6b4 tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c17c6098-fa79-4828-98e7-4203977eb6b4 tempest-CreateVolumesFromSnapshotTest-501804922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:57 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:10:57 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:57 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c17c6098-fa79-4828-98e7-4203977eb6b4 tempest-CreateVolumesFromSnapshotTest-501804922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.320s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:57 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-c17c6098-fa79-4828-98e7-4203977eb6b4 tempest-CreateVolumesFromSnapshotTest-501804922 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:10:57 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-c17c6098-fa79-4828-98e7-4203977eb6b4 tempest-CreateVolumesFromSnapshotTest-501804922 None] Deleted volume successfully. Sep 04 18:10:57 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c17c6098-fa79-4828-98e7-4203977eb6b4 tempest-CreateVolumesFromSnapshotTest-501804922 None] Lock "cinder-f4bb0533-7194-4476-893e-276e17d7b84b-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:10:58 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc841bbc-962e-4c4e-bb1c-ef2dcee32f80 tempest-ProjectReaderTests-165009307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:10:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fc841bbc-962e-4c4e-bb1c-ef2dcee32f80 tempest-ProjectReaderTests-165009307 None] Flow 'volume_create_manager' (13db00fc-2a60-440d-9a2d-32532a6df13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:10:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fc841bbc-962e-4c4e-bb1c-ef2dcee32f80 tempest-ProjectReaderTests-165009307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27590165-2492-4dca-a01d-681ea2d08984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fc841bbc-962e-4c4e-bb1c-ef2dcee32f80 tempest-ProjectReaderTests-165009307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27590165-2492-4dca-a01d-681ea2d08984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1330943712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17df51ec-803b-44cb-a770-6d5e1d2c0882,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2254891158940bf81044300c7adb7e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:10:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:10:58Z,use_quota=True,user_id='35dfe42a94cd45139aca9b499fda11af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fc841bbc-962e-4c4e-bb1c-ef2dcee32f80 tempest-ProjectReaderTests-165009307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6912e57-5b87-451c-ab70-aecf3348bd50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fc841bbc-962e-4c4e-bb1c-ef2dcee32f80 tempest-ProjectReaderTests-165009307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6912e57-5b87-451c-ab70-aecf3348bd50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fc841bbc-962e-4c4e-bb1c-ef2dcee32f80 tempest-ProjectReaderTests-165009307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31b9e3a2-1e7f-4a56-946f-aa2fa8de6932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fc841bbc-962e-4c4e-bb1c-ef2dcee32f80 tempest-ProjectReaderTests-165009307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31b9e3a2-1e7f-4a56-946f-aa2fa8de6932) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17df51ec-803b-44cb-a770-6d5e1d2c0882', 'volume_name': 'volume-17df51ec-803b-44cb-a770-6d5e1d2c0882', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fc841bbc-962e-4c4e-bb1c-ef2dcee32f80 tempest-ProjectReaderTests-165009307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38a02efc-d786-4c0b-b4a2-67351845f45a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fc841bbc-962e-4c4e-bb1c-ef2dcee32f80 tempest-ProjectReaderTests-165009307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38a02efc-d786-4c0b-b4a2-67351845f45a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:58 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fc841bbc-962e-4c4e-bb1c-ef2dcee32f80 tempest-ProjectReaderTests-165009307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caa9cb9d-6c33-48e4-b6f2-62dbf525efab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:58 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-fc841bbc-962e-4c4e-bb1c-ef2dcee32f80 tempest-ProjectReaderTests-165009307 None] Volume 17df51ec-803b-44cb-a770-6d5e1d2c0882: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17df51ec-803b-44cb-a770-6d5e1d2c0882', 'volume_size': 1} Sep 04 18:10:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fc841bbc-962e-4c4e-bb1c-ef2dcee32f80 tempest-ProjectReaderTests-165009307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fc841bbc-962e-4c4e-bb1c-ef2dcee32f80 tempest-ProjectReaderTests-165009307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-fc841bbc-962e-4c4e-bb1c-ef2dcee32f80 tempest-ProjectReaderTests-165009307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1330943712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17df51ec-803b-44cb-a770-6d5e1d2c0882,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2254891158940bf81044300c7adb7e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:10:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:10:58Z,use_quota=True,user_id='35dfe42a94cd45139aca9b499fda11af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:10:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-fc841bbc-962e-4c4e-bb1c-ef2dcee32f80 tempest-ProjectReaderTests-165009307 None] Creating volume 17df51ec-803b-44cb-a770-6d5e1d2c0882 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:10:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fc841bbc-962e-4c4e-bb1c-ef2dcee32f80 tempest-ProjectReaderTests-165009307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:10:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fc841bbc-962e-4c4e-bb1c-ef2dcee32f80 tempest-ProjectReaderTests-165009307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:10:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-fc841bbc-962e-4c4e-bb1c-ef2dcee32f80 tempest-ProjectReaderTests-165009307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:10:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-fc841bbc-962e-4c4e-bb1c-ef2dcee32f80 tempest-ProjectReaderTests-165009307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:10:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fc841bbc-962e-4c4e-bb1c-ef2dcee32f80 tempest-ProjectReaderTests-165009307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-fc841bbc-962e-4c4e-bb1c-ef2dcee32f80 tempest-ProjectReaderTests-165009307 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:10:58 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-fc841bbc-962e-4c4e-bb1c-ef2dcee32f80 tempest-ProjectReaderTests-165009307 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:10:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fc841bbc-962e-4c4e-bb1c-ef2dcee32f80 tempest-ProjectReaderTests-165009307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-17df51ec-803b-44cb-a770-6d5e1d2c0882 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:58 devstack sudo[107215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-17df51ec-803b-44cb-a770-6d5e1d2c0882 1073741824 Sep 04 18:10:58 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:58 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fc841bbc-962e-4c4e-bb1c-ef2dcee32f80 tempest-ProjectReaderTests-165009307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-17df51ec-803b-44cb-a770-6d5e1d2c0882 1073741824" returned: 0 in 0.527s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fc841bbc-962e-4c4e-bb1c-ef2dcee32f80 tempest-ProjectReaderTests-165009307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-17df51ec-803b-44cb-a770-6d5e1d2c0882 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:10:58 devstack sudo[107221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-17df51ec-803b-44cb-a770-6d5e1d2c0882 Sep 04 18:10:58 devstack sudo[107221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:10:59 devstack sudo[107221]: pam_unix(sudo:session): session closed for user root Sep 04 18:10:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fc841bbc-962e-4c4e-bb1c-ef2dcee32f80 tempest-ProjectReaderTests-165009307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-17df51ec-803b-44cb-a770-6d5e1d2c0882" returned: 0 in 0.405s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:10:59 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-fc841bbc-962e-4c4e-bb1c-ef2dcee32f80 tempest-ProjectReaderTests-165009307 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:10:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fc841bbc-962e-4c4e-bb1c-ef2dcee32f80 tempest-ProjectReaderTests-165009307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:10:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fc841bbc-962e-4c4e-bb1c-ef2dcee32f80 tempest-ProjectReaderTests-165009307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caa9cb9d-6c33-48e4-b6f2-62dbf525efab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17df51ec-803b-44cb-a770-6d5e1d2c0882', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fc841bbc-962e-4c4e-bb1c-ef2dcee32f80 tempest-ProjectReaderTests-165009307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (105722d9-6f99-4979-bf94-d7ac0ba3b2c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:10:59 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-fc841bbc-962e-4c4e-bb1c-ef2dcee32f80 tempest-ProjectReaderTests-165009307 None] Volume volume-17df51ec-803b-44cb-a770-6d5e1d2c0882 (17df51ec-803b-44cb-a770-6d5e1d2c0882): created successfully Sep 04 18:10:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fc841bbc-962e-4c4e-bb1c-ef2dcee32f80 tempest-ProjectReaderTests-165009307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (105722d9-6f99-4979-bf94-d7ac0ba3b2c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:10:59 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fc841bbc-962e-4c4e-bb1c-ef2dcee32f80 tempest-ProjectReaderTests-165009307 None] Flow 'volume_create_manager' (13db00fc-2a60-440d-9a2d-32532a6df13b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:10:59 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-fc841bbc-962e-4c4e-bb1c-ef2dcee32f80 tempest-ProjectReaderTests-165009307 None] Created volume successfully. Sep 04 18:11:00 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ae403d4b-9f07-44f5-a6db-113fe7b5a116 tempest-ProjectReaderTests-165009307 None] Acquiring lock "cinder-17df51ec-803b-44cb-a770-6d5e1d2c0882-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:11:00 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ae403d4b-9f07-44f5-a6db-113fe7b5a116 tempest-ProjectReaderTests-165009307 None] Lock "cinder-17df51ec-803b-44cb-a770-6d5e1d2c0882-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:11:00 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=197,cinder:UPDATE=278,cinder:INSERT=75,cinder:DELETE=24 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 18:11:00 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:UPDATE=270,cinder:SELECT=193,cinder:INSERT=70,cinder:DELETE=25 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 18:11:00 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ae403d4b-9f07-44f5-a6db-113fe7b5a116 tempest-ProjectReaderTests-165009307 None] Acquiring lock "cinder-quobyte-17df51ec-803b-44cb-a770-6d5e1d2c0882" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:11:00 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ae403d4b-9f07-44f5-a6db-113fe7b5a116 tempest-ProjectReaderTests-165009307 None] Lock "cinder-quobyte-17df51ec-803b-44cb-a770-6d5e1d2c0882" acquired by "delete_volume" :: waited 0.037s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:11:00 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b23898-0631-4d6b-b31a-cc8cfa0485a9]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:11:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ae403d4b-9f07-44f5-a6db-113fe7b5a116 tempest-ProjectReaderTests-165009307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-17df51ec-803b-44cb-a770-6d5e1d2c0882 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:00 devstack sudo[107225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-17df51ec-803b-44cb-a770-6d5e1d2c0882 Sep 04 18:11:00 devstack sudo[107225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:01 devstack sudo[107225]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ae403d4b-9f07-44f5-a6db-113fe7b5a116 tempest-ProjectReaderTests-165009307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-17df51ec-803b-44cb-a770-6d5e1d2c0882" returned: 0 in 0.542s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ae403d4b-9f07-44f5-a6db-113fe7b5a116 tempest-ProjectReaderTests-165009307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-17df51ec-803b-44cb-a770-6d5e1d2c0882 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:01 devstack sudo[107233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-17df51ec-803b-44cb-a770-6d5e1d2c0882 Sep 04 18:11:01 devstack sudo[107233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:01 devstack sudo[107233]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ae403d4b-9f07-44f5-a6db-113fe7b5a116 tempest-ProjectReaderTests-165009307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-17df51ec-803b-44cb-a770-6d5e1d2c0882" returned: 0 in 0.511s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ae403d4b-9f07-44f5-a6db-113fe7b5a116 tempest-ProjectReaderTests-165009307 None] Lock "cinder-quobyte-17df51ec-803b-44cb-a770-6d5e1d2c0882" released by "delete_volume" :: held 1.115s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:11:01 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7d729cb-ca60-45a7-82dd-4f3fb87a0d04 tempest-ProjectReaderTests-189025791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:11:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b7d729cb-ca60-45a7-82dd-4f3fb87a0d04 tempest-ProjectReaderTests-189025791 None] Flow 'volume_create_manager' (657d00d9-7943-4892-a76e-6e08aa2c41fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:11:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b7d729cb-ca60-45a7-82dd-4f3fb87a0d04 tempest-ProjectReaderTests-189025791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9c1a3da-b020-4b54-9ca8-7df94ab08405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:11:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b7d729cb-ca60-45a7-82dd-4f3fb87a0d04 tempest-ProjectReaderTests-189025791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9c1a3da-b020-4b54-9ca8-7df94ab08405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-549615098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cef3d6d2-d59a-4a12-8783-c3bdedaa079f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37323aeb945244598636fe4542f66684',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:11:02Z,use_quota=True,user_id='a8ca54a32a8d4e2a8482566325c0979e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:11:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b7d729cb-ca60-45a7-82dd-4f3fb87a0d04 tempest-ProjectReaderTests-189025791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (393d1bc9-c4ea-46dd-bf4e-bffbd836dc40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:11:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b7d729cb-ca60-45a7-82dd-4f3fb87a0d04 tempest-ProjectReaderTests-189025791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (393d1bc9-c4ea-46dd-bf4e-bffbd836dc40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:11:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b7d729cb-ca60-45a7-82dd-4f3fb87a0d04 tempest-ProjectReaderTests-189025791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8969d576-a3e8-4b62-a13a-c2ac46d77043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:11:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b7d729cb-ca60-45a7-82dd-4f3fb87a0d04 tempest-ProjectReaderTests-189025791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8969d576-a3e8-4b62-a13a-c2ac46d77043) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cef3d6d2-d59a-4a12-8783-c3bdedaa079f', 'volume_name': 'volume-cef3d6d2-d59a-4a12-8783-c3bdedaa079f', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:11:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b7d729cb-ca60-45a7-82dd-4f3fb87a0d04 tempest-ProjectReaderTests-189025791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71c30233-ad1b-4e43-89b7-6277395ce835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:11:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b7d729cb-ca60-45a7-82dd-4f3fb87a0d04 tempest-ProjectReaderTests-189025791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71c30233-ad1b-4e43-89b7-6277395ce835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:11:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b7d729cb-ca60-45a7-82dd-4f3fb87a0d04 tempest-ProjectReaderTests-189025791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (985311c2-8d0d-4492-aa45-d5acfe43865f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:11:01 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-b7d729cb-ca60-45a7-82dd-4f3fb87a0d04 tempest-ProjectReaderTests-189025791 None] Volume cef3d6d2-d59a-4a12-8783-c3bdedaa079f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cef3d6d2-d59a-4a12-8783-c3bdedaa079f', 'volume_size': 1} Sep 04 18:11:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b7d729cb-ca60-45a7-82dd-4f3fb87a0d04 tempest-ProjectReaderTests-189025791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:11:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b7d729cb-ca60-45a7-82dd-4f3fb87a0d04 tempest-ProjectReaderTests-189025791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:11:01 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b7d729cb-ca60-45a7-82dd-4f3fb87a0d04 tempest-ProjectReaderTests-189025791 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-549615098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cef3d6d2-d59a-4a12-8783-c3bdedaa079f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37323aeb945244598636fe4542f66684',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:11:02Z,use_quota=True,user_id='a8ca54a32a8d4e2a8482566325c0979e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:11:01 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-b7d729cb-ca60-45a7-82dd-4f3fb87a0d04 tempest-ProjectReaderTests-189025791 None] Creating volume cef3d6d2-d59a-4a12-8783-c3bdedaa079f {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:11:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b7d729cb-ca60-45a7-82dd-4f3fb87a0d04 tempest-ProjectReaderTests-189025791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:11:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b7d729cb-ca60-45a7-82dd-4f3fb87a0d04 tempest-ProjectReaderTests-189025791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:11:01 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b7d729cb-ca60-45a7-82dd-4f3fb87a0d04 tempest-ProjectReaderTests-189025791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:11:01 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b7d729cb-ca60-45a7-82dd-4f3fb87a0d04 tempest-ProjectReaderTests-189025791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:11:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b7d729cb-ca60-45a7-82dd-4f3fb87a0d04 tempest-ProjectReaderTests-189025791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:11:01 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b7d729cb-ca60-45a7-82dd-4f3fb87a0d04 tempest-ProjectReaderTests-189025791 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:11:01 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-b7d729cb-ca60-45a7-82dd-4f3fb87a0d04 tempest-ProjectReaderTests-189025791 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:11:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b7d729cb-ca60-45a7-82dd-4f3fb87a0d04 tempest-ProjectReaderTests-189025791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cef3d6d2-d59a-4a12-8783-c3bdedaa079f 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:01 devstack sudo[107239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cef3d6d2-d59a-4a12-8783-c3bdedaa079f 1073741824 Sep 04 18:11:01 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:01 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-ae403d4b-9f07-44f5-a6db-113fe7b5a116 tempest-ProjectReaderTests-165009307 None] Created reservations ['b0634622-4b98-44b0-b07c-ed41a9cf9475', '89404fb8-6064-4685-b580-7dd6061f8177', 'e8ac949e-ca6f-440e-8e9a-bfb521d6c5c7', '6c79f85c-7b0e-4ae4-a224-2ff585f4b24c'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:11:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ae403d4b-9f07-44f5-a6db-113fe7b5a116 tempest-ProjectReaderTests-165009307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:11:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ae403d4b-9f07-44f5-a6db-113fe7b5a116 tempest-ProjectReaderTests-165009307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:11:02 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ae403d4b-9f07-44f5-a6db-113fe7b5a116 tempest-ProjectReaderTests-165009307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:11:02 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ae403d4b-9f07-44f5-a6db-113fe7b5a116 tempest-ProjectReaderTests-165009307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:11:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ae403d4b-9f07-44f5-a6db-113fe7b5a116 tempest-ProjectReaderTests-165009307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:11:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ae403d4b-9f07-44f5-a6db-113fe7b5a116 tempest-ProjectReaderTests-165009307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:02 devstack sudo[107241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:11:02 devstack sudo[107241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:02 devstack sudo[107241]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ae403d4b-9f07-44f5-a6db-113fe7b5a116 tempest-ProjectReaderTests-165009307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.344s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:02 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-ae403d4b-9f07-44f5-a6db-113fe7b5a116 tempest-ProjectReaderTests-165009307 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:11:02 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-ae403d4b-9f07-44f5-a6db-113fe7b5a116 tempest-ProjectReaderTests-165009307 None] Deleted volume successfully. Sep 04 18:11:02 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ae403d4b-9f07-44f5-a6db-113fe7b5a116 tempest-ProjectReaderTests-165009307 None] Lock "cinder-17df51ec-803b-44cb-a770-6d5e1d2c0882-delete_volume" released by "delete_volume" :: held 2.028s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:11:02 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b7d729cb-ca60-45a7-82dd-4f3fb87a0d04 tempest-ProjectReaderTests-189025791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cef3d6d2-d59a-4a12-8783-c3bdedaa079f 1073741824" returned: 0 in 0.635s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:02 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-24942405-80b1-4903-a8b2-102628e09c32 tempest-CinderUnicodeTest-735511110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:11:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-24942405-80b1-4903-a8b2-102628e09c32 tempest-CinderUnicodeTest-735511110 None] Flow 'volume_create_manager' (dd951047-8dbf-4d77-9c51-3cadc825b58f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:11:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-24942405-80b1-4903-a8b2-102628e09c32 tempest-CinderUnicodeTest-735511110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ece9b8b1-ef9d-4e35-ba60-488c14456ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:11:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-24942405-80b1-4903-a8b2-102628e09c32 tempest-CinderUnicodeTest-735511110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ece9b8b1-ef9d-4e35-ba60-488c14456ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13860350-1f71-4594-97cd-3032d00d785d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58aca8810f5f4def9b74d00a59569537',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:11:03Z,use_quota=True,user_id='6300dbd077f8466ab948e039284a947f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:11:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-24942405-80b1-4903-a8b2-102628e09c32 tempest-CinderUnicodeTest-735511110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46c6638c-4d93-4650-9872-70de2df0ae7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:11:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-24942405-80b1-4903-a8b2-102628e09c32 tempest-CinderUnicodeTest-735511110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46c6638c-4d93-4650-9872-70de2df0ae7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:11:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-24942405-80b1-4903-a8b2-102628e09c32 tempest-CinderUnicodeTest-735511110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e217f91e-f912-4c7f-9638-a858083a3b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:11:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-24942405-80b1-4903-a8b2-102628e09c32 tempest-CinderUnicodeTest-735511110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e217f91e-f912-4c7f-9638-a858083a3b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13860350-1f71-4594-97cd-3032d00d785d', 'volume_name': 'volume-13860350-1f71-4594-97cd-3032d00d785d', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:11:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-24942405-80b1-4903-a8b2-102628e09c32 tempest-CinderUnicodeTest-735511110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57a7bf65-f10e-4750-adff-1eb88c6faabd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:11:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-24942405-80b1-4903-a8b2-102628e09c32 tempest-CinderUnicodeTest-735511110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57a7bf65-f10e-4750-adff-1eb88c6faabd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:11:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-24942405-80b1-4903-a8b2-102628e09c32 tempest-CinderUnicodeTest-735511110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13a0a44f-64e8-47b4-8f3d-8fe9f014f93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:11:02 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-24942405-80b1-4903-a8b2-102628e09c32 tempest-CinderUnicodeTest-735511110 None] Volume 13860350-1f71-4594-97cd-3032d00d785d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13860350-1f71-4594-97cd-3032d00d785d', 'volume_size': 1} Sep 04 18:11:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-24942405-80b1-4903-a8b2-102628e09c32 tempest-CinderUnicodeTest-735511110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:11:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b7d729cb-ca60-45a7-82dd-4f3fb87a0d04 tempest-ProjectReaderTests-189025791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cef3d6d2-d59a-4a12-8783-c3bdedaa079f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:02 devstack sudo[107248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cef3d6d2-d59a-4a12-8783-c3bdedaa079f Sep 04 18:11:02 devstack sudo[107248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:02 devstack sudo[107248]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b7d729cb-ca60-45a7-82dd-4f3fb87a0d04 tempest-ProjectReaderTests-189025791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cef3d6d2-d59a-4a12-8783-c3bdedaa079f" returned: 0 in 0.320s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:02 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b7d729cb-ca60-45a7-82dd-4f3fb87a0d04 tempest-ProjectReaderTests-189025791 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:11:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b7d729cb-ca60-45a7-82dd-4f3fb87a0d04 tempest-ProjectReaderTests-189025791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:11:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-24942405-80b1-4903-a8b2-102628e09c32 tempest-CinderUnicodeTest-735511110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.328s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:11:02 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-24942405-80b1-4903-a8b2-102628e09c32 tempest-CinderUnicodeTest-735511110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13860350-1f71-4594-97cd-3032d00d785d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58aca8810f5f4def9b74d00a59569537',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:11:03Z,use_quota=True,user_id='6300dbd077f8466ab948e039284a947f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:11:02 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-24942405-80b1-4903-a8b2-102628e09c32 tempest-CinderUnicodeTest-735511110 None] Creating volume 13860350-1f71-4594-97cd-3032d00d785d {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:11:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-24942405-80b1-4903-a8b2-102628e09c32 tempest-CinderUnicodeTest-735511110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:11:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-24942405-80b1-4903-a8b2-102628e09c32 tempest-CinderUnicodeTest-735511110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:11:03 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-24942405-80b1-4903-a8b2-102628e09c32 tempest-CinderUnicodeTest-735511110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:11:03 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-24942405-80b1-4903-a8b2-102628e09c32 tempest-CinderUnicodeTest-735511110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:11:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-24942405-80b1-4903-a8b2-102628e09c32 tempest-CinderUnicodeTest-735511110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:11:03 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-24942405-80b1-4903-a8b2-102628e09c32 tempest-CinderUnicodeTest-735511110 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:11:03 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-24942405-80b1-4903-a8b2-102628e09c32 tempest-CinderUnicodeTest-735511110 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:11:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-24942405-80b1-4903-a8b2-102628e09c32 tempest-CinderUnicodeTest-735511110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-13860350-1f71-4594-97cd-3032d00d785d 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b7d729cb-ca60-45a7-82dd-4f3fb87a0d04 tempest-ProjectReaderTests-189025791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (985311c2-8d0d-4492-aa45-d5acfe43865f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cef3d6d2-d59a-4a12-8783-c3bdedaa079f', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:11:03 devstack sudo[107253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-13860350-1f71-4594-97cd-3032d00d785d 1073741824 Sep 04 18:11:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b7d729cb-ca60-45a7-82dd-4f3fb87a0d04 tempest-ProjectReaderTests-189025791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a022dc7b-5409-492e-85a4-c73b3e708803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:11:03 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:03 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-b7d729cb-ca60-45a7-82dd-4f3fb87a0d04 tempest-ProjectReaderTests-189025791 None] Volume volume-cef3d6d2-d59a-4a12-8783-c3bdedaa079f (cef3d6d2-d59a-4a12-8783-c3bdedaa079f): created successfully Sep 04 18:11:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b7d729cb-ca60-45a7-82dd-4f3fb87a0d04 tempest-ProjectReaderTests-189025791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a022dc7b-5409-492e-85a4-c73b3e708803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:11:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b7d729cb-ca60-45a7-82dd-4f3fb87a0d04 tempest-ProjectReaderTests-189025791 None] Flow 'volume_create_manager' (657d00d9-7943-4892-a76e-6e08aa2c41fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:11:03 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-b7d729cb-ca60-45a7-82dd-4f3fb87a0d04 tempest-ProjectReaderTests-189025791 None] Created volume successfully. Sep 04 18:11:03 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b155955-b84b-46d6-8055-bf20bf34ed50 tempest-ProjectReaderTests-165009307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:11:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1b155955-b84b-46d6-8055-bf20bf34ed50 tempest-ProjectReaderTests-165009307 None] Flow 'volume_create_manager' (d091f5d6-e497-4ae4-a543-b7d8baa101d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:11:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1b155955-b84b-46d6-8055-bf20bf34ed50 tempest-ProjectReaderTests-165009307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55382635-955a-459a-977a-88e3df6974f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:11:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1b155955-b84b-46d6-8055-bf20bf34ed50 tempest-ProjectReaderTests-165009307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55382635-955a-459a-977a-88e3df6974f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:11:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-734899273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8b79182-c03e-4878-a4b9-3afb4e7d1c64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2254891158940bf81044300c7adb7e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:11:03Z,use_quota=True,user_id='35dfe42a94cd45139aca9b499fda11af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:11:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1b155955-b84b-46d6-8055-bf20bf34ed50 tempest-ProjectReaderTests-165009307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80a06fbf-e601-4b40-a11a-b104ba66999c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:11:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1b155955-b84b-46d6-8055-bf20bf34ed50 tempest-ProjectReaderTests-165009307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80a06fbf-e601-4b40-a11a-b104ba66999c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:11:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1b155955-b84b-46d6-8055-bf20bf34ed50 tempest-ProjectReaderTests-165009307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79431431-e6d3-479f-9de4-805971f27d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:11:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1b155955-b84b-46d6-8055-bf20bf34ed50 tempest-ProjectReaderTests-165009307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79431431-e6d3-479f-9de4-805971f27d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8b79182-c03e-4878-a4b9-3afb4e7d1c64', 'volume_name': 'volume-e8b79182-c03e-4878-a4b9-3afb4e7d1c64', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:11:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1b155955-b84b-46d6-8055-bf20bf34ed50 tempest-ProjectReaderTests-165009307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08739275-0796-4f8c-82b0-03e3e1d65a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:11:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1b155955-b84b-46d6-8055-bf20bf34ed50 tempest-ProjectReaderTests-165009307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08739275-0796-4f8c-82b0-03e3e1d65a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:11:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1b155955-b84b-46d6-8055-bf20bf34ed50 tempest-ProjectReaderTests-165009307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd2111b6-552a-4380-8544-878d04674370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:11:03 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-1b155955-b84b-46d6-8055-bf20bf34ed50 tempest-ProjectReaderTests-165009307 None] Volume e8b79182-c03e-4878-a4b9-3afb4e7d1c64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8b79182-c03e-4878-a4b9-3afb4e7d1c64', 'volume_size': 1} Sep 04 18:11:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1b155955-b84b-46d6-8055-bf20bf34ed50 tempest-ProjectReaderTests-165009307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:11:03 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-24942405-80b1-4903-a8b2-102628e09c32 tempest-CinderUnicodeTest-735511110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-13860350-1f71-4594-97cd-3032d00d785d 1073741824" returned: 0 in 0.549s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-24942405-80b1-4903-a8b2-102628e09c32 tempest-CinderUnicodeTest-735511110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-13860350-1f71-4594-97cd-3032d00d785d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:03 devstack sudo[107259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-13860350-1f71-4594-97cd-3032d00d785d Sep 04 18:11:03 devstack sudo[107259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:03 devstack sudo[107259]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-24942405-80b1-4903-a8b2-102628e09c32 tempest-CinderUnicodeTest-735511110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-13860350-1f71-4594-97cd-3032d00d785d" returned: 0 in 0.248s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:03 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-24942405-80b1-4903-a8b2-102628e09c32 tempest-CinderUnicodeTest-735511110 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:11:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-24942405-80b1-4903-a8b2-102628e09c32 tempest-CinderUnicodeTest-735511110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:11:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1b155955-b84b-46d6-8055-bf20bf34ed50 tempest-ProjectReaderTests-165009307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.389s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:11:03 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-1b155955-b84b-46d6-8055-bf20bf34ed50 tempest-ProjectReaderTests-165009307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:11:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-734899273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8b79182-c03e-4878-a4b9-3afb4e7d1c64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2254891158940bf81044300c7adb7e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:11:03Z,use_quota=True,user_id='35dfe42a94cd45139aca9b499fda11af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:11:03 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-1b155955-b84b-46d6-8055-bf20bf34ed50 tempest-ProjectReaderTests-165009307 None] Creating volume e8b79182-c03e-4878-a4b9-3afb4e7d1c64 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:11:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1b155955-b84b-46d6-8055-bf20bf34ed50 tempest-ProjectReaderTests-165009307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:11:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1b155955-b84b-46d6-8055-bf20bf34ed50 tempest-ProjectReaderTests-165009307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:11:03 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-1b155955-b84b-46d6-8055-bf20bf34ed50 tempest-ProjectReaderTests-165009307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:11:03 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-1b155955-b84b-46d6-8055-bf20bf34ed50 tempest-ProjectReaderTests-165009307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:11:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1b155955-b84b-46d6-8055-bf20bf34ed50 tempest-ProjectReaderTests-165009307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:11:03 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-1b155955-b84b-46d6-8055-bf20bf34ed50 tempest-ProjectReaderTests-165009307 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:11:03 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-1b155955-b84b-46d6-8055-bf20bf34ed50 tempest-ProjectReaderTests-165009307 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:11:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1b155955-b84b-46d6-8055-bf20bf34ed50 tempest-ProjectReaderTests-165009307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-e8b79182-c03e-4878-a4b9-3afb4e7d1c64 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-24942405-80b1-4903-a8b2-102628e09c32 tempest-CinderUnicodeTest-735511110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13a0a44f-64e8-47b4-8f3d-8fe9f014f93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13860350-1f71-4594-97cd-3032d00d785d', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:11:03 devstack sudo[107262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-e8b79182-c03e-4878-a4b9-3afb4e7d1c64 1073741824 Sep 04 18:11:03 devstack sudo[107262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-24942405-80b1-4903-a8b2-102628e09c32 tempest-CinderUnicodeTest-735511110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46799617-3f0a-4fa4-b5a0-121a6078a182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:11:03 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-24942405-80b1-4903-a8b2-102628e09c32 tempest-CinderUnicodeTest-735511110 None] Volume volume-13860350-1f71-4594-97cd-3032d00d785d (13860350-1f71-4594-97cd-3032d00d785d): created successfully Sep 04 18:11:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-24942405-80b1-4903-a8b2-102628e09c32 tempest-CinderUnicodeTest-735511110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46799617-3f0a-4fa4-b5a0-121a6078a182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:11:03 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-24942405-80b1-4903-a8b2-102628e09c32 tempest-CinderUnicodeTest-735511110 None] Flow 'volume_create_manager' (dd951047-8dbf-4d77-9c51-3cadc825b58f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:11:03 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-24942405-80b1-4903-a8b2-102628e09c32 tempest-CinderUnicodeTest-735511110 None] Created volume successfully. Sep 04 18:11:04 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-96e25e9d-1b6a-42d0-a1ab-49282481feb0 tempest-ProjectReaderTests-189025791 None] Acquiring lock "cinder-cef3d6d2-d59a-4a12-8783-c3bdedaa079f-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:11:04 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-96e25e9d-1b6a-42d0-a1ab-49282481feb0 tempest-ProjectReaderTests-189025791 None] Lock "cinder-cef3d6d2-d59a-4a12-8783-c3bdedaa079f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:11:04 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-96e25e9d-1b6a-42d0-a1ab-49282481feb0 tempest-ProjectReaderTests-189025791 None] Acquiring lock "cinder-quobyte-cef3d6d2-d59a-4a12-8783-c3bdedaa079f" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:11:04 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-96e25e9d-1b6a-42d0-a1ab-49282481feb0 tempest-ProjectReaderTests-189025791 None] Lock "cinder-quobyte-cef3d6d2-d59a-4a12-8783-c3bdedaa079f" acquired by "delete_volume" :: waited 0.016s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:11:04 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[2533ebff-1c28-4e27-ac3f-c1d8f452f3fa]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:11:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-96e25e9d-1b6a-42d0-a1ab-49282481feb0 tempest-ProjectReaderTests-189025791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cef3d6d2-d59a-4a12-8783-c3bdedaa079f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:04 devstack sudo[107268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cef3d6d2-d59a-4a12-8783-c3bdedaa079f Sep 04 18:11:04 devstack sudo[107268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:04 devstack sudo[107262]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1b155955-b84b-46d6-8055-bf20bf34ed50 tempest-ProjectReaderTests-165009307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-e8b79182-c03e-4878-a4b9-3afb4e7d1c64 1073741824" returned: 0 in 0.620s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1b155955-b84b-46d6-8055-bf20bf34ed50 tempest-ProjectReaderTests-165009307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-e8b79182-c03e-4878-a4b9-3afb4e7d1c64 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:04 devstack sudo[107270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-e8b79182-c03e-4878-a4b9-3afb4e7d1c64 Sep 04 18:11:04 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:04 devstack sudo[107268]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-96e25e9d-1b6a-42d0-a1ab-49282481feb0 tempest-ProjectReaderTests-189025791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cef3d6d2-d59a-4a12-8783-c3bdedaa079f" returned: 0 in 0.574s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-96e25e9d-1b6a-42d0-a1ab-49282481feb0 tempest-ProjectReaderTests-189025791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cef3d6d2-d59a-4a12-8783-c3bdedaa079f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:04 devstack sudo[107275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cef3d6d2-d59a-4a12-8783-c3bdedaa079f Sep 04 18:11:04 devstack sudo[107275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:04 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-1b155955-b84b-46d6-8055-bf20bf34ed50 tempest-ProjectReaderTests-165009307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-e8b79182-c03e-4878-a4b9-3afb4e7d1c64" returned: 0 in 0.370s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:04 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-1b155955-b84b-46d6-8055-bf20bf34ed50 tempest-ProjectReaderTests-165009307 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:11:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-1b155955-b84b-46d6-8055-bf20bf34ed50 tempest-ProjectReaderTests-165009307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:11:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1b155955-b84b-46d6-8055-bf20bf34ed50 tempest-ProjectReaderTests-165009307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd2111b6-552a-4380-8544-878d04674370) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8b79182-c03e-4878-a4b9-3afb4e7d1c64', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:11:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1b155955-b84b-46d6-8055-bf20bf34ed50 tempest-ProjectReaderTests-165009307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41ac1cdf-63d9-44ae-8739-a476383e6e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:11:04 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-1b155955-b84b-46d6-8055-bf20bf34ed50 tempest-ProjectReaderTests-165009307 None] Volume volume-e8b79182-c03e-4878-a4b9-3afb4e7d1c64 (e8b79182-c03e-4878-a4b9-3afb4e7d1c64): created successfully Sep 04 18:11:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1b155955-b84b-46d6-8055-bf20bf34ed50 tempest-ProjectReaderTests-165009307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41ac1cdf-63d9-44ae-8739-a476383e6e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:11:04 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-1b155955-b84b-46d6-8055-bf20bf34ed50 tempest-ProjectReaderTests-165009307 None] Flow 'volume_create_manager' (d091f5d6-e497-4ae4-a543-b7d8baa101d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:11:04 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-1b155955-b84b-46d6-8055-bf20bf34ed50 tempest-ProjectReaderTests-165009307 None] Created volume successfully. Sep 04 18:11:05 devstack sudo[107275]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-96e25e9d-1b6a-42d0-a1ab-49282481feb0 tempest-ProjectReaderTests-189025791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-cef3d6d2-d59a-4a12-8783-c3bdedaa079f" returned: 0 in 0.387s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:05 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-96e25e9d-1b6a-42d0-a1ab-49282481feb0 tempest-ProjectReaderTests-189025791 None] Lock "cinder-quobyte-cef3d6d2-d59a-4a12-8783-c3bdedaa079f" released by "delete_volume" :: held 1.011s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:11:05 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-96e25e9d-1b6a-42d0-a1ab-49282481feb0 tempest-ProjectReaderTests-189025791 None] Created reservations ['98257eb5-b906-4acd-abc9-90f051484161', '85f8beb9-6b5d-4669-a839-cbb28b4dac1f', 'bcc95c5b-d96d-4bc2-bdb6-5cf7ac70aa32', '11266f43-8e74-435a-9ecc-b542f83f20db'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:11:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-96e25e9d-1b6a-42d0-a1ab-49282481feb0 tempest-ProjectReaderTests-189025791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:11:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-96e25e9d-1b6a-42d0-a1ab-49282481feb0 tempest-ProjectReaderTests-189025791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:11:05 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-96e25e9d-1b6a-42d0-a1ab-49282481feb0 tempest-ProjectReaderTests-189025791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:11:05 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-96e25e9d-1b6a-42d0-a1ab-49282481feb0 tempest-ProjectReaderTests-189025791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:11:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-96e25e9d-1b6a-42d0-a1ab-49282481feb0 tempest-ProjectReaderTests-189025791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:11:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-96e25e9d-1b6a-42d0-a1ab-49282481feb0 tempest-ProjectReaderTests-189025791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:05 devstack sudo[107279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:11:05 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:05 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b4f64f2-36ec-4181-bb49-fde9c3ecfad1 tempest-CinderUnicodeTest-735511110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:11:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9b4f64f2-36ec-4181-bb49-fde9c3ecfad1 tempest-CinderUnicodeTest-735511110 None] Flow 'volume_create_manager' (b57407cf-76bd-40fd-a764-5bacfc3c103c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:11:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9b4f64f2-36ec-4181-bb49-fde9c3ecfad1 tempest-CinderUnicodeTest-735511110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dca95d2f-5899-4ed2-b606-cff1e4b08408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:11:05 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2ac29918-e8d1-430a-b043-79d69da060e3 tempest-ProjectReaderTests-165009307 None] Acquiring lock "cinder-e8b79182-c03e-4878-a4b9-3afb4e7d1c64-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:11:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9b4f64f2-36ec-4181-bb49-fde9c3ecfad1 tempest-CinderUnicodeTest-735511110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dca95d2f-5899-4ed2-b606-cff1e4b08408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:11:05Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2104158744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0ecd42b-aaba-4235-ae35-5cb460eedc59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58aca8810f5f4def9b74d00a59569537',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:11:05Z,use_quota=True,user_id='6300dbd077f8466ab948e039284a947f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:11:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9b4f64f2-36ec-4181-bb49-fde9c3ecfad1 tempest-CinderUnicodeTest-735511110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d8bf214-f67c-49c0-b862-421c68dec7e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:11:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9b4f64f2-36ec-4181-bb49-fde9c3ecfad1 tempest-CinderUnicodeTest-735511110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d8bf214-f67c-49c0-b862-421c68dec7e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:11:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9b4f64f2-36ec-4181-bb49-fde9c3ecfad1 tempest-CinderUnicodeTest-735511110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc02f25e-5c2d-4ec2-8955-47f7f08f1932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:11:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9b4f64f2-36ec-4181-bb49-fde9c3ecfad1 tempest-CinderUnicodeTest-735511110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc02f25e-5c2d-4ec2-8955-47f7f08f1932) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0ecd42b-aaba-4235-ae35-5cb460eedc59', 'volume_name': 'volume-d0ecd42b-aaba-4235-ae35-5cb460eedc59', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:11:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9b4f64f2-36ec-4181-bb49-fde9c3ecfad1 tempest-CinderUnicodeTest-735511110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29599d3e-cd1b-45cc-a6e9-13ef38149e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:11:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9b4f64f2-36ec-4181-bb49-fde9c3ecfad1 tempest-CinderUnicodeTest-735511110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29599d3e-cd1b-45cc-a6e9-13ef38149e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:11:05 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9b4f64f2-36ec-4181-bb49-fde9c3ecfad1 tempest-CinderUnicodeTest-735511110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3e197ef-07c2-4669-9a1f-a9d14b8fddec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:11:05 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-9b4f64f2-36ec-4181-bb49-fde9c3ecfad1 tempest-CinderUnicodeTest-735511110 None] Volume d0ecd42b-aaba-4235-ae35-5cb460eedc59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0ecd42b-aaba-4235-ae35-5cb460eedc59', 'volume_size': 1} Sep 04 18:11:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9b4f64f2-36ec-4181-bb49-fde9c3ecfad1 tempest-CinderUnicodeTest-735511110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:11:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9b4f64f2-36ec-4181-bb49-fde9c3ecfad1 tempest-CinderUnicodeTest-735511110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:11:05 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9b4f64f2-36ec-4181-bb49-fde9c3ecfad1 tempest-CinderUnicodeTest-735511110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:11:05Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2104158744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0ecd42b-aaba-4235-ae35-5cb460eedc59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58aca8810f5f4def9b74d00a59569537',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:11:05Z,use_quota=True,user_id='6300dbd077f8466ab948e039284a947f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:11:05 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-9b4f64f2-36ec-4181-bb49-fde9c3ecfad1 tempest-CinderUnicodeTest-735511110 None] Creating volume d0ecd42b-aaba-4235-ae35-5cb460eedc59 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:11:05 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9b4f64f2-36ec-4181-bb49-fde9c3ecfad1 tempest-CinderUnicodeTest-735511110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:11:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9b4f64f2-36ec-4181-bb49-fde9c3ecfad1 tempest-CinderUnicodeTest-735511110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:11:05 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9b4f64f2-36ec-4181-bb49-fde9c3ecfad1 tempest-CinderUnicodeTest-735511110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:11:05 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9b4f64f2-36ec-4181-bb49-fde9c3ecfad1 tempest-CinderUnicodeTest-735511110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:11:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9b4f64f2-36ec-4181-bb49-fde9c3ecfad1 tempest-CinderUnicodeTest-735511110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:11:05 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9b4f64f2-36ec-4181-bb49-fde9c3ecfad1 tempest-CinderUnicodeTest-735511110 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:11:05 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-9b4f64f2-36ec-4181-bb49-fde9c3ecfad1 tempest-CinderUnicodeTest-735511110 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:11:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9b4f64f2-36ec-4181-bb49-fde9c3ecfad1 tempest-CinderUnicodeTest-735511110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d0ecd42b-aaba-4235-ae35-5cb460eedc59 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:05 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2ac29918-e8d1-430a-b043-79d69da060e3 tempest-ProjectReaderTests-165009307 None] Lock "cinder-e8b79182-c03e-4878-a4b9-3afb4e7d1c64-delete_volume" acquired by "delete_volume" :: waited 0.118s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:11:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-96e25e9d-1b6a-42d0-a1ab-49282481feb0 tempest-ProjectReaderTests-189025791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.321s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:05 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-96e25e9d-1b6a-42d0-a1ab-49282481feb0 tempest-ProjectReaderTests-189025791 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:11:05 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-96e25e9d-1b6a-42d0-a1ab-49282481feb0 tempest-ProjectReaderTests-189025791 None] Deleted volume successfully. Sep 04 18:11:05 devstack sudo[107282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d0ecd42b-aaba-4235-ae35-5cb460eedc59 1073741824 Sep 04 18:11:05 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:05 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-96e25e9d-1b6a-42d0-a1ab-49282481feb0 tempest-ProjectReaderTests-189025791 None] Lock "cinder-cef3d6d2-d59a-4a12-8783-c3bdedaa079f-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:11:05 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2ac29918-e8d1-430a-b043-79d69da060e3 tempest-ProjectReaderTests-165009307 None] Acquiring lock "cinder-quobyte-e8b79182-c03e-4878-a4b9-3afb4e7d1c64" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:11:05 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2ac29918-e8d1-430a-b043-79d69da060e3 tempest-ProjectReaderTests-165009307 None] Lock "cinder-quobyte-e8b79182-c03e-4878-a4b9-3afb4e7d1c64" acquired by "delete_volume" :: waited 0.015s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:11:05 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28f0ba5-5b36-41ba-a2d7-8f44397dc699]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:11:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2ac29918-e8d1-430a-b043-79d69da060e3 tempest-ProjectReaderTests-165009307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-e8b79182-c03e-4878-a4b9-3afb4e7d1c64 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:05 devstack sudo[107284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-e8b79182-c03e-4878-a4b9-3afb4e7d1c64 Sep 04 18:11:05 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:06 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9b4f64f2-36ec-4181-bb49-fde9c3ecfad1 tempest-CinderUnicodeTest-735511110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d0ecd42b-aaba-4235-ae35-5cb460eedc59 1073741824" returned: 0 in 0.512s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:06 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2ac29918-e8d1-430a-b043-79d69da060e3 tempest-ProjectReaderTests-165009307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-e8b79182-c03e-4878-a4b9-3afb4e7d1c64" returned: 0 in 0.412s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2ac29918-e8d1-430a-b043-79d69da060e3 tempest-ProjectReaderTests-165009307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-e8b79182-c03e-4878-a4b9-3afb4e7d1c64 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:06 devstack sudo[107293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-e8b79182-c03e-4878-a4b9-3afb4e7d1c64 Sep 04 18:11:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9b4f64f2-36ec-4181-bb49-fde9c3ecfad1 tempest-CinderUnicodeTest-735511110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d0ecd42b-aaba-4235-ae35-5cb460eedc59 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:06 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:06 devstack sudo[107295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d0ecd42b-aaba-4235-ae35-5cb460eedc59 Sep 04 18:11:06 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:06 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9b4f64f2-36ec-4181-bb49-fde9c3ecfad1 tempest-CinderUnicodeTest-735511110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d0ecd42b-aaba-4235-ae35-5cb460eedc59" returned: 0 in 0.293s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:06 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-9b4f64f2-36ec-4181-bb49-fde9c3ecfad1 tempest-CinderUnicodeTest-735511110 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:11:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-9b4f64f2-36ec-4181-bb49-fde9c3ecfad1 tempest-CinderUnicodeTest-735511110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:11:06 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2ac29918-e8d1-430a-b043-79d69da060e3 tempest-ProjectReaderTests-165009307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-e8b79182-c03e-4878-a4b9-3afb4e7d1c64" returned: 0 in 0.338s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9b4f64f2-36ec-4181-bb49-fde9c3ecfad1 tempest-CinderUnicodeTest-735511110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3e197ef-07c2-4669-9a1f-a9d14b8fddec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0ecd42b-aaba-4235-ae35-5cb460eedc59', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:11:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9b4f64f2-36ec-4181-bb49-fde9c3ecfad1 tempest-CinderUnicodeTest-735511110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d2dbb7d-811a-4a0e-a765-4645e52d5c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:11:06 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2ac29918-e8d1-430a-b043-79d69da060e3 tempest-ProjectReaderTests-165009307 None] Lock "cinder-quobyte-e8b79182-c03e-4878-a4b9-3afb4e7d1c64" released by "delete_volume" :: held 0.822s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:11:06 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-9b4f64f2-36ec-4181-bb49-fde9c3ecfad1 tempest-CinderUnicodeTest-735511110 None] Volume volume-d0ecd42b-aaba-4235-ae35-5cb460eedc59 (d0ecd42b-aaba-4235-ae35-5cb460eedc59): created successfully Sep 04 18:11:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9b4f64f2-36ec-4181-bb49-fde9c3ecfad1 tempest-CinderUnicodeTest-735511110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d2dbb7d-811a-4a0e-a765-4645e52d5c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:11:06 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-9b4f64f2-36ec-4181-bb49-fde9c3ecfad1 tempest-CinderUnicodeTest-735511110 None] Flow 'volume_create_manager' (b57407cf-76bd-40fd-a764-5bacfc3c103c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:11:06 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-9b4f64f2-36ec-4181-bb49-fde9c3ecfad1 tempest-CinderUnicodeTest-735511110 None] Created volume successfully. Sep 04 18:11:06 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-2ac29918-e8d1-430a-b043-79d69da060e3 tempest-ProjectReaderTests-165009307 None] Created reservations ['d906143a-8373-471d-ab7c-f8e8f89cc980', '4afd42dd-8d6b-4c86-a22b-6aaf79cee184', 'caba97b2-7dd0-4fa7-9ed7-8cefebae257a', '5205e58d-0b34-4728-97d9-3022cce68683'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:11:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-2ac29918-e8d1-430a-b043-79d69da060e3 tempest-ProjectReaderTests-165009307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:11:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-2ac29918-e8d1-430a-b043-79d69da060e3 tempest-ProjectReaderTests-165009307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:11:06 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-2ac29918-e8d1-430a-b043-79d69da060e3 tempest-ProjectReaderTests-165009307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:11:06 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-2ac29918-e8d1-430a-b043-79d69da060e3 tempest-ProjectReaderTests-165009307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:11:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-2ac29918-e8d1-430a-b043-79d69da060e3 tempest-ProjectReaderTests-165009307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:11:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2ac29918-e8d1-430a-b043-79d69da060e3 tempest-ProjectReaderTests-165009307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:06 devstack sudo[107299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:11:06 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:07 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac89399d-713c-47b4-a77c-3bf6b5b0dd1d tempest-ProjectReaderTests-189025791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:11:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ac89399d-713c-47b4-a77c-3bf6b5b0dd1d tempest-ProjectReaderTests-189025791 None] Flow 'volume_create_manager' (fea96956-6569-4024-be91-50942b0f82fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:11:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ac89399d-713c-47b4-a77c-3bf6b5b0dd1d tempest-ProjectReaderTests-189025791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d0a9ee9-1a7a-45c1-95e9-027c7b2a9d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:11:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ac89399d-713c-47b4-a77c-3bf6b5b0dd1d tempest-ProjectReaderTests-189025791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d0a9ee9-1a7a-45c1-95e9-027c7b2a9d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:11:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1043202981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf2d0ba7-2143-4bbd-aa9e-75ce9213bcb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37323aeb945244598636fe4542f66684',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:11:07Z,use_quota=True,user_id='a8ca54a32a8d4e2a8482566325c0979e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:11:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ac89399d-713c-47b4-a77c-3bf6b5b0dd1d tempest-ProjectReaderTests-189025791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae16bb97-9a80-403a-876f-e8a94b34641b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:11:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ac89399d-713c-47b4-a77c-3bf6b5b0dd1d tempest-ProjectReaderTests-189025791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae16bb97-9a80-403a-876f-e8a94b34641b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:11:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ac89399d-713c-47b4-a77c-3bf6b5b0dd1d tempest-ProjectReaderTests-189025791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91caec2c-abe2-4b9a-9735-71523a78a005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:11:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ac89399d-713c-47b4-a77c-3bf6b5b0dd1d tempest-ProjectReaderTests-189025791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91caec2c-abe2-4b9a-9735-71523a78a005) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf2d0ba7-2143-4bbd-aa9e-75ce9213bcb9', 'volume_name': 'volume-bf2d0ba7-2143-4bbd-aa9e-75ce9213bcb9', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:11:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ac89399d-713c-47b4-a77c-3bf6b5b0dd1d tempest-ProjectReaderTests-189025791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d318106c-9b78-42f1-9fec-12cea39bd066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:11:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ac89399d-713c-47b4-a77c-3bf6b5b0dd1d tempest-ProjectReaderTests-189025791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d318106c-9b78-42f1-9fec-12cea39bd066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:11:07 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ac89399d-713c-47b4-a77c-3bf6b5b0dd1d tempest-ProjectReaderTests-189025791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e21f577a-70c5-4e81-8b52-b8b55b5f4ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:11:07 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-ac89399d-713c-47b4-a77c-3bf6b5b0dd1d tempest-ProjectReaderTests-189025791 None] Volume bf2d0ba7-2143-4bbd-aa9e-75ce9213bcb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf2d0ba7-2143-4bbd-aa9e-75ce9213bcb9', 'volume_size': 1} Sep 04 18:11:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ac89399d-713c-47b4-a77c-3bf6b5b0dd1d tempest-ProjectReaderTests-189025791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:11:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ac89399d-713c-47b4-a77c-3bf6b5b0dd1d tempest-ProjectReaderTests-189025791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:11:07 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ac89399d-713c-47b4-a77c-3bf6b5b0dd1d tempest-ProjectReaderTests-189025791 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:11:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1043202981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf2d0ba7-2143-4bbd-aa9e-75ce9213bcb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37323aeb945244598636fe4542f66684',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:11:07Z,use_quota=True,user_id='a8ca54a32a8d4e2a8482566325c0979e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:11:07 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-ac89399d-713c-47b4-a77c-3bf6b5b0dd1d tempest-ProjectReaderTests-189025791 None] Creating volume bf2d0ba7-2143-4bbd-aa9e-75ce9213bcb9 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:11:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ac89399d-713c-47b4-a77c-3bf6b5b0dd1d tempest-ProjectReaderTests-189025791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:11:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ac89399d-713c-47b4-a77c-3bf6b5b0dd1d tempest-ProjectReaderTests-189025791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:11:07 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ac89399d-713c-47b4-a77c-3bf6b5b0dd1d tempest-ProjectReaderTests-189025791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:11:07 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ac89399d-713c-47b4-a77c-3bf6b5b0dd1d tempest-ProjectReaderTests-189025791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:11:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ac89399d-713c-47b4-a77c-3bf6b5b0dd1d tempest-ProjectReaderTests-189025791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:11:07 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ac89399d-713c-47b4-a77c-3bf6b5b0dd1d tempest-ProjectReaderTests-189025791 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:11:07 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-ac89399d-713c-47b4-a77c-3bf6b5b0dd1d tempest-ProjectReaderTests-189025791 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:11:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ac89399d-713c-47b4-a77c-3bf6b5b0dd1d tempest-ProjectReaderTests-189025791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-bf2d0ba7-2143-4bbd-aa9e-75ce9213bcb9 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:07 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2ac29918-e8d1-430a-b043-79d69da060e3 tempest-ProjectReaderTests-165009307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.345s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:07 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-2ac29918-e8d1-430a-b043-79d69da060e3 tempest-ProjectReaderTests-165009307 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:11:07 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-2ac29918-e8d1-430a-b043-79d69da060e3 tempest-ProjectReaderTests-165009307 None] Deleted volume successfully. Sep 04 18:11:07 devstack sudo[107302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-bf2d0ba7-2143-4bbd-aa9e-75ce9213bcb9 1073741824 Sep 04 18:11:07 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:07 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2ac29918-e8d1-430a-b043-79d69da060e3 tempest-ProjectReaderTests-165009307 None] Lock "cinder-e8b79182-c03e-4878-a4b9-3afb4e7d1c64-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:11:07 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ac89399d-713c-47b4-a77c-3bf6b5b0dd1d tempest-ProjectReaderTests-189025791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-bf2d0ba7-2143-4bbd-aa9e-75ce9213bcb9 1073741824" returned: 0 in 0.599s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ac89399d-713c-47b4-a77c-3bf6b5b0dd1d tempest-ProjectReaderTests-189025791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-bf2d0ba7-2143-4bbd-aa9e-75ce9213bcb9 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:07 devstack sudo[107308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-bf2d0ba7-2143-4bbd-aa9e-75ce9213bcb9 Sep 04 18:11:07 devstack sudo[107308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-18372905-6e9d-470e-a0e3-983b30f5ecd9 tempest-CinderUnicodeTest-735511110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:11:08 devstack sudo[107308]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ac89399d-713c-47b4-a77c-3bf6b5b0dd1d tempest-ProjectReaderTests-189025791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-bf2d0ba7-2143-4bbd-aa9e-75ce9213bcb9" returned: 0 in 0.340s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ac89399d-713c-47b4-a77c-3bf6b5b0dd1d tempest-ProjectReaderTests-189025791 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:11:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ac89399d-713c-47b4-a77c-3bf6b5b0dd1d tempest-ProjectReaderTests-189025791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:11:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-18372905-6e9d-470e-a0e3-983b30f5ecd9 tempest-CinderUnicodeTest-735511110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.177s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:11:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-18372905-6e9d-470e-a0e3-983b30f5ecd9 tempest-CinderUnicodeTest-735511110 None] Creating offline snapshot 70f9fbf4-bba1-45cd-8f33-3fca72b2661f of volume d0ecd42b-aaba-4235-ae35-5cb460eedc59 {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 18:11:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ac89399d-713c-47b4-a77c-3bf6b5b0dd1d tempest-ProjectReaderTests-189025791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e21f577a-70c5-4e81-8b52-b8b55b5f4ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf2d0ba7-2143-4bbd-aa9e-75ce9213bcb9', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:11:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ac89399d-713c-47b4-a77c-3bf6b5b0dd1d tempest-ProjectReaderTests-189025791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdb5d2bc-cf7f-4ce7-9fe0-080081e1566b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:11:08 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2ba16b-b04f-4968-a003-89a5b74c3866]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:11:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-18372905-6e9d-470e-a0e3-983b30f5ecd9 tempest-CinderUnicodeTest-735511110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d0ecd42b-aaba-4235-ae35-5cb460eedc59 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:08 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-ac89399d-713c-47b4-a77c-3bf6b5b0dd1d tempest-ProjectReaderTests-189025791 None] Volume volume-bf2d0ba7-2143-4bbd-aa9e-75ce9213bcb9 (bf2d0ba7-2143-4bbd-aa9e-75ce9213bcb9): created successfully Sep 04 18:11:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ac89399d-713c-47b4-a77c-3bf6b5b0dd1d tempest-ProjectReaderTests-189025791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdb5d2bc-cf7f-4ce7-9fe0-080081e1566b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:11:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-ac89399d-713c-47b4-a77c-3bf6b5b0dd1d tempest-ProjectReaderTests-189025791 None] Flow 'volume_create_manager' (fea96956-6569-4024-be91-50942b0f82fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:11:08 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-ac89399d-713c-47b4-a77c-3bf6b5b0dd1d tempest-ProjectReaderTests-189025791 None] Created volume successfully. Sep 04 18:11:08 devstack sudo[107311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d0ecd42b-aaba-4235-ae35-5cb460eedc59 Sep 04 18:11:08 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:08 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-18372905-6e9d-470e-a0e3-983b30f5ecd9 tempest-CinderUnicodeTest-735511110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d0ecd42b-aaba-4235-ae35-5cb460eedc59" returned: 0 in 0.419s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-18372905-6e9d-470e-a0e3-983b30f5ecd9 tempest-CinderUnicodeTest-735511110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d0ecd42b-aaba-4235-ae35-5cb460eedc59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d0ecd42b-aaba-4235-ae35-5cb460eedc59.70f9fbf4-bba1-45cd-8f33-3fca72b2661f 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:08 devstack sudo[107317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d0ecd42b-aaba-4235-ae35-5cb460eedc59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d0ecd42b-aaba-4235-ae35-5cb460eedc59.70f9fbf4-bba1-45cd-8f33-3fca72b2661f 1G Sep 04 18:11:08 devstack sudo[107317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:09 devstack sudo[107317]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-18372905-6e9d-470e-a0e3-983b30f5ecd9 tempest-CinderUnicodeTest-735511110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d0ecd42b-aaba-4235-ae35-5cb460eedc59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d0ecd42b-aaba-4235-ae35-5cb460eedc59.70f9fbf4-bba1-45cd-8f33-3fca72b2661f 1G" returned: 0 in 0.593s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-18372905-6e9d-470e-a0e3-983b30f5ecd9 tempest-CinderUnicodeTest-735511110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0ecd42b-aaba-4235-ae35-5cb460eedc59 -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d0ecd42b-aaba-4235-ae35-5cb460eedc59.70f9fbf4-bba1-45cd-8f33-3fca72b2661f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:09 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5ade4ca0-5bfa-421c-950f-2ef2c3534646 tempest-ProjectReaderTests-189025791 None] Acquiring lock "cinder-bf2d0ba7-2143-4bbd-aa9e-75ce9213bcb9-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:11:09 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5ade4ca0-5bfa-421c-950f-2ef2c3534646 tempest-ProjectReaderTests-189025791 None] Lock "cinder-bf2d0ba7-2143-4bbd-aa9e-75ce9213bcb9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:11:09 devstack sudo[107323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0ecd42b-aaba-4235-ae35-5cb460eedc59 -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d0ecd42b-aaba-4235-ae35-5cb460eedc59.70f9fbf4-bba1-45cd-8f33-3fca72b2661f Sep 04 18:11:09 devstack sudo[107323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:09 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5ade4ca0-5bfa-421c-950f-2ef2c3534646 tempest-ProjectReaderTests-189025791 None] Acquiring lock "cinder-quobyte-bf2d0ba7-2143-4bbd-aa9e-75ce9213bcb9" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:11:09 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5ade4ca0-5bfa-421c-950f-2ef2c3534646 tempest-ProjectReaderTests-189025791 None] Lock "cinder-quobyte-bf2d0ba7-2143-4bbd-aa9e-75ce9213bcb9" acquired by "delete_volume" :: waited 0.024s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:11:09 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec9293e-75cf-4753-a5c8-ffc5474ce06e]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:11:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5ade4ca0-5bfa-421c-950f-2ef2c3534646 tempest-ProjectReaderTests-189025791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-bf2d0ba7-2143-4bbd-aa9e-75ce9213bcb9 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:09 devstack sudo[107325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-bf2d0ba7-2143-4bbd-aa9e-75ce9213bcb9 Sep 04 18:11:09 devstack sudo[107325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:09 devstack sudo[107323]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-18372905-6e9d-470e-a0e3-983b30f5ecd9 tempest-CinderUnicodeTest-735511110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0ecd42b-aaba-4235-ae35-5cb460eedc59 -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d0ecd42b-aaba-4235-ae35-5cb460eedc59.70f9fbf4-bba1-45cd-8f33-3fca72b2661f" returned: 0 in 0.479s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:09 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-18372905-6e9d-470e-a0e3-983b30f5ecd9 tempest-CinderUnicodeTest-735511110 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d0ecd42b-aaba-4235-ae35-5cb460eedc59.70f9fbf4-bba1-45cd-8f33-3fca72b2661f is being set with open permissions: ugo+rw Sep 04 18:11:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-18372905-6e9d-470e-a0e3-983b30f5ecd9 tempest-CinderUnicodeTest-735511110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d0ecd42b-aaba-4235-ae35-5cb460eedc59.70f9fbf4-bba1-45cd-8f33-3fca72b2661f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:09 devstack sudo[107330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d0ecd42b-aaba-4235-ae35-5cb460eedc59.70f9fbf4-bba1-45cd-8f33-3fca72b2661f Sep 04 18:11:09 devstack sudo[107330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:09 devstack sudo[107325]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5ade4ca0-5bfa-421c-950f-2ef2c3534646 tempest-ProjectReaderTests-189025791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-bf2d0ba7-2143-4bbd-aa9e-75ce9213bcb9" returned: 0 in 0.513s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5ade4ca0-5bfa-421c-950f-2ef2c3534646 tempest-ProjectReaderTests-189025791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-bf2d0ba7-2143-4bbd-aa9e-75ce9213bcb9 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:09 devstack sudo[107335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-bf2d0ba7-2143-4bbd-aa9e-75ce9213bcb9 Sep 04 18:11:09 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:10 devstack sudo[107330]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-18372905-6e9d-470e-a0e3-983b30f5ecd9 tempest-CinderUnicodeTest-735511110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d0ecd42b-aaba-4235-ae35-5cb460eedc59.70f9fbf4-bba1-45cd-8f33-3fca72b2661f" returned: 0 in 0.383s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-18372905-6e9d-470e-a0e3-983b30f5ecd9 tempest-CinderUnicodeTest-735511110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d0ecd42b-aaba-4235-ae35-5cb460eedc59.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:10 devstack sudo[107338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d0ecd42b-aaba-4235-ae35-5cb460eedc59.info Sep 04 18:11:10 devstack sudo[107338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:10 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5ade4ca0-5bfa-421c-950f-2ef2c3534646 tempest-ProjectReaderTests-189025791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-bf2d0ba7-2143-4bbd-aa9e-75ce9213bcb9" returned: 0 in 0.393s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:10 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5ade4ca0-5bfa-421c-950f-2ef2c3534646 tempest-ProjectReaderTests-189025791 None] Lock "cinder-quobyte-bf2d0ba7-2143-4bbd-aa9e-75ce9213bcb9" released by "delete_volume" :: held 0.977s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:11:10 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-5ade4ca0-5bfa-421c-950f-2ef2c3534646 tempest-ProjectReaderTests-189025791 None] Created reservations ['f151a05a-be7f-442a-af1b-5d59718436df', '85121b61-3eae-48d8-87c9-96fc325f0a5f', 'c088394f-e8e1-4e27-b897-40a06851336a', '799f30e0-fbc4-4086-ae6d-49525c2e6110'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:11:10 devstack sudo[107338]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-18372905-6e9d-470e-a0e3-983b30f5ecd9 tempest-CinderUnicodeTest-735511110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d0ecd42b-aaba-4235-ae35-5cb460eedc59.info" returned: 0 in 0.456s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:10 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-18372905-6e9d-470e-a0e3-983b30f5ecd9 tempest-CinderUnicodeTest-735511110 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d0ecd42b-aaba-4235-ae35-5cb460eedc59.info is being set with open permissions: ugo+rw Sep 04 18:11:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-18372905-6e9d-470e-a0e3-983b30f5ecd9 tempest-CinderUnicodeTest-735511110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d0ecd42b-aaba-4235-ae35-5cb460eedc59.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:10 devstack sudo[107342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d0ecd42b-aaba-4235-ae35-5cb460eedc59.info Sep 04 18:11:10 devstack sudo[107342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5ade4ca0-5bfa-421c-950f-2ef2c3534646 tempest-ProjectReaderTests-189025791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:11:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5ade4ca0-5bfa-421c-950f-2ef2c3534646 tempest-ProjectReaderTests-189025791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:11:10 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5ade4ca0-5bfa-421c-950f-2ef2c3534646 tempest-ProjectReaderTests-189025791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:11:10 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5ade4ca0-5bfa-421c-950f-2ef2c3534646 tempest-ProjectReaderTests-189025791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:11:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5ade4ca0-5bfa-421c-950f-2ef2c3534646 tempest-ProjectReaderTests-189025791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:11:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5ade4ca0-5bfa-421c-950f-2ef2c3534646 tempest-ProjectReaderTests-189025791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:10 devstack sudo[107344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:11:10 devstack sudo[107344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:10 devstack sudo[107342]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-18372905-6e9d-470e-a0e3-983b30f5ecd9 tempest-CinderUnicodeTest-735511110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d0ecd42b-aaba-4235-ae35-5cb460eedc59.info" returned: 0 in 0.418s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-18372905-6e9d-470e-a0e3-983b30f5ecd9 tempest-CinderUnicodeTest-735511110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.903s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:11:11 devstack sudo[107344]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:11 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-18372905-6e9d-470e-a0e3-983b30f5ecd9 tempest-CinderUnicodeTest-735511110 None] Create snapshot completed successfully Sep 04 18:11:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5ade4ca0-5bfa-421c-950f-2ef2c3534646 tempest-ProjectReaderTests-189025791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.430s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:11 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-5ade4ca0-5bfa-421c-950f-2ef2c3534646 tempest-ProjectReaderTests-189025791 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:11:11 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-5ade4ca0-5bfa-421c-950f-2ef2c3534646 tempest-ProjectReaderTests-189025791 None] Deleted volume successfully. Sep 04 18:11:11 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5ade4ca0-5bfa-421c-950f-2ef2c3534646 tempest-ProjectReaderTests-189025791 None] Lock "cinder-bf2d0ba7-2143-4bbd-aa9e-75ce9213bcb9-delete_volume" released by "delete_volume" :: held 1.899s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:11:12 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-47f8ae5e-a714-42e5-8392-52d850edb0dd tempest-CinderUnicodeTest-735511110 None] Acquiring lock "cinder-70f9fbf4-bba1-45cd-8f33-3fca72b2661f-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:11:12 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-47f8ae5e-a714-42e5-8392-52d850edb0dd tempest-CinderUnicodeTest-735511110 None] Lock "cinder-70f9fbf4-bba1-45cd-8f33-3fca72b2661f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:11:12 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-47f8ae5e-a714-42e5-8392-52d850edb0dd tempest-CinderUnicodeTest-735511110 None] Acquiring lock "cinder-quobyte-d0ecd42b-aaba-4235-ae35-5cb460eedc59" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:11:12 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-47f8ae5e-a714-42e5-8392-52d850edb0dd tempest-CinderUnicodeTest-735511110 None] Lock "cinder-quobyte-d0ecd42b-aaba-4235-ae35-5cb460eedc59" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:11:12 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-47f8ae5e-a714-42e5-8392-52d850edb0dd tempest-CinderUnicodeTest-735511110 None] Acquiring lock "cinder-quobyte-70f9fbf4-bba1-45cd-8f33-3fca72b2661f" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:11:12 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-47f8ae5e-a714-42e5-8392-52d850edb0dd tempest-CinderUnicodeTest-735511110 None] Lock "cinder-quobyte-70f9fbf4-bba1-45cd-8f33-3fca72b2661f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:11:12 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-47f8ae5e-a714-42e5-8392-52d850edb0dd tempest-CinderUnicodeTest-735511110 None] Deleting offline snapshot 70f9fbf4-bba1-45cd-8f33-3fca72b2661f of volume d0ecd42b-aaba-4235-ae35-5cb460eedc59 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 18:11:12 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-47f8ae5e-a714-42e5-8392-52d850edb0dd tempest-CinderUnicodeTest-735511110 None] snapshot_file for this snap is: volume-d0ecd42b-aaba-4235-ae35-5cb460eedc59.70f9fbf4-bba1-45cd-8f33-3fca72b2661f {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 18:11:12 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d55f36-cd09-4c60-84c2-23fddd2fe1c3]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:11:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-47f8ae5e-a714-42e5-8392-52d850edb0dd tempest-CinderUnicodeTest-735511110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d0ecd42b-aaba-4235-ae35-5cb460eedc59.70f9fbf4-bba1-45cd-8f33-3fca72b2661f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:12 devstack sudo[107348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d0ecd42b-aaba-4235-ae35-5cb460eedc59.70f9fbf4-bba1-45cd-8f33-3fca72b2661f Sep 04 18:11:12 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:12 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-47f8ae5e-a714-42e5-8392-52d850edb0dd tempest-CinderUnicodeTest-735511110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d0ecd42b-aaba-4235-ae35-5cb460eedc59.70f9fbf4-bba1-45cd-8f33-3fca72b2661f" returned: 0 in 0.431s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:12 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-47f8ae5e-a714-42e5-8392-52d850edb0dd tempest-CinderUnicodeTest-735511110 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0ecd42b-aaba-4235-ae35-5cb460eedc59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 18:11:12 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca98d0a-f87a-4e10-8f3b-0614a9b95727]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:11:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-47f8ae5e-a714-42e5-8392-52d850edb0dd tempest-CinderUnicodeTest-735511110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d0ecd42b-aaba-4235-ae35-5cb460eedc59 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:12 devstack sudo[107353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d0ecd42b-aaba-4235-ae35-5cb460eedc59 Sep 04 18:11:12 devstack sudo[107353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:13 devstack sudo[107353]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-47f8ae5e-a714-42e5-8392-52d850edb0dd tempest-CinderUnicodeTest-735511110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d0ecd42b-aaba-4235-ae35-5cb460eedc59" returned: 0 in 0.500s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-47f8ae5e-a714-42e5-8392-52d850edb0dd tempest-CinderUnicodeTest-735511110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d0ecd42b-aaba-4235-ae35-5cb460eedc59.70f9fbf4-bba1-45cd-8f33-3fca72b2661f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:13 devstack sudo[107359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d0ecd42b-aaba-4235-ae35-5cb460eedc59.70f9fbf4-bba1-45cd-8f33-3fca72b2661f Sep 04 18:11:13 devstack sudo[107359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:13 devstack sudo[107359]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-47f8ae5e-a714-42e5-8392-52d850edb0dd tempest-CinderUnicodeTest-735511110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d0ecd42b-aaba-4235-ae35-5cb460eedc59.70f9fbf4-bba1-45cd-8f33-3fca72b2661f" returned: 0 in 0.509s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-47f8ae5e-a714-42e5-8392-52d850edb0dd tempest-CinderUnicodeTest-735511110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d0ecd42b-aaba-4235-ae35-5cb460eedc59.70f9fbf4-bba1-45cd-8f33-3fca72b2661f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:13 devstack sudo[107365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d0ecd42b-aaba-4235-ae35-5cb460eedc59.70f9fbf4-bba1-45cd-8f33-3fca72b2661f Sep 04 18:11:13 devstack sudo[107365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:14 devstack sudo[107365]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-47f8ae5e-a714-42e5-8392-52d850edb0dd tempest-CinderUnicodeTest-735511110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d0ecd42b-aaba-4235-ae35-5cb460eedc59.70f9fbf4-bba1-45cd-8f33-3fca72b2661f" returned: 0 in 0.308s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:14 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-47f8ae5e-a714-42e5-8392-52d850edb0dd tempest-CinderUnicodeTest-735511110 None] Lock "cinder-quobyte-70f9fbf4-bba1-45cd-8f33-3fca72b2661f" released by "_delete_snapshot" :: held 1.904s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:11:14 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-47f8ae5e-a714-42e5-8392-52d850edb0dd tempest-CinderUnicodeTest-735511110 None] Lock "cinder-quobyte-d0ecd42b-aaba-4235-ae35-5cb460eedc59" released by "delete_snapshot" :: held 1.930s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:11:14 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-47f8ae5e-a714-42e5-8392-52d850edb0dd tempest-CinderUnicodeTest-735511110 None] Created reservations ['cbf5692b-38b5-4500-a4f9-bd58faad6248', 'bde50d33-c1cb-4917-af4d-5f2a076ef7dc', '1719d73b-988f-4cf4-8be0-8f3da84580ed', '31ce1287-a9a4-440c-a575-781727eb1b0f'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:11:14 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-47f8ae5e-a714-42e5-8392-52d850edb0dd tempest-CinderUnicodeTest-735511110 None] Delete snapshot completed successfully. Sep 04 18:11:14 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-47f8ae5e-a714-42e5-8392-52d850edb0dd tempest-CinderUnicodeTest-735511110 None] Lock "cinder-70f9fbf4-bba1-45cd-8f33-3fca72b2661f-delete_snapshot" released by "delete_snapshot" :: held 2.090s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:11:14 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-28399a3d-6644-4676-8577-1b47d4bbfff9 tempest-CinderUnicodeTest-735511110 None] Acquiring lock "cinder-d0ecd42b-aaba-4235-ae35-5cb460eedc59-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:11:14 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-28399a3d-6644-4676-8577-1b47d4bbfff9 tempest-CinderUnicodeTest-735511110 None] Lock "cinder-d0ecd42b-aaba-4235-ae35-5cb460eedc59-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:11:14 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-28399a3d-6644-4676-8577-1b47d4bbfff9 tempest-CinderUnicodeTest-735511110 None] Acquiring lock "cinder-quobyte-d0ecd42b-aaba-4235-ae35-5cb460eedc59" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:11:14 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-28399a3d-6644-4676-8577-1b47d4bbfff9 tempest-CinderUnicodeTest-735511110 None] Lock "cinder-quobyte-d0ecd42b-aaba-4235-ae35-5cb460eedc59" acquired by "delete_volume" :: waited 0.020s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:11:14 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[39292238-9903-40a5-8567-071818c883f6]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:11:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-28399a3d-6644-4676-8577-1b47d4bbfff9 tempest-CinderUnicodeTest-735511110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d0ecd42b-aaba-4235-ae35-5cb460eedc59 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:14 devstack sudo[107369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d0ecd42b-aaba-4235-ae35-5cb460eedc59 Sep 04 18:11:14 devstack sudo[107369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:14 devstack sudo[107369]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-28399a3d-6644-4676-8577-1b47d4bbfff9 tempest-CinderUnicodeTest-735511110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d0ecd42b-aaba-4235-ae35-5cb460eedc59" returned: 0 in 0.374s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-28399a3d-6644-4676-8577-1b47d4bbfff9 tempest-CinderUnicodeTest-735511110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d0ecd42b-aaba-4235-ae35-5cb460eedc59 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:14 devstack sudo[107375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d0ecd42b-aaba-4235-ae35-5cb460eedc59 Sep 04 18:11:14 devstack sudo[107375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:15 devstack sudo[107375]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-28399a3d-6644-4676-8577-1b47d4bbfff9 tempest-CinderUnicodeTest-735511110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d0ecd42b-aaba-4235-ae35-5cb460eedc59" returned: 0 in 0.262s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:15 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-28399a3d-6644-4676-8577-1b47d4bbfff9 tempest-CinderUnicodeTest-735511110 None] Lock "cinder-quobyte-d0ecd42b-aaba-4235-ae35-5cb460eedc59" released by "delete_volume" :: held 0.705s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:11:15 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-28399a3d-6644-4676-8577-1b47d4bbfff9 tempest-CinderUnicodeTest-735511110 None] Created reservations ['784d48ab-e2ae-43f5-b292-0e01bece5650', 'f9a1a620-859d-4bae-b1dc-1947c2473f59', 'fed79926-f866-4b81-b690-8e81bc7bda74', '5a6d6708-b145-407f-a27d-4b79f4c9689e'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:11:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-28399a3d-6644-4676-8577-1b47d4bbfff9 tempest-CinderUnicodeTest-735511110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:11:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-28399a3d-6644-4676-8577-1b47d4bbfff9 tempest-CinderUnicodeTest-735511110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:11:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-28399a3d-6644-4676-8577-1b47d4bbfff9 tempest-CinderUnicodeTest-735511110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:11:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-28399a3d-6644-4676-8577-1b47d4bbfff9 tempest-CinderUnicodeTest-735511110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:11:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-28399a3d-6644-4676-8577-1b47d4bbfff9 tempest-CinderUnicodeTest-735511110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:11:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-28399a3d-6644-4676-8577-1b47d4bbfff9 tempest-CinderUnicodeTest-735511110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:15 devstack sudo[107378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:11:15 devstack sudo[107378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:15 devstack sudo[107378]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-28399a3d-6644-4676-8577-1b47d4bbfff9 tempest-CinderUnicodeTest-735511110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.253s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:15 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-28399a3d-6644-4676-8577-1b47d4bbfff9 tempest-CinderUnicodeTest-735511110 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:11:15 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-28399a3d-6644-4676-8577-1b47d4bbfff9 tempest-CinderUnicodeTest-735511110 None] Deleted volume successfully. Sep 04 18:11:15 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-07b8cff3-59c5-4f9a-81a0-b64151abd645 tempest-CinderUnicodeTest-735511110 None] Acquiring lock "cinder-13860350-1f71-4594-97cd-3032d00d785d-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:11:15 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-28399a3d-6644-4676-8577-1b47d4bbfff9 tempest-CinderUnicodeTest-735511110 None] Lock "cinder-d0ecd42b-aaba-4235-ae35-5cb460eedc59-delete_volume" released by "delete_volume" :: held 1.201s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:11:15 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-07b8cff3-59c5-4f9a-81a0-b64151abd645 tempest-CinderUnicodeTest-735511110 None] Lock "cinder-13860350-1f71-4594-97cd-3032d00d785d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:11:15 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-07b8cff3-59c5-4f9a-81a0-b64151abd645 tempest-CinderUnicodeTest-735511110 None] Acquiring lock "cinder-quobyte-13860350-1f71-4594-97cd-3032d00d785d" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:11:15 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-07b8cff3-59c5-4f9a-81a0-b64151abd645 tempest-CinderUnicodeTest-735511110 None] Lock "cinder-quobyte-13860350-1f71-4594-97cd-3032d00d785d" acquired by "delete_volume" :: waited 0.016s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:11:15 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[46862e2c-1faf-46a4-a2b5-3353c6804dae]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:11:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-07b8cff3-59c5-4f9a-81a0-b64151abd645 tempest-CinderUnicodeTest-735511110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-13860350-1f71-4594-97cd-3032d00d785d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:15 devstack sudo[107381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-13860350-1f71-4594-97cd-3032d00d785d Sep 04 18:11:15 devstack sudo[107381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:16 devstack sudo[107381]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-07b8cff3-59c5-4f9a-81a0-b64151abd645 tempest-CinderUnicodeTest-735511110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-13860350-1f71-4594-97cd-3032d00d785d" returned: 0 in 0.398s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-07b8cff3-59c5-4f9a-81a0-b64151abd645 tempest-CinderUnicodeTest-735511110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-13860350-1f71-4594-97cd-3032d00d785d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:16 devstack sudo[107386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-13860350-1f71-4594-97cd-3032d00d785d Sep 04 18:11:16 devstack sudo[107386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:16 devstack sudo[107386]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-07b8cff3-59c5-4f9a-81a0-b64151abd645 tempest-CinderUnicodeTest-735511110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-13860350-1f71-4594-97cd-3032d00d785d" returned: 0 in 0.283s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:16 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-07b8cff3-59c5-4f9a-81a0-b64151abd645 tempest-CinderUnicodeTest-735511110 None] Lock "cinder-quobyte-13860350-1f71-4594-97cd-3032d00d785d" released by "delete_volume" :: held 0.723s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:11:16 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-07b8cff3-59c5-4f9a-81a0-b64151abd645 tempest-CinderUnicodeTest-735511110 None] Created reservations ['a09242d9-b620-407b-b9e1-50ba52505a82', '70b8c89f-a096-4dc7-a826-24bb183af867', '705d1200-4a22-4edc-ab97-6ae940d7d22d', '5e1c89a5-8d98-471b-a57e-1d51cd836911'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:11:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-07b8cff3-59c5-4f9a-81a0-b64151abd645 tempest-CinderUnicodeTest-735511110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:11:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-07b8cff3-59c5-4f9a-81a0-b64151abd645 tempest-CinderUnicodeTest-735511110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:11:16 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-07b8cff3-59c5-4f9a-81a0-b64151abd645 tempest-CinderUnicodeTest-735511110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:11:16 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-07b8cff3-59c5-4f9a-81a0-b64151abd645 tempest-CinderUnicodeTest-735511110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:11:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-07b8cff3-59c5-4f9a-81a0-b64151abd645 tempest-CinderUnicodeTest-735511110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:11:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-07b8cff3-59c5-4f9a-81a0-b64151abd645 tempest-CinderUnicodeTest-735511110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:16 devstack sudo[107389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:11:16 devstack sudo[107389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:16 devstack sudo[107389]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-07b8cff3-59c5-4f9a-81a0-b64151abd645 tempest-CinderUnicodeTest-735511110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.297s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:16 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-07b8cff3-59c5-4f9a-81a0-b64151abd645 tempest-CinderUnicodeTest-735511110 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:11:16 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-07b8cff3-59c5-4f9a-81a0-b64151abd645 tempest-CinderUnicodeTest-735511110 None] Deleted volume successfully. Sep 04 18:11:16 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-07b8cff3-59c5-4f9a-81a0-b64151abd645 tempest-CinderUnicodeTest-735511110 None] Lock "cinder-13860350-1f71-4594-97cd-3032d00d785d-delete_volume" released by "delete_volume" :: held 1.262s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:11:21 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 18:11:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:11:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:11:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:11:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:11:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:11:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:21 devstack sudo[107393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:11:21 devstack sudo[107393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:21 devstack sudo[107393]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.345s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:21 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:11:21 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running periodic task VolumeManager._thread_info {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 18:11:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] thread count: 28 {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 18:11:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] thread info: [<_MainThread(MainThread, started 139900377723008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 18:11:22 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-77e9ca62-6e44-4be1-b43b-4492e8e9c494 tempest-SnapshotDependencyTests-1007144741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:11:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-77e9ca62-6e44-4be1-b43b-4492e8e9c494 tempest-SnapshotDependencyTests-1007144741 None] Flow 'volume_create_manager' (08af270c-33f2-4a05-94f6-5bef878e3b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:11:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-77e9ca62-6e44-4be1-b43b-4492e8e9c494 tempest-SnapshotDependencyTests-1007144741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d83c9d3-3d10-4221-a4b7-f48d002958c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:11:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-77e9ca62-6e44-4be1-b43b-4492e8e9c494 tempest-SnapshotDependencyTests-1007144741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d83c9d3-3d10-4221-a4b7-f48d002958c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:11:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-583093343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5df6f55d-50f9-40cf-b2d1-9a3758e847e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80bc9b992f434a2aa17bde5d86784e92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:11:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:11:22Z,use_quota=True,user_id='cef11e6a776647c691d0dd6d3a60e602',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:11:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-77e9ca62-6e44-4be1-b43b-4492e8e9c494 tempest-SnapshotDependencyTests-1007144741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6815133f-53cf-41cd-a5b7-f14558d4dadb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:11:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-77e9ca62-6e44-4be1-b43b-4492e8e9c494 tempest-SnapshotDependencyTests-1007144741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6815133f-53cf-41cd-a5b7-f14558d4dadb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:11:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-77e9ca62-6e44-4be1-b43b-4492e8e9c494 tempest-SnapshotDependencyTests-1007144741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fdde3a4-ac33-4e33-a5af-11dfd74e4328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:11:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-77e9ca62-6e44-4be1-b43b-4492e8e9c494 tempest-SnapshotDependencyTests-1007144741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fdde3a4-ac33-4e33-a5af-11dfd74e4328) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5df6f55d-50f9-40cf-b2d1-9a3758e847e6', 'volume_name': 'volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:11:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-77e9ca62-6e44-4be1-b43b-4492e8e9c494 tempest-SnapshotDependencyTests-1007144741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0e7503e-5058-4344-a8fa-051b712680c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:11:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-77e9ca62-6e44-4be1-b43b-4492e8e9c494 tempest-SnapshotDependencyTests-1007144741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0e7503e-5058-4344-a8fa-051b712680c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:11:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-77e9ca62-6e44-4be1-b43b-4492e8e9c494 tempest-SnapshotDependencyTests-1007144741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0a600e5-9b57-40a8-8b82-e8259e0739a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:11:22 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-77e9ca62-6e44-4be1-b43b-4492e8e9c494 tempest-SnapshotDependencyTests-1007144741 None] Volume 5df6f55d-50f9-40cf-b2d1-9a3758e847e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6', 'volume_size': 1} Sep 04 18:11:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-77e9ca62-6e44-4be1-b43b-4492e8e9c494 tempest-SnapshotDependencyTests-1007144741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:11:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-77e9ca62-6e44-4be1-b43b-4492e8e9c494 tempest-SnapshotDependencyTests-1007144741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:11:22 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-77e9ca62-6e44-4be1-b43b-4492e8e9c494 tempest-SnapshotDependencyTests-1007144741 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:11:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-583093343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5df6f55d-50f9-40cf-b2d1-9a3758e847e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80bc9b992f434a2aa17bde5d86784e92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:11:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:11:22Z,use_quota=True,user_id='cef11e6a776647c691d0dd6d3a60e602',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:11:22 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-77e9ca62-6e44-4be1-b43b-4492e8e9c494 tempest-SnapshotDependencyTests-1007144741 None] Creating volume 5df6f55d-50f9-40cf-b2d1-9a3758e847e6 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:11:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-77e9ca62-6e44-4be1-b43b-4492e8e9c494 tempest-SnapshotDependencyTests-1007144741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:11:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-77e9ca62-6e44-4be1-b43b-4492e8e9c494 tempest-SnapshotDependencyTests-1007144741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:11:22 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-77e9ca62-6e44-4be1-b43b-4492e8e9c494 tempest-SnapshotDependencyTests-1007144741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:11:22 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-77e9ca62-6e44-4be1-b43b-4492e8e9c494 tempest-SnapshotDependencyTests-1007144741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:11:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-77e9ca62-6e44-4be1-b43b-4492e8e9c494 tempest-SnapshotDependencyTests-1007144741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:11:22 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-77e9ca62-6e44-4be1-b43b-4492e8e9c494 tempest-SnapshotDependencyTests-1007144741 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:11:22 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-77e9ca62-6e44-4be1-b43b-4492e8e9c494 tempest-SnapshotDependencyTests-1007144741 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:11:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-77e9ca62-6e44-4be1-b43b-4492e8e9c494 tempest-SnapshotDependencyTests-1007144741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:22 devstack sudo[107397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6 1073741824 Sep 04 18:11:22 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:22 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-77e9ca62-6e44-4be1-b43b-4492e8e9c494 tempest-SnapshotDependencyTests-1007144741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6 1073741824" returned: 0 in 0.444s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-77e9ca62-6e44-4be1-b43b-4492e8e9c494 tempest-SnapshotDependencyTests-1007144741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:22 devstack sudo[107403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6 Sep 04 18:11:22 devstack sudo[107403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:23 devstack sudo[107403]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-77e9ca62-6e44-4be1-b43b-4492e8e9c494 tempest-SnapshotDependencyTests-1007144741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6" returned: 0 in 0.261s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:23 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-77e9ca62-6e44-4be1-b43b-4492e8e9c494 tempest-SnapshotDependencyTests-1007144741 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:11:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-77e9ca62-6e44-4be1-b43b-4492e8e9c494 tempest-SnapshotDependencyTests-1007144741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:11:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-77e9ca62-6e44-4be1-b43b-4492e8e9c494 tempest-SnapshotDependencyTests-1007144741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0a600e5-9b57-40a8-8b82-e8259e0739a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:11:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-77e9ca62-6e44-4be1-b43b-4492e8e9c494 tempest-SnapshotDependencyTests-1007144741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe6dd8ed-423d-4abc-b219-44740a3eab57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:11:23 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-77e9ca62-6e44-4be1-b43b-4492e8e9c494 tempest-SnapshotDependencyTests-1007144741 None] Volume volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6 (5df6f55d-50f9-40cf-b2d1-9a3758e847e6): created successfully Sep 04 18:11:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-77e9ca62-6e44-4be1-b43b-4492e8e9c494 tempest-SnapshotDependencyTests-1007144741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe6dd8ed-423d-4abc-b219-44740a3eab57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:11:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-77e9ca62-6e44-4be1-b43b-4492e8e9c494 tempest-SnapshotDependencyTests-1007144741 None] Flow 'volume_create_manager' (08af270c-33f2-4a05-94f6-5bef878e3b9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:11:23 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-77e9ca62-6e44-4be1-b43b-4492e8e9c494 tempest-SnapshotDependencyTests-1007144741 None] Created volume successfully. Sep 04 18:11:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4bdfc7e8-e477-4db7-911a-c4c061de5abd tempest-SnapshotDependencyTests-1007144741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:11:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4bdfc7e8-e477-4db7-911a-c4c061de5abd tempest-SnapshotDependencyTests-1007144741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:11:24 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-4bdfc7e8-e477-4db7-911a-c4c061de5abd tempest-SnapshotDependencyTests-1007144741 None] Creating offline snapshot a096684b-d505-401c-8cbb-590785ceb3de of volume 5df6f55d-50f9-40cf-b2d1-9a3758e847e6 {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 18:11:24 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe02e5f-3dc1-4e4b-9cc9-21543f65b3a0]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:11:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4bdfc7e8-e477-4db7-911a-c4c061de5abd tempest-SnapshotDependencyTests-1007144741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:24 devstack sudo[107407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6 Sep 04 18:11:24 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:24 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4bdfc7e8-e477-4db7-911a-c4c061de5abd tempest-SnapshotDependencyTests-1007144741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6" returned: 0 in 0.399s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4bdfc7e8-e477-4db7-911a-c4c061de5abd tempest-SnapshotDependencyTests-1007144741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6.a096684b-d505-401c-8cbb-590785ceb3de 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:24 devstack sudo[107412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6.a096684b-d505-401c-8cbb-590785ceb3de 1G Sep 04 18:11:24 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:25 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4bdfc7e8-e477-4db7-911a-c4c061de5abd tempest-SnapshotDependencyTests-1007144741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6.a096684b-d505-401c-8cbb-590785ceb3de 1G" returned: 0 in 0.399s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4bdfc7e8-e477-4db7-911a-c4c061de5abd tempest-SnapshotDependencyTests-1007144741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6 -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6.a096684b-d505-401c-8cbb-590785ceb3de {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:25 devstack sudo[107418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6 -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6.a096684b-d505-401c-8cbb-590785ceb3de Sep 04 18:11:25 devstack sudo[107418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:25 devstack sudo[107418]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4bdfc7e8-e477-4db7-911a-c4c061de5abd tempest-SnapshotDependencyTests-1007144741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6 -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6.a096684b-d505-401c-8cbb-590785ceb3de" returned: 0 in 0.297s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:25 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-4bdfc7e8-e477-4db7-911a-c4c061de5abd tempest-SnapshotDependencyTests-1007144741 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6.a096684b-d505-401c-8cbb-590785ceb3de is being set with open permissions: ugo+rw Sep 04 18:11:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4bdfc7e8-e477-4db7-911a-c4c061de5abd tempest-SnapshotDependencyTests-1007144741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6.a096684b-d505-401c-8cbb-590785ceb3de {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:25 devstack sudo[107423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6.a096684b-d505-401c-8cbb-590785ceb3de Sep 04 18:11:25 devstack sudo[107423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:25 devstack sudo[107423]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4bdfc7e8-e477-4db7-911a-c4c061de5abd tempest-SnapshotDependencyTests-1007144741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6.a096684b-d505-401c-8cbb-590785ceb3de" returned: 0 in 0.236s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4bdfc7e8-e477-4db7-911a-c4c061de5abd tempest-SnapshotDependencyTests-1007144741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:25 devstack sudo[107426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6.info Sep 04 18:11:25 devstack sudo[107426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:26 devstack sudo[107426]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4bdfc7e8-e477-4db7-911a-c4c061de5abd tempest-SnapshotDependencyTests-1007144741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6.info" returned: 0 in 0.238s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:26 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-4bdfc7e8-e477-4db7-911a-c4c061de5abd tempest-SnapshotDependencyTests-1007144741 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6.info is being set with open permissions: ugo+rw Sep 04 18:11:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4bdfc7e8-e477-4db7-911a-c4c061de5abd tempest-SnapshotDependencyTests-1007144741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:26 devstack sudo[107429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6.info Sep 04 18:11:26 devstack sudo[107429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:26 devstack sudo[107429]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-4bdfc7e8-e477-4db7-911a-c4c061de5abd tempest-SnapshotDependencyTests-1007144741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6.info" returned: 0 in 0.250s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-4bdfc7e8-e477-4db7-911a-c4c061de5abd tempest-SnapshotDependencyTests-1007144741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.911s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:11:26 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-4bdfc7e8-e477-4db7-911a-c4c061de5abd tempest-SnapshotDependencyTests-1007144741 None] Create snapshot completed successfully Sep 04 18:11:26 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-88d1fb27-d997-49bf-858a-2fc1c065063e tempest-ProjectMemberTests-488731474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:11:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-88d1fb27-d997-49bf-858a-2fc1c065063e tempest-ProjectMemberTests-488731474 None] Flow 'volume_create_manager' (f24041d8-624c-47d9-a550-fc87d1145071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:11:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-88d1fb27-d997-49bf-858a-2fc1c065063e tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd9d165e-673b-4237-bd2e-fd307d489d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:11:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-88d1fb27-d997-49bf-858a-2fc1c065063e tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd9d165e-673b-4237-bd2e-fd307d489d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:11:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1552210599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71487a65-5e15-479d-8ceb-45a6283b70df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b5af8d2d70740348028c34578cb1393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:11:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:11:27Z,use_quota=True,user_id='21f3365c7a9a490387324872cde069aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:11:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-88d1fb27-d997-49bf-858a-2fc1c065063e tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (107d52c0-96ea-4098-8506-f07570d0fbf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:11:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-88d1fb27-d997-49bf-858a-2fc1c065063e tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (107d52c0-96ea-4098-8506-f07570d0fbf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:11:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-88d1fb27-d997-49bf-858a-2fc1c065063e tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c61a5fd-3ebf-47d9-b67e-46426201551a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:11:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-88d1fb27-d997-49bf-858a-2fc1c065063e tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c61a5fd-3ebf-47d9-b67e-46426201551a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71487a65-5e15-479d-8ceb-45a6283b70df', 'volume_name': 'volume-71487a65-5e15-479d-8ceb-45a6283b70df', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:11:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-88d1fb27-d997-49bf-858a-2fc1c065063e tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32bd73ca-8e1d-4550-a11b-f1eccbf133e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:11:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-88d1fb27-d997-49bf-858a-2fc1c065063e tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32bd73ca-8e1d-4550-a11b-f1eccbf133e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:11:26 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-88d1fb27-d997-49bf-858a-2fc1c065063e tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b35f34f-bbe8-4a84-ba36-9d5f5ff416e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:11:26 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-88d1fb27-d997-49bf-858a-2fc1c065063e tempest-ProjectMemberTests-488731474 None] Volume 71487a65-5e15-479d-8ceb-45a6283b70df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71487a65-5e15-479d-8ceb-45a6283b70df', 'volume_size': 1} Sep 04 18:11:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-88d1fb27-d997-49bf-858a-2fc1c065063e tempest-ProjectMemberTests-488731474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:11:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-88d1fb27-d997-49bf-858a-2fc1c065063e tempest-ProjectMemberTests-488731474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:11:26 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-88d1fb27-d997-49bf-858a-2fc1c065063e tempest-ProjectMemberTests-488731474 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:11:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1552210599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71487a65-5e15-479d-8ceb-45a6283b70df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b5af8d2d70740348028c34578cb1393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:11:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:11:27Z,use_quota=True,user_id='21f3365c7a9a490387324872cde069aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:11:26 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-88d1fb27-d997-49bf-858a-2fc1c065063e tempest-ProjectMemberTests-488731474 None] Creating volume 71487a65-5e15-479d-8ceb-45a6283b70df {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:11:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-88d1fb27-d997-49bf-858a-2fc1c065063e tempest-ProjectMemberTests-488731474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:11:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-88d1fb27-d997-49bf-858a-2fc1c065063e tempest-ProjectMemberTests-488731474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:11:26 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-88d1fb27-d997-49bf-858a-2fc1c065063e tempest-ProjectMemberTests-488731474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:11:26 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-88d1fb27-d997-49bf-858a-2fc1c065063e tempest-ProjectMemberTests-488731474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:11:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-88d1fb27-d997-49bf-858a-2fc1c065063e tempest-ProjectMemberTests-488731474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:11:26 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-88d1fb27-d997-49bf-858a-2fc1c065063e tempest-ProjectMemberTests-488731474 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:11:26 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-88d1fb27-d997-49bf-858a-2fc1c065063e tempest-ProjectMemberTests-488731474 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:11:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-88d1fb27-d997-49bf-858a-2fc1c065063e tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-71487a65-5e15-479d-8ceb-45a6283b70df 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:26 devstack sudo[107432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-71487a65-5e15-479d-8ceb-45a6283b70df 1073741824 Sep 04 18:11:26 devstack sudo[107432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:27 devstack sudo[107432]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-88d1fb27-d997-49bf-858a-2fc1c065063e tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-71487a65-5e15-479d-8ceb-45a6283b70df 1073741824" returned: 0 in 0.447s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:27 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-678a1b89-657e-445f-921f-7e54aafceb85 tempest-SnapshotDependencyTests-1007144741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:11:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-88d1fb27-d997-49bf-858a-2fc1c065063e tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-71487a65-5e15-479d-8ceb-45a6283b70df {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:27 devstack sudo[107438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-71487a65-5e15-479d-8ceb-45a6283b70df Sep 04 18:11:27 devstack sudo[107438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-678a1b89-657e-445f-921f-7e54aafceb85 tempest-SnapshotDependencyTests-1007144741 None] Flow 'volume_create_manager' (27005fa9-69bd-42d6-a109-137598edb3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:11:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-678a1b89-657e-445f-921f-7e54aafceb85 tempest-SnapshotDependencyTests-1007144741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73568d76-f8f6-4cce-bd08-ee8b36c9974a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:11:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-678a1b89-657e-445f-921f-7e54aafceb85 tempest-SnapshotDependencyTests-1007144741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73568d76-f8f6-4cce-bd08-ee8b36c9974a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:11:27Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b76fa0c2-83e7-4b52-bdd0-15579051bfd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80bc9b992f434a2aa17bde5d86784e92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:11:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a096684b-d505-401c-8cbb-590785ceb3de,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:11:27Z,use_quota=True,user_id='cef11e6a776647c691d0dd6d3a60e602',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:11:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-678a1b89-657e-445f-921f-7e54aafceb85 tempest-SnapshotDependencyTests-1007144741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f174cd0-a657-4d5b-bbe1-dfad82bb8233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:11:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-678a1b89-657e-445f-921f-7e54aafceb85 tempest-SnapshotDependencyTests-1007144741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f174cd0-a657-4d5b-bbe1-dfad82bb8233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:11:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-678a1b89-657e-445f-921f-7e54aafceb85 tempest-SnapshotDependencyTests-1007144741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99505743-db82-414e-ae6a-d940155b61df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:11:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-678a1b89-657e-445f-921f-7e54aafceb85 tempest-SnapshotDependencyTests-1007144741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99505743-db82-414e-ae6a-d940155b61df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b76fa0c2-83e7-4b52-bdd0-15579051bfd3', 'volume_name': 'volume-b76fa0c2-83e7-4b52-bdd0-15579051bfd3', 'volume_size': 1, 'snapshot_id': 'a096684b-d505-401c-8cbb-590785ceb3de'}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:11:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-678a1b89-657e-445f-921f-7e54aafceb85 tempest-SnapshotDependencyTests-1007144741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27b1327d-910a-452b-aa07-7cf9fb7bbd23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:11:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-678a1b89-657e-445f-921f-7e54aafceb85 tempest-SnapshotDependencyTests-1007144741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27b1327d-910a-452b-aa07-7cf9fb7bbd23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:11:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-678a1b89-657e-445f-921f-7e54aafceb85 tempest-SnapshotDependencyTests-1007144741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb8f9708-95e5-4bc4-a4ea-b3a5e02a2ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:11:27 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-678a1b89-657e-445f-921f-7e54aafceb85 tempest-SnapshotDependencyTests-1007144741 None] Volume b76fa0c2-83e7-4b52-bdd0-15579051bfd3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b76fa0c2-83e7-4b52-bdd0-15579051bfd3', 'volume_size': 1, 'snapshot_id': 'a096684b-d505-401c-8cbb-590785ceb3de'} Sep 04 18:11:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-678a1b89-657e-445f-921f-7e54aafceb85 tempest-SnapshotDependencyTests-1007144741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:11:27 devstack sudo[107438]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-88d1fb27-d997-49bf-858a-2fc1c065063e tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-71487a65-5e15-479d-8ceb-45a6283b70df" returned: 0 in 0.242s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:27 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-88d1fb27-d997-49bf-858a-2fc1c065063e tempest-ProjectMemberTests-488731474 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:11:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-88d1fb27-d997-49bf-858a-2fc1c065063e tempest-ProjectMemberTests-488731474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:11:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-678a1b89-657e-445f-921f-7e54aafceb85 tempest-SnapshotDependencyTests-1007144741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.147s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:11:27 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-678a1b89-657e-445f-921f-7e54aafceb85 tempest-SnapshotDependencyTests-1007144741 None] Acquiring lock "cinder-quobyte-a096684b-d505-401c-8cbb-590785ceb3de-b76fa0c2-83e7-4b52-bdd0-15579051bfd3" by "_create_volume_from_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:11:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-88d1fb27-d997-49bf-858a-2fc1c065063e tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b35f34f-bbe8-4a84-ba36-9d5f5ff416e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71487a65-5e15-479d-8ceb-45a6283b70df', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:11:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-88d1fb27-d997-49bf-858a-2fc1c065063e tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12448508-9768-407c-9054-731c723b8fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:11:27 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-678a1b89-657e-445f-921f-7e54aafceb85 tempest-SnapshotDependencyTests-1007144741 None] Lock "cinder-quobyte-a096684b-d505-401c-8cbb-590785ceb3de-b76fa0c2-83e7-4b52-bdd0-15579051bfd3" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:11:27 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-678a1b89-657e-445f-921f-7e54aafceb85 tempest-SnapshotDependencyTests-1007144741 None] Creating volume b76fa0c2-83e7-4b52-bdd0-15579051bfd3 from snapshot a096684b-d505-401c-8cbb-590785ceb3de {{(pid=87314) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 04 18:11:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-678a1b89-657e-445f-921f-7e54aafceb85 tempest-SnapshotDependencyTests-1007144741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:11:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-678a1b89-657e-445f-921f-7e54aafceb85 tempest-SnapshotDependencyTests-1007144741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:11:27 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-678a1b89-657e-445f-921f-7e54aafceb85 tempest-SnapshotDependencyTests-1007144741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:11:27 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-678a1b89-657e-445f-921f-7e54aafceb85 tempest-SnapshotDependencyTests-1007144741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:11:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-678a1b89-657e-445f-921f-7e54aafceb85 tempest-SnapshotDependencyTests-1007144741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:11:27 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-678a1b89-657e-445f-921f-7e54aafceb85 tempest-SnapshotDependencyTests-1007144741 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:11:27 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-678a1b89-657e-445f-921f-7e54aafceb85 tempest-SnapshotDependencyTests-1007144741 None] Acquiring lock "cinder-quobyte-b76fa0c2-83e7-4b52-bdd0-15579051bfd3" by "_copy_volume_from_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:11:27 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-88d1fb27-d997-49bf-858a-2fc1c065063e tempest-ProjectMemberTests-488731474 None] Volume volume-71487a65-5e15-479d-8ceb-45a6283b70df (71487a65-5e15-479d-8ceb-45a6283b70df): created successfully Sep 04 18:11:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-88d1fb27-d997-49bf-858a-2fc1c065063e tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12448508-9768-407c-9054-731c723b8fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:11:27 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-88d1fb27-d997-49bf-858a-2fc1c065063e tempest-ProjectMemberTests-488731474 None] Flow 'volume_create_manager' (f24041d8-624c-47d9-a550-fc87d1145071) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:11:27 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-678a1b89-657e-445f-921f-7e54aafceb85 tempest-SnapshotDependencyTests-1007144741 None] Lock "cinder-quobyte-b76fa0c2-83e7-4b52-bdd0-15579051bfd3" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:11:27 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-678a1b89-657e-445f-921f-7e54aafceb85 tempest-SnapshotDependencyTests-1007144741 None] snapshot: a096684b-d505-401c-8cbb-590785ceb3de, volume: b76fa0c2-83e7-4b52-bdd0-15579051bfd3, {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 04 18:11:27 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-88d1fb27-d997-49bf-858a-2fc1c065063e tempest-ProjectMemberTests-488731474 None] Created volume successfully. Sep 04 18:11:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-678a1b89-657e-445f-921f-7e54aafceb85 tempest-SnapshotDependencyTests-1007144741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:11:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-678a1b89-657e-445f-921f-7e54aafceb85 tempest-SnapshotDependencyTests-1007144741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:11:27 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-678a1b89-657e-445f-921f-7e54aafceb85 tempest-SnapshotDependencyTests-1007144741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:11:27 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-678a1b89-657e-445f-921f-7e54aafceb85 tempest-SnapshotDependencyTests-1007144741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:11:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-678a1b89-657e-445f-921f-7e54aafceb85 tempest-SnapshotDependencyTests-1007144741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:11:27 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e5f36e-9f1f-4cc3-9184-4338d7aac803]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:11:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-678a1b89-657e-445f-921f-7e54aafceb85 tempest-SnapshotDependencyTests-1007144741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6.a096684b-d505-401c-8cbb-590785ceb3de {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:27 devstack sudo[107441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6.a096684b-d505-401c-8cbb-590785ceb3de Sep 04 18:11:27 devstack sudo[107441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fc408f7d-46c7-412c-8a7a-044ba82cf411 tempest-ProjectMemberTests-488731474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:11:27 devstack sudo[107441]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-678a1b89-657e-445f-921f-7e54aafceb85 tempest-SnapshotDependencyTests-1007144741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6.a096684b-d505-401c-8cbb-590785ceb3de" returned: 0 in 0.381s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:27 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-678a1b89-657e-445f-921f-7e54aafceb85 tempest-SnapshotDependencyTests-1007144741 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 18:11:27 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2d90f9-bfd4-4d00-8d31-08299d3f352a]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:11:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-678a1b89-657e-445f-921f-7e54aafceb85 tempest-SnapshotDependencyTests-1007144741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:28 devstack sudo[107446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6 Sep 04 18:11:28 devstack sudo[107446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:28 devstack sudo[107446]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-678a1b89-657e-445f-921f-7e54aafceb85 tempest-SnapshotDependencyTests-1007144741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6" returned: 0 in 0.336s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:28 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-678a1b89-657e-445f-921f-7e54aafceb85 tempest-SnapshotDependencyTests-1007144741 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6 {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 04 18:11:28 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-678a1b89-657e-445f-921f-7e54aafceb85 tempest-SnapshotDependencyTests-1007144741 None] Creating direct copy from snapshot {{(pid=87314) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 04 18:11:28 devstack cinder-volume[87314]: DEBUG cinder.utils [None req-678a1b89-657e-445f-921f-7e54aafceb85 tempest-SnapshotDependencyTests-1007144741 None] Path /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b76fa0c2-83e7-4b52-bdd0-15579051bfd3 not found in is_blk_device check {{(pid=87314) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 04 18:11:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-678a1b89-657e-445f-921f-7e54aafceb85 tempest-SnapshotDependencyTests-1007144741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b76fa0c2-83e7-4b52-bdd0-15579051bfd3 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:28 devstack sudo[107451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b76fa0c2-83e7-4b52-bdd0-15579051bfd3 Sep 04 18:11:28 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:32 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-678a1b89-657e-445f-921f-7e54aafceb85 tempest-SnapshotDependencyTests-1007144741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b76fa0c2-83e7-4b52-bdd0-15579051bfd3" returned: 0 in 3.826s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:32 devstack cinder-volume[87314]: DEBUG cinder.image.image_utils [None req-678a1b89-657e-445f-921f-7e54aafceb85 tempest-SnapshotDependencyTests-1007144741 None] Image conversion details: src /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6, size 1024.00 MB, duration 3.83 sec, destination /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b76fa0c2-83e7-4b52-bdd0-15579051bfd3 {{(pid=87314) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 18:11:32 devstack cinder-volume[87314]: INFO cinder.image.image_utils [None req-678a1b89-657e-445f-921f-7e54aafceb85 tempest-SnapshotDependencyTests-1007144741 None] Converted 1024.00 MB image at 267.53 MB/s Sep 04 18:11:32 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-678a1b89-657e-445f-921f-7e54aafceb85 tempest-SnapshotDependencyTests-1007144741 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b76fa0c2-83e7-4b52-bdd0-15579051bfd3 is being set with open permissions: ugo+rw Sep 04 18:11:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-678a1b89-657e-445f-921f-7e54aafceb85 tempest-SnapshotDependencyTests-1007144741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b76fa0c2-83e7-4b52-bdd0-15579051bfd3 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:32 devstack sudo[107464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b76fa0c2-83e7-4b52-bdd0-15579051bfd3 Sep 04 18:11:32 devstack sudo[107464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:32 devstack sudo[107464]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-678a1b89-657e-445f-921f-7e54aafceb85 tempest-SnapshotDependencyTests-1007144741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b76fa0c2-83e7-4b52-bdd0-15579051bfd3" returned: 0 in 0.249s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:32 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-678a1b89-657e-445f-921f-7e54aafceb85 tempest-SnapshotDependencyTests-1007144741 None] Lock "cinder-quobyte-b76fa0c2-83e7-4b52-bdd0-15579051bfd3" released by "_copy_volume_from_snapshot" :: held 4.873s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:11:32 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-678a1b89-657e-445f-921f-7e54aafceb85 tempest-SnapshotDependencyTests-1007144741 None] Lock "cinder-quobyte-a096684b-d505-401c-8cbb-590785ceb3de-b76fa0c2-83e7-4b52-bdd0-15579051bfd3" released by "_create_volume_from_snapshot" :: held 4.958s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:11:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-678a1b89-657e-445f-921f-7e54aafceb85 tempest-SnapshotDependencyTests-1007144741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.988s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:11:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fc408f7d-46c7-412c-8a7a-044ba82cf411 tempest-ProjectMemberTests-488731474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.513s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:11:32 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-fc408f7d-46c7-412c-8a7a-044ba82cf411 tempest-ProjectMemberTests-488731474 None] Creating offline snapshot 57f03736-b65f-4012-b515-966ad13dd469 of volume 71487a65-5e15-479d-8ceb-45a6283b70df {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 18:11:32 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-678a1b89-657e-445f-921f-7e54aafceb85 tempest-SnapshotDependencyTests-1007144741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb8f9708-95e5-4bc4-a4ea-b3a5e02a2ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b76fa0c2-83e7-4b52-bdd0-15579051bfd3', 'volume_size': 1, 'snapshot_id': 'a096684b-d505-401c-8cbb-590785ceb3de'}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:11:32 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-678a1b89-657e-445f-921f-7e54aafceb85 tempest-SnapshotDependencyTests-1007144741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58ab237d-25ac-4dba-9086-5ff7bfe027d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:11:32 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed9bf6c-6950-42e6-bb6e-19686042c32c]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:11:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fc408f7d-46c7-412c-8a7a-044ba82cf411 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-71487a65-5e15-479d-8ceb-45a6283b70df {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:32 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-678a1b89-657e-445f-921f-7e54aafceb85 tempest-SnapshotDependencyTests-1007144741 None] Volume volume-b76fa0c2-83e7-4b52-bdd0-15579051bfd3 (b76fa0c2-83e7-4b52-bdd0-15579051bfd3): created successfully Sep 04 18:11:32 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-678a1b89-657e-445f-921f-7e54aafceb85 tempest-SnapshotDependencyTests-1007144741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58ab237d-25ac-4dba-9086-5ff7bfe027d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:11:32 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-678a1b89-657e-445f-921f-7e54aafceb85 tempest-SnapshotDependencyTests-1007144741 None] Flow 'volume_create_manager' (27005fa9-69bd-42d6-a109-137598edb3c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:11:32 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-678a1b89-657e-445f-921f-7e54aafceb85 tempest-SnapshotDependencyTests-1007144741 None] Created volume successfully. Sep 04 18:11:32 devstack sudo[107467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-71487a65-5e15-479d-8ceb-45a6283b70df Sep 04 18:11:32 devstack sudo[107467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:32 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6068b657-3801-4cc8-b890-ef08401d1e35 tempest-SnapshotDependencyTests-1007144741 None] Acquiring lock "cinder-a096684b-d505-401c-8cbb-590785ceb3de-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:11:32 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6068b657-3801-4cc8-b890-ef08401d1e35 tempest-SnapshotDependencyTests-1007144741 None] Lock "cinder-a096684b-d505-401c-8cbb-590785ceb3de-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:11:32 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6068b657-3801-4cc8-b890-ef08401d1e35 tempest-SnapshotDependencyTests-1007144741 None] Acquiring lock "cinder-quobyte-5df6f55d-50f9-40cf-b2d1-9a3758e847e6" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:11:32 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6068b657-3801-4cc8-b890-ef08401d1e35 tempest-SnapshotDependencyTests-1007144741 None] Lock "cinder-quobyte-5df6f55d-50f9-40cf-b2d1-9a3758e847e6" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:11:32 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6068b657-3801-4cc8-b890-ef08401d1e35 tempest-SnapshotDependencyTests-1007144741 None] Acquiring lock "cinder-quobyte-a096684b-d505-401c-8cbb-590785ceb3de" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:11:32 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6068b657-3801-4cc8-b890-ef08401d1e35 tempest-SnapshotDependencyTests-1007144741 None] Lock "cinder-quobyte-a096684b-d505-401c-8cbb-590785ceb3de" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:11:32 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-6068b657-3801-4cc8-b890-ef08401d1e35 tempest-SnapshotDependencyTests-1007144741 None] Deleting offline snapshot a096684b-d505-401c-8cbb-590785ceb3de of volume 5df6f55d-50f9-40cf-b2d1-9a3758e847e6 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 18:11:32 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-6068b657-3801-4cc8-b890-ef08401d1e35 tempest-SnapshotDependencyTests-1007144741 None] snapshot_file for this snap is: volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6.a096684b-d505-401c-8cbb-590785ceb3de {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 18:11:32 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec4dce5-e2f5-429f-a3d2-5dc7c344fc90]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:11:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6068b657-3801-4cc8-b890-ef08401d1e35 tempest-SnapshotDependencyTests-1007144741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6.a096684b-d505-401c-8cbb-590785ceb3de {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:32 devstack sudo[107467]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fc408f7d-46c7-412c-8a7a-044ba82cf411 tempest-ProjectMemberTests-488731474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-71487a65-5e15-479d-8ceb-45a6283b70df" returned: 0 in 0.380s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fc408f7d-46c7-412c-8a7a-044ba82cf411 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-71487a65-5e15-479d-8ceb-45a6283b70df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-71487a65-5e15-479d-8ceb-45a6283b70df.57f03736-b65f-4012-b515-966ad13dd469 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:32 devstack sudo[107473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-71487a65-5e15-479d-8ceb-45a6283b70df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-71487a65-5e15-479d-8ceb-45a6283b70df.57f03736-b65f-4012-b515-966ad13dd469 1G Sep 04 18:11:32 devstack sudo[107473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:32 devstack sudo[107472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6.a096684b-d505-401c-8cbb-590785ceb3de Sep 04 18:11:32 devstack sudo[107472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:33 devstack sudo[107472]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6068b657-3801-4cc8-b890-ef08401d1e35 tempest-SnapshotDependencyTests-1007144741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6.a096684b-d505-401c-8cbb-590785ceb3de" returned: 0 in 0.366s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:33 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-6068b657-3801-4cc8-b890-ef08401d1e35 tempest-SnapshotDependencyTests-1007144741 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 18:11:33 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1dedb2-b245-479d-82ac-9fbe21c89eed]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:11:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6068b657-3801-4cc8-b890-ef08401d1e35 tempest-SnapshotDependencyTests-1007144741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:33 devstack sudo[107473]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fc408f7d-46c7-412c-8a7a-044ba82cf411 tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-71487a65-5e15-479d-8ceb-45a6283b70df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-71487a65-5e15-479d-8ceb-45a6283b70df.57f03736-b65f-4012-b515-966ad13dd469 1G" returned: 0 in 0.400s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fc408f7d-46c7-412c-8a7a-044ba82cf411 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71487a65-5e15-479d-8ceb-45a6283b70df -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-71487a65-5e15-479d-8ceb-45a6283b70df.57f03736-b65f-4012-b515-966ad13dd469 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:33 devstack sudo[107484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71487a65-5e15-479d-8ceb-45a6283b70df -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-71487a65-5e15-479d-8ceb-45a6283b70df.57f03736-b65f-4012-b515-966ad13dd469 Sep 04 18:11:33 devstack sudo[107484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:33 devstack sudo[107483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6 Sep 04 18:11:33 devstack sudo[107483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:33 devstack sudo[107484]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fc408f7d-46c7-412c-8a7a-044ba82cf411 tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71487a65-5e15-479d-8ceb-45a6283b70df -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-71487a65-5e15-479d-8ceb-45a6283b70df.57f03736-b65f-4012-b515-966ad13dd469" returned: 0 in 0.281s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:33 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-fc408f7d-46c7-412c-8a7a-044ba82cf411 tempest-ProjectMemberTests-488731474 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-71487a65-5e15-479d-8ceb-45a6283b70df.57f03736-b65f-4012-b515-966ad13dd469 is being set with open permissions: ugo+rw Sep 04 18:11:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fc408f7d-46c7-412c-8a7a-044ba82cf411 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-71487a65-5e15-479d-8ceb-45a6283b70df.57f03736-b65f-4012-b515-966ad13dd469 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:33 devstack sudo[107493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-71487a65-5e15-479d-8ceb-45a6283b70df.57f03736-b65f-4012-b515-966ad13dd469 Sep 04 18:11:33 devstack sudo[107493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:33 devstack sudo[107483]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6068b657-3801-4cc8-b890-ef08401d1e35 tempest-SnapshotDependencyTests-1007144741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6" returned: 0 in 0.517s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6068b657-3801-4cc8-b890-ef08401d1e35 tempest-SnapshotDependencyTests-1007144741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6.a096684b-d505-401c-8cbb-590785ceb3de {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:33 devstack sudo[107496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6.a096684b-d505-401c-8cbb-590785ceb3de Sep 04 18:11:33 devstack sudo[107496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:33 devstack sudo[107493]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fc408f7d-46c7-412c-8a7a-044ba82cf411 tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-71487a65-5e15-479d-8ceb-45a6283b70df.57f03736-b65f-4012-b515-966ad13dd469" returned: 0 in 0.250s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fc408f7d-46c7-412c-8a7a-044ba82cf411 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-71487a65-5e15-479d-8ceb-45a6283b70df.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:33 devstack sudo[107499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-71487a65-5e15-479d-8ceb-45a6283b70df.info Sep 04 18:11:33 devstack sudo[107499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:34 devstack sudo[107496]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6068b657-3801-4cc8-b890-ef08401d1e35 tempest-SnapshotDependencyTests-1007144741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6.a096684b-d505-401c-8cbb-590785ceb3de" returned: 0 in 0.330s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6068b657-3801-4cc8-b890-ef08401d1e35 tempest-SnapshotDependencyTests-1007144741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6.a096684b-d505-401c-8cbb-590785ceb3de {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:34 devstack sudo[107499]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fc408f7d-46c7-412c-8a7a-044ba82cf411 tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-71487a65-5e15-479d-8ceb-45a6283b70df.info" returned: 0 in 0.243s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:34 devstack sudo[107506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6.a096684b-d505-401c-8cbb-590785ceb3de Sep 04 18:11:34 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-fc408f7d-46c7-412c-8a7a-044ba82cf411 tempest-ProjectMemberTests-488731474 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-71487a65-5e15-479d-8ceb-45a6283b70df.info is being set with open permissions: ugo+rw Sep 04 18:11:34 devstack sudo[107506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fc408f7d-46c7-412c-8a7a-044ba82cf411 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-71487a65-5e15-479d-8ceb-45a6283b70df.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:34 devstack sudo[107508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-71487a65-5e15-479d-8ceb-45a6283b70df.info Sep 04 18:11:34 devstack sudo[107508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:34 devstack sudo[107506]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6068b657-3801-4cc8-b890-ef08401d1e35 tempest-SnapshotDependencyTests-1007144741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6.a096684b-d505-401c-8cbb-590785ceb3de" returned: 0 in 0.239s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:34 devstack sudo[107508]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fc408f7d-46c7-412c-8a7a-044ba82cf411 tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-71487a65-5e15-479d-8ceb-45a6283b70df.info" returned: 0 in 0.247s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fc408f7d-46c7-412c-8a7a-044ba82cf411 tempest-ProjectMemberTests-488731474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.905s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:11:34 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6068b657-3801-4cc8-b890-ef08401d1e35 tempest-SnapshotDependencyTests-1007144741 None] Lock "cinder-quobyte-a096684b-d505-401c-8cbb-590785ceb3de" released by "_delete_snapshot" :: held 1.555s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:11:34 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6068b657-3801-4cc8-b890-ef08401d1e35 tempest-SnapshotDependencyTests-1007144741 None] Lock "cinder-quobyte-5df6f55d-50f9-40cf-b2d1-9a3758e847e6" released by "delete_snapshot" :: held 1.588s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:11:34 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-fc408f7d-46c7-412c-8a7a-044ba82cf411 tempest-ProjectMemberTests-488731474 None] Create snapshot completed successfully Sep 04 18:11:34 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-6068b657-3801-4cc8-b890-ef08401d1e35 tempest-SnapshotDependencyTests-1007144741 None] Created reservations ['769f77ab-6438-437f-9808-80499b4d3c4a', '4c47675c-f4fd-4ab5-91ed-70af1a63bbf0', '2aa4f475-6226-462d-8581-8173b93bcb19', '47382a2e-e5aa-4167-99e9-37c1e6a9c809'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:11:34 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-6068b657-3801-4cc8-b890-ef08401d1e35 tempest-SnapshotDependencyTests-1007144741 None] Delete snapshot completed successfully. Sep 04 18:11:34 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-6068b657-3801-4cc8-b890-ef08401d1e35 tempest-SnapshotDependencyTests-1007144741 None] Lock "cinder-a096684b-d505-401c-8cbb-590785ceb3de-delete_snapshot" released by "delete_snapshot" :: held 1.731s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:11:34 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-199cb2c2-9052-4185-aef9-2d9665d23c76 tempest-SnapshotDependencyTests-1007144741 None] Acquiring lock "cinder-5df6f55d-50f9-40cf-b2d1-9a3758e847e6-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:11:34 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-199cb2c2-9052-4185-aef9-2d9665d23c76 tempest-SnapshotDependencyTests-1007144741 None] Lock "cinder-5df6f55d-50f9-40cf-b2d1-9a3758e847e6-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:11:34 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-199cb2c2-9052-4185-aef9-2d9665d23c76 tempest-SnapshotDependencyTests-1007144741 None] Acquiring lock "cinder-quobyte-5df6f55d-50f9-40cf-b2d1-9a3758e847e6" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:11:34 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-199cb2c2-9052-4185-aef9-2d9665d23c76 tempest-SnapshotDependencyTests-1007144741 None] Lock "cinder-quobyte-5df6f55d-50f9-40cf-b2d1-9a3758e847e6" acquired by "delete_volume" :: waited 0.022s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:11:34 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e3d379-6506-440b-97d5-967875ec2d05]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:11:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-199cb2c2-9052-4185-aef9-2d9665d23c76 tempest-SnapshotDependencyTests-1007144741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:35 devstack sudo[107512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6 Sep 04 18:11:35 devstack sudo[107512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:35 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0881e3b1-2524-42bd-9f2f-02097b27978a tempest-ProjectMemberTests-488731474 None] Acquiring lock "cinder-57f03736-b65f-4012-b515-966ad13dd469-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:11:35 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0881e3b1-2524-42bd-9f2f-02097b27978a tempest-ProjectMemberTests-488731474 None] Lock "cinder-57f03736-b65f-4012-b515-966ad13dd469-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:11:35 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0881e3b1-2524-42bd-9f2f-02097b27978a tempest-ProjectMemberTests-488731474 None] Acquiring lock "cinder-quobyte-71487a65-5e15-479d-8ceb-45a6283b70df" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:11:35 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0881e3b1-2524-42bd-9f2f-02097b27978a tempest-ProjectMemberTests-488731474 None] Lock "cinder-quobyte-71487a65-5e15-479d-8ceb-45a6283b70df" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:11:35 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0881e3b1-2524-42bd-9f2f-02097b27978a tempest-ProjectMemberTests-488731474 None] Acquiring lock "cinder-quobyte-57f03736-b65f-4012-b515-966ad13dd469" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:11:35 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0881e3b1-2524-42bd-9f2f-02097b27978a tempest-ProjectMemberTests-488731474 None] Lock "cinder-quobyte-57f03736-b65f-4012-b515-966ad13dd469" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:11:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-0881e3b1-2524-42bd-9f2f-02097b27978a tempest-ProjectMemberTests-488731474 None] Deleting offline snapshot 57f03736-b65f-4012-b515-966ad13dd469 of volume 71487a65-5e15-479d-8ceb-45a6283b70df {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 18:11:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-0881e3b1-2524-42bd-9f2f-02097b27978a tempest-ProjectMemberTests-488731474 None] snapshot_file for this snap is: volume-71487a65-5e15-479d-8ceb-45a6283b70df.57f03736-b65f-4012-b515-966ad13dd469 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 18:11:35 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae8a2c2-ed08-4c13-bba9-114332079a7f]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:11:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0881e3b1-2524-42bd-9f2f-02097b27978a tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-71487a65-5e15-479d-8ceb-45a6283b70df.57f03736-b65f-4012-b515-966ad13dd469 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:35 devstack sudo[107512]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-199cb2c2-9052-4185-aef9-2d9665d23c76 tempest-SnapshotDependencyTests-1007144741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6" returned: 0 in 0.391s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-199cb2c2-9052-4185-aef9-2d9665d23c76 tempest-SnapshotDependencyTests-1007144741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:35 devstack sudo[107519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6 Sep 04 18:11:35 devstack sudo[107519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:35 devstack sudo[107517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-71487a65-5e15-479d-8ceb-45a6283b70df.57f03736-b65f-4012-b515-966ad13dd469 Sep 04 18:11:35 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:35 devstack sudo[107519]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-199cb2c2-9052-4185-aef9-2d9665d23c76 tempest-SnapshotDependencyTests-1007144741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-5df6f55d-50f9-40cf-b2d1-9a3758e847e6" returned: 0 in 0.254s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:35 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-199cb2c2-9052-4185-aef9-2d9665d23c76 tempest-SnapshotDependencyTests-1007144741 None] Lock "cinder-quobyte-5df6f55d-50f9-40cf-b2d1-9a3758e847e6" released by "delete_volume" :: held 0.724s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:11:35 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0881e3b1-2524-42bd-9f2f-02097b27978a tempest-ProjectMemberTests-488731474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-71487a65-5e15-479d-8ceb-45a6283b70df.57f03736-b65f-4012-b515-966ad13dd469" returned: 0 in 0.382s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-0881e3b1-2524-42bd-9f2f-02097b27978a tempest-ProjectMemberTests-488731474 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71487a65-5e15-479d-8ceb-45a6283b70df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 18:11:35 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-199cb2c2-9052-4185-aef9-2d9665d23c76 tempest-SnapshotDependencyTests-1007144741 None] Created reservations ['eb5ae00f-90cb-4887-a94a-1c274c1573f4', '3b7802ee-b9c1-46a5-8171-6255e8fe7074', '543a3cc1-f2b5-42a5-9b2d-d9e11753ec08', 'd3d54aad-4c39-407a-8531-bf35710d3211'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:11:35 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd26adb0-a275-4f6f-9696-97938a0b7a8a]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:11:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0881e3b1-2524-42bd-9f2f-02097b27978a tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-71487a65-5e15-479d-8ceb-45a6283b70df {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-199cb2c2-9052-4185-aef9-2d9665d23c76 tempest-SnapshotDependencyTests-1007144741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:11:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-199cb2c2-9052-4185-aef9-2d9665d23c76 tempest-SnapshotDependencyTests-1007144741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:11:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-199cb2c2-9052-4185-aef9-2d9665d23c76 tempest-SnapshotDependencyTests-1007144741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:11:35 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-199cb2c2-9052-4185-aef9-2d9665d23c76 tempest-SnapshotDependencyTests-1007144741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:11:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-199cb2c2-9052-4185-aef9-2d9665d23c76 tempest-SnapshotDependencyTests-1007144741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:11:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-199cb2c2-9052-4185-aef9-2d9665d23c76 tempest-SnapshotDependencyTests-1007144741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:35 devstack sudo[107527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:11:35 devstack sudo[107527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:35 devstack sudo[107526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-71487a65-5e15-479d-8ceb-45a6283b70df Sep 04 18:11:35 devstack sudo[107526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:36 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ae21bff6-a29b-4573-b177-0712f1092ad6 tempest-SnapshotDependencyTests-1007144741 None] Acquiring lock "cinder-b76fa0c2-83e7-4b52-bdd0-15579051bfd3-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:11:36 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ae21bff6-a29b-4573-b177-0712f1092ad6 tempest-SnapshotDependencyTests-1007144741 None] Lock "cinder-b76fa0c2-83e7-4b52-bdd0-15579051bfd3-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:11:36 devstack sudo[107527]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:36 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ae21bff6-a29b-4573-b177-0712f1092ad6 tempest-SnapshotDependencyTests-1007144741 None] Acquiring lock "cinder-quobyte-b76fa0c2-83e7-4b52-bdd0-15579051bfd3" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:11:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-199cb2c2-9052-4185-aef9-2d9665d23c76 tempest-SnapshotDependencyTests-1007144741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.293s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:36 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-199cb2c2-9052-4185-aef9-2d9665d23c76 tempest-SnapshotDependencyTests-1007144741 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:11:36 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-199cb2c2-9052-4185-aef9-2d9665d23c76 tempest-SnapshotDependencyTests-1007144741 None] Deleted volume successfully. Sep 04 18:11:36 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ae21bff6-a29b-4573-b177-0712f1092ad6 tempest-SnapshotDependencyTests-1007144741 None] Lock "cinder-quobyte-b76fa0c2-83e7-4b52-bdd0-15579051bfd3" acquired by "delete_volume" :: waited 0.028s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:11:36 devstack sudo[107526]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0881e3b1-2524-42bd-9f2f-02097b27978a tempest-ProjectMemberTests-488731474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-71487a65-5e15-479d-8ceb-45a6283b70df" returned: 0 in 0.401s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0881e3b1-2524-42bd-9f2f-02097b27978a tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-71487a65-5e15-479d-8ceb-45a6283b70df.57f03736-b65f-4012-b515-966ad13dd469 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:36 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[01fa1f03-84ab-4c74-a643-1f2f99d9bef0]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:11:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ae21bff6-a29b-4573-b177-0712f1092ad6 tempest-SnapshotDependencyTests-1007144741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b76fa0c2-83e7-4b52-bdd0-15579051bfd3 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:36 devstack sudo[107534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-71487a65-5e15-479d-8ceb-45a6283b70df.57f03736-b65f-4012-b515-966ad13dd469 Sep 04 18:11:36 devstack sudo[107534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:36 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-199cb2c2-9052-4185-aef9-2d9665d23c76 tempest-SnapshotDependencyTests-1007144741 None] Lock "cinder-5df6f55d-50f9-40cf-b2d1-9a3758e847e6-delete_volume" released by "delete_volume" :: held 1.316s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:11:36 devstack sudo[107535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b76fa0c2-83e7-4b52-bdd0-15579051bfd3 Sep 04 18:11:36 devstack sudo[107535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:36 devstack sudo[107534]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0881e3b1-2524-42bd-9f2f-02097b27978a tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-71487a65-5e15-479d-8ceb-45a6283b70df.57f03736-b65f-4012-b515-966ad13dd469" returned: 0 in 0.324s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0881e3b1-2524-42bd-9f2f-02097b27978a tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-71487a65-5e15-479d-8ceb-45a6283b70df.57f03736-b65f-4012-b515-966ad13dd469 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:36 devstack sudo[107543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-71487a65-5e15-479d-8ceb-45a6283b70df.57f03736-b65f-4012-b515-966ad13dd469 Sep 04 18:11:36 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:36 devstack sudo[107535]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ae21bff6-a29b-4573-b177-0712f1092ad6 tempest-SnapshotDependencyTests-1007144741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b76fa0c2-83e7-4b52-bdd0-15579051bfd3" returned: 0 in 0.381s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ae21bff6-a29b-4573-b177-0712f1092ad6 tempest-SnapshotDependencyTests-1007144741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b76fa0c2-83e7-4b52-bdd0-15579051bfd3 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:36 devstack sudo[107546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b76fa0c2-83e7-4b52-bdd0-15579051bfd3 Sep 04 18:11:36 devstack sudo[107546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:36 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0881e3b1-2524-42bd-9f2f-02097b27978a tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-71487a65-5e15-479d-8ceb-45a6283b70df.57f03736-b65f-4012-b515-966ad13dd469" returned: 0 in 0.265s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:36 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0881e3b1-2524-42bd-9f2f-02097b27978a tempest-ProjectMemberTests-488731474 None] Lock "cinder-quobyte-57f03736-b65f-4012-b515-966ad13dd469" released by "_delete_snapshot" :: held 1.483s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:11:36 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0881e3b1-2524-42bd-9f2f-02097b27978a tempest-ProjectMemberTests-488731474 None] Lock "cinder-quobyte-71487a65-5e15-479d-8ceb-45a6283b70df" released by "delete_snapshot" :: held 1.510s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:11:36 devstack sudo[107546]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ae21bff6-a29b-4573-b177-0712f1092ad6 tempest-SnapshotDependencyTests-1007144741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b76fa0c2-83e7-4b52-bdd0-15579051bfd3" returned: 0 in 0.276s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:36 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ae21bff6-a29b-4573-b177-0712f1092ad6 tempest-SnapshotDependencyTests-1007144741 None] Lock "cinder-quobyte-b76fa0c2-83e7-4b52-bdd0-15579051bfd3" released by "delete_volume" :: held 0.705s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:11:36 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-0881e3b1-2524-42bd-9f2f-02097b27978a tempest-ProjectMemberTests-488731474 None] Created reservations ['c52fe9a1-e6ad-4a2b-8b9a-5b6cb3940769', 'e7c38b85-6036-4a32-b8f3-dfad4bf560a5', 'd34073d8-050e-44ed-952e-9b90946dcfb9', '0d8bf6e1-c8e2-4e21-8a39-6a56b450e9fa'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:11:36 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-ae21bff6-a29b-4573-b177-0712f1092ad6 tempest-SnapshotDependencyTests-1007144741 None] Created reservations ['798a01f9-93b0-41ab-9bdc-2425f3e14f30', '4caf0489-4638-4c5c-9821-ce0db766cd56', 'e2c8a7a9-9c96-4aba-b706-aac52fccc86e', '14ebe44e-c936-4425-be95-172794fa24a7'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:11:36 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-0881e3b1-2524-42bd-9f2f-02097b27978a tempest-ProjectMemberTests-488731474 None] Delete snapshot completed successfully. Sep 04 18:11:36 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0881e3b1-2524-42bd-9f2f-02097b27978a tempest-ProjectMemberTests-488731474 None] Lock "cinder-57f03736-b65f-4012-b515-966ad13dd469-delete_snapshot" released by "delete_snapshot" :: held 1.698s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:11:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ae21bff6-a29b-4573-b177-0712f1092ad6 tempest-SnapshotDependencyTests-1007144741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:11:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ae21bff6-a29b-4573-b177-0712f1092ad6 tempest-SnapshotDependencyTests-1007144741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:11:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ae21bff6-a29b-4573-b177-0712f1092ad6 tempest-SnapshotDependencyTests-1007144741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:11:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-ae21bff6-a29b-4573-b177-0712f1092ad6 tempest-SnapshotDependencyTests-1007144741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:11:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-ae21bff6-a29b-4573-b177-0712f1092ad6 tempest-SnapshotDependencyTests-1007144741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:11:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ae21bff6-a29b-4573-b177-0712f1092ad6 tempest-SnapshotDependencyTests-1007144741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:36 devstack sudo[107550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:11:36 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:37 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-ae21bff6-a29b-4573-b177-0712f1092ad6 tempest-SnapshotDependencyTests-1007144741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.238s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:37 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-ae21bff6-a29b-4573-b177-0712f1092ad6 tempest-SnapshotDependencyTests-1007144741 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:11:37 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-ae21bff6-a29b-4573-b177-0712f1092ad6 tempest-SnapshotDependencyTests-1007144741 None] Deleted volume successfully. Sep 04 18:11:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-ae21bff6-a29b-4573-b177-0712f1092ad6 tempest-SnapshotDependencyTests-1007144741 None] Lock "cinder-b76fa0c2-83e7-4b52-bdd0-15579051bfd3-delete_volume" released by "delete_volume" :: held 1.192s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:11:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d377ca58-5493-4b66-88b0-324d4558aa7c tempest-ProjectMemberTests-488731474 None] Acquiring lock "cinder-71487a65-5e15-479d-8ceb-45a6283b70df-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:11:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d377ca58-5493-4b66-88b0-324d4558aa7c tempest-ProjectMemberTests-488731474 None] Lock "cinder-71487a65-5e15-479d-8ceb-45a6283b70df-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:11:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d377ca58-5493-4b66-88b0-324d4558aa7c tempest-ProjectMemberTests-488731474 None] Acquiring lock "cinder-quobyte-71487a65-5e15-479d-8ceb-45a6283b70df" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:11:37 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d377ca58-5493-4b66-88b0-324d4558aa7c tempest-ProjectMemberTests-488731474 None] Lock "cinder-quobyte-71487a65-5e15-479d-8ceb-45a6283b70df" acquired by "delete_volume" :: waited 0.016s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:11:37 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[997a97e2-a1c9-41c2-ab1e-225daa4cea8b]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:11:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d377ca58-5493-4b66-88b0-324d4558aa7c tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-71487a65-5e15-479d-8ceb-45a6283b70df {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:37 devstack sudo[107553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-71487a65-5e15-479d-8ceb-45a6283b70df Sep 04 18:11:37 devstack sudo[107553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:37 devstack sudo[107553]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d377ca58-5493-4b66-88b0-324d4558aa7c tempest-ProjectMemberTests-488731474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-71487a65-5e15-479d-8ceb-45a6283b70df" returned: 0 in 0.377s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:37 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d377ca58-5493-4b66-88b0-324d4558aa7c tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-71487a65-5e15-479d-8ceb-45a6283b70df {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:37 devstack sudo[107558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-71487a65-5e15-479d-8ceb-45a6283b70df Sep 04 18:11:37 devstack sudo[107558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:38 devstack sudo[107558]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d377ca58-5493-4b66-88b0-324d4558aa7c tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-71487a65-5e15-479d-8ceb-45a6283b70df" returned: 0 in 0.276s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d377ca58-5493-4b66-88b0-324d4558aa7c tempest-ProjectMemberTests-488731474 None] Lock "cinder-quobyte-71487a65-5e15-479d-8ceb-45a6283b70df" released by "delete_volume" :: held 0.723s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:11:38 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-d377ca58-5493-4b66-88b0-324d4558aa7c tempest-ProjectMemberTests-488731474 None] Created reservations ['1aa4e7de-9b81-4d62-8e77-c3ed108d688b', '50ff4fc1-f857-45ff-8c71-af4c0780b212', '8b69c4bd-5850-4928-902e-c86eca2ca6ee', 'ff5240e1-b4cc-4607-8913-5033a1c217eb'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:11:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d377ca58-5493-4b66-88b0-324d4558aa7c tempest-ProjectMemberTests-488731474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:11:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d377ca58-5493-4b66-88b0-324d4558aa7c tempest-ProjectMemberTests-488731474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:11:38 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d377ca58-5493-4b66-88b0-324d4558aa7c tempest-ProjectMemberTests-488731474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:11:38 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-d377ca58-5493-4b66-88b0-324d4558aa7c tempest-ProjectMemberTests-488731474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:11:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d377ca58-5493-4b66-88b0-324d4558aa7c tempest-ProjectMemberTests-488731474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:11:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d377ca58-5493-4b66-88b0-324d4558aa7c tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:38 devstack sudo[107561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:11:38 devstack sudo[107561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:38 devstack sudo[107561]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:38 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d377ca58-5493-4b66-88b0-324d4558aa7c tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.242s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:38 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-d377ca58-5493-4b66-88b0-324d4558aa7c tempest-ProjectMemberTests-488731474 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:11:38 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-d377ca58-5493-4b66-88b0-324d4558aa7c tempest-ProjectMemberTests-488731474 None] Deleted volume successfully. Sep 04 18:11:38 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d377ca58-5493-4b66-88b0-324d4558aa7c tempest-ProjectMemberTests-488731474 None] Lock "cinder-71487a65-5e15-479d-8ceb-45a6283b70df-delete_volume" released by "delete_volume" :: held 1.176s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:11:39 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b006e0f-6749-4ddd-8a61-2aab188b1616 tempest-ProjectMemberTests-488731474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:11:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0b006e0f-6749-4ddd-8a61-2aab188b1616 tempest-ProjectMemberTests-488731474 None] Flow 'volume_create_manager' (f2938149-7e74-4b86-867c-3bf5edb43d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:11:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0b006e0f-6749-4ddd-8a61-2aab188b1616 tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7191139d-f5c2-4ac5-9069-8d805ce2808f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:11:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0b006e0f-6749-4ddd-8a61-2aab188b1616 tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7191139d-f5c2-4ac5-9069-8d805ce2808f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1492769687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c2e25fe-bed7-47ac-bad9-255c25f77980,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b5af8d2d70740348028c34578cb1393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:11:39Z,use_quota=True,user_id='21f3365c7a9a490387324872cde069aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:11:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0b006e0f-6749-4ddd-8a61-2aab188b1616 tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c06b7f4d-52dd-4efa-8e88-6d9cd0ef5ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:11:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0b006e0f-6749-4ddd-8a61-2aab188b1616 tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c06b7f4d-52dd-4efa-8e88-6d9cd0ef5ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:11:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0b006e0f-6749-4ddd-8a61-2aab188b1616 tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac00fd7c-bc22-4b14-a6b6-345d1e29a91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:11:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0b006e0f-6749-4ddd-8a61-2aab188b1616 tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac00fd7c-bc22-4b14-a6b6-345d1e29a91f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c2e25fe-bed7-47ac-bad9-255c25f77980', 'volume_name': 'volume-9c2e25fe-bed7-47ac-bad9-255c25f77980', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:11:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0b006e0f-6749-4ddd-8a61-2aab188b1616 tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (491f4f76-bcdf-435b-bcda-bcb2807b4693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:11:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0b006e0f-6749-4ddd-8a61-2aab188b1616 tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (491f4f76-bcdf-435b-bcda-bcb2807b4693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:11:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0b006e0f-6749-4ddd-8a61-2aab188b1616 tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a83759d0-8094-40d5-9910-63a03fe4f05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:11:39 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-0b006e0f-6749-4ddd-8a61-2aab188b1616 tempest-ProjectMemberTests-488731474 None] Volume 9c2e25fe-bed7-47ac-bad9-255c25f77980: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c2e25fe-bed7-47ac-bad9-255c25f77980', 'volume_size': 1} Sep 04 18:11:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0b006e0f-6749-4ddd-8a61-2aab188b1616 tempest-ProjectMemberTests-488731474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:11:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0b006e0f-6749-4ddd-8a61-2aab188b1616 tempest-ProjectMemberTests-488731474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:11:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0b006e0f-6749-4ddd-8a61-2aab188b1616 tempest-ProjectMemberTests-488731474 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1492769687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c2e25fe-bed7-47ac-bad9-255c25f77980,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b5af8d2d70740348028c34578cb1393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:11:39Z,use_quota=True,user_id='21f3365c7a9a490387324872cde069aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:11:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-0b006e0f-6749-4ddd-8a61-2aab188b1616 tempest-ProjectMemberTests-488731474 None] Creating volume 9c2e25fe-bed7-47ac-bad9-255c25f77980 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:11:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0b006e0f-6749-4ddd-8a61-2aab188b1616 tempest-ProjectMemberTests-488731474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:11:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0b006e0f-6749-4ddd-8a61-2aab188b1616 tempest-ProjectMemberTests-488731474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:11:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0b006e0f-6749-4ddd-8a61-2aab188b1616 tempest-ProjectMemberTests-488731474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:11:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0b006e0f-6749-4ddd-8a61-2aab188b1616 tempest-ProjectMemberTests-488731474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:11:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0b006e0f-6749-4ddd-8a61-2aab188b1616 tempest-ProjectMemberTests-488731474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:11:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0b006e0f-6749-4ddd-8a61-2aab188b1616 tempest-ProjectMemberTests-488731474 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:11:39 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-0b006e0f-6749-4ddd-8a61-2aab188b1616 tempest-ProjectMemberTests-488731474 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:11:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0b006e0f-6749-4ddd-8a61-2aab188b1616 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9c2e25fe-bed7-47ac-bad9-255c25f77980 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:39 devstack sudo[107565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9c2e25fe-bed7-47ac-bad9-255c25f77980 1073741824 Sep 04 18:11:39 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:39 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0b006e0f-6749-4ddd-8a61-2aab188b1616 tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9c2e25fe-bed7-47ac-bad9-255c25f77980 1073741824" returned: 0 in 0.441s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0b006e0f-6749-4ddd-8a61-2aab188b1616 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9c2e25fe-bed7-47ac-bad9-255c25f77980 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:39 devstack sudo[107571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9c2e25fe-bed7-47ac-bad9-255c25f77980 Sep 04 18:11:39 devstack sudo[107571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:39 devstack sudo[107571]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0b006e0f-6749-4ddd-8a61-2aab188b1616 tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9c2e25fe-bed7-47ac-bad9-255c25f77980" returned: 0 in 0.269s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:39 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0b006e0f-6749-4ddd-8a61-2aab188b1616 tempest-ProjectMemberTests-488731474 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:11:39 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0b006e0f-6749-4ddd-8a61-2aab188b1616 tempest-ProjectMemberTests-488731474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:11:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0b006e0f-6749-4ddd-8a61-2aab188b1616 tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a83759d0-8094-40d5-9910-63a03fe4f05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c2e25fe-bed7-47ac-bad9-255c25f77980', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:11:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0b006e0f-6749-4ddd-8a61-2aab188b1616 tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ff28d33-24d5-44f7-b415-91fda283545a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:11:39 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-0b006e0f-6749-4ddd-8a61-2aab188b1616 tempest-ProjectMemberTests-488731474 None] Volume volume-9c2e25fe-bed7-47ac-bad9-255c25f77980 (9c2e25fe-bed7-47ac-bad9-255c25f77980): created successfully Sep 04 18:11:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0b006e0f-6749-4ddd-8a61-2aab188b1616 tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ff28d33-24d5-44f7-b415-91fda283545a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:11:39 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-0b006e0f-6749-4ddd-8a61-2aab188b1616 tempest-ProjectMemberTests-488731474 None] Flow 'volume_create_manager' (f2938149-7e74-4b86-867c-3bf5edb43d5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:11:39 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-0b006e0f-6749-4ddd-8a61-2aab188b1616 tempest-ProjectMemberTests-488731474 None] Created volume successfully. Sep 04 18:11:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0d5495ed-fa4f-4588-8f76-aed5e2a8da2d tempest-ProjectMemberTests-488731474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:11:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0d5495ed-fa4f-4588-8f76-aed5e2a8da2d tempest-ProjectMemberTests-488731474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:11:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-0d5495ed-fa4f-4588-8f76-aed5e2a8da2d tempest-ProjectMemberTests-488731474 None] Creating offline snapshot c9bcaec2-d62a-43d5-9b12-7b50b3e451b7 of volume 9c2e25fe-bed7-47ac-bad9-255c25f77980 {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 18:11:40 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e7cafa-514d-4b51-bad4-8108c4ca9754]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:11:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0d5495ed-fa4f-4588-8f76-aed5e2a8da2d tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9c2e25fe-bed7-47ac-bad9-255c25f77980 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:40 devstack sudo[107574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9c2e25fe-bed7-47ac-bad9-255c25f77980 Sep 04 18:11:40 devstack sudo[107574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:40 devstack sudo[107574]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0d5495ed-fa4f-4588-8f76-aed5e2a8da2d tempest-ProjectMemberTests-488731474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9c2e25fe-bed7-47ac-bad9-255c25f77980" returned: 0 in 0.372s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0d5495ed-fa4f-4588-8f76-aed5e2a8da2d tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9c2e25fe-bed7-47ac-bad9-255c25f77980,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9c2e25fe-bed7-47ac-bad9-255c25f77980.c9bcaec2-d62a-43d5-9b12-7b50b3e451b7 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:40 devstack sudo[107579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9c2e25fe-bed7-47ac-bad9-255c25f77980,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9c2e25fe-bed7-47ac-bad9-255c25f77980.c9bcaec2-d62a-43d5-9b12-7b50b3e451b7 1G Sep 04 18:11:40 devstack sudo[107579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:41 devstack sudo[107579]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0d5495ed-fa4f-4588-8f76-aed5e2a8da2d tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9c2e25fe-bed7-47ac-bad9-255c25f77980,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9c2e25fe-bed7-47ac-bad9-255c25f77980.c9bcaec2-d62a-43d5-9b12-7b50b3e451b7 1G" returned: 0 in 0.511s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0d5495ed-fa4f-4588-8f76-aed5e2a8da2d tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c2e25fe-bed7-47ac-bad9-255c25f77980 -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9c2e25fe-bed7-47ac-bad9-255c25f77980.c9bcaec2-d62a-43d5-9b12-7b50b3e451b7 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:41 devstack sudo[107585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c2e25fe-bed7-47ac-bad9-255c25f77980 -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9c2e25fe-bed7-47ac-bad9-255c25f77980.c9bcaec2-d62a-43d5-9b12-7b50b3e451b7 Sep 04 18:11:41 devstack sudo[107585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:41 devstack sudo[107585]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0d5495ed-fa4f-4588-8f76-aed5e2a8da2d tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c2e25fe-bed7-47ac-bad9-255c25f77980 -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9c2e25fe-bed7-47ac-bad9-255c25f77980.c9bcaec2-d62a-43d5-9b12-7b50b3e451b7" returned: 0 in 0.302s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:41 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-0d5495ed-fa4f-4588-8f76-aed5e2a8da2d tempest-ProjectMemberTests-488731474 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9c2e25fe-bed7-47ac-bad9-255c25f77980.c9bcaec2-d62a-43d5-9b12-7b50b3e451b7 is being set with open permissions: ugo+rw Sep 04 18:11:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0d5495ed-fa4f-4588-8f76-aed5e2a8da2d tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9c2e25fe-bed7-47ac-bad9-255c25f77980.c9bcaec2-d62a-43d5-9b12-7b50b3e451b7 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:41 devstack sudo[107590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9c2e25fe-bed7-47ac-bad9-255c25f77980.c9bcaec2-d62a-43d5-9b12-7b50b3e451b7 Sep 04 18:11:41 devstack sudo[107590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:41 devstack sudo[107590]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0d5495ed-fa4f-4588-8f76-aed5e2a8da2d tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9c2e25fe-bed7-47ac-bad9-255c25f77980.c9bcaec2-d62a-43d5-9b12-7b50b3e451b7" returned: 0 in 0.288s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0d5495ed-fa4f-4588-8f76-aed5e2a8da2d tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9c2e25fe-bed7-47ac-bad9-255c25f77980.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:41 devstack sudo[107594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9c2e25fe-bed7-47ac-bad9-255c25f77980.info Sep 04 18:11:41 devstack sudo[107594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:42 devstack sudo[107594]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0d5495ed-fa4f-4588-8f76-aed5e2a8da2d tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9c2e25fe-bed7-47ac-bad9-255c25f77980.info" returned: 0 in 0.274s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:42 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-0d5495ed-fa4f-4588-8f76-aed5e2a8da2d tempest-ProjectMemberTests-488731474 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9c2e25fe-bed7-47ac-bad9-255c25f77980.info is being set with open permissions: ugo+rw Sep 04 18:11:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0d5495ed-fa4f-4588-8f76-aed5e2a8da2d tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9c2e25fe-bed7-47ac-bad9-255c25f77980.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:42 devstack sudo[107597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9c2e25fe-bed7-47ac-bad9-255c25f77980.info Sep 04 18:11:42 devstack sudo[107597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:42 devstack sudo[107597]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0d5495ed-fa4f-4588-8f76-aed5e2a8da2d tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9c2e25fe-bed7-47ac-bad9-255c25f77980.info" returned: 0 in 0.257s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0d5495ed-fa4f-4588-8f76-aed5e2a8da2d tempest-ProjectMemberTests-488731474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.087s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:11:42 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-0d5495ed-fa4f-4588-8f76-aed5e2a8da2d tempest-ProjectMemberTests-488731474 None] Create snapshot completed successfully Sep 04 18:11:43 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-339b927e-db51-4572-ae9b-fc4d8727f2f9 tempest-ProjectMemberTests-488731474 None] Acquiring lock "cinder-c9bcaec2-d62a-43d5-9b12-7b50b3e451b7-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:11:43 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-339b927e-db51-4572-ae9b-fc4d8727f2f9 tempest-ProjectMemberTests-488731474 None] Lock "cinder-c9bcaec2-d62a-43d5-9b12-7b50b3e451b7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:11:43 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-339b927e-db51-4572-ae9b-fc4d8727f2f9 tempest-ProjectMemberTests-488731474 None] Acquiring lock "cinder-quobyte-9c2e25fe-bed7-47ac-bad9-255c25f77980" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:11:43 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-339b927e-db51-4572-ae9b-fc4d8727f2f9 tempest-ProjectMemberTests-488731474 None] Lock "cinder-quobyte-9c2e25fe-bed7-47ac-bad9-255c25f77980" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:11:43 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-339b927e-db51-4572-ae9b-fc4d8727f2f9 tempest-ProjectMemberTests-488731474 None] Acquiring lock "cinder-quobyte-c9bcaec2-d62a-43d5-9b12-7b50b3e451b7" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:11:43 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-339b927e-db51-4572-ae9b-fc4d8727f2f9 tempest-ProjectMemberTests-488731474 None] Lock "cinder-quobyte-c9bcaec2-d62a-43d5-9b12-7b50b3e451b7" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:11:43 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-339b927e-db51-4572-ae9b-fc4d8727f2f9 tempest-ProjectMemberTests-488731474 None] Deleting offline snapshot c9bcaec2-d62a-43d5-9b12-7b50b3e451b7 of volume 9c2e25fe-bed7-47ac-bad9-255c25f77980 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 18:11:43 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-339b927e-db51-4572-ae9b-fc4d8727f2f9 tempest-ProjectMemberTests-488731474 None] snapshot_file for this snap is: volume-9c2e25fe-bed7-47ac-bad9-255c25f77980.c9bcaec2-d62a-43d5-9b12-7b50b3e451b7 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 18:11:43 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[291c1fe8-3f8c-4938-a9dd-09b66112ccae]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:11:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-339b927e-db51-4572-ae9b-fc4d8727f2f9 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9c2e25fe-bed7-47ac-bad9-255c25f77980.c9bcaec2-d62a-43d5-9b12-7b50b3e451b7 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:43 devstack sudo[107601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9c2e25fe-bed7-47ac-bad9-255c25f77980.c9bcaec2-d62a-43d5-9b12-7b50b3e451b7 Sep 04 18:11:43 devstack sudo[107601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:43 devstack sudo[107601]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-339b927e-db51-4572-ae9b-fc4d8727f2f9 tempest-ProjectMemberTests-488731474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9c2e25fe-bed7-47ac-bad9-255c25f77980.c9bcaec2-d62a-43d5-9b12-7b50b3e451b7" returned: 0 in 0.356s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:43 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-339b927e-db51-4572-ae9b-fc4d8727f2f9 tempest-ProjectMemberTests-488731474 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c2e25fe-bed7-47ac-bad9-255c25f77980(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 18:11:43 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f8ebf4-9342-4190-830a-9e2ec79e1e99]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:11:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-339b927e-db51-4572-ae9b-fc4d8727f2f9 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9c2e25fe-bed7-47ac-bad9-255c25f77980 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:43 devstack sudo[107606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9c2e25fe-bed7-47ac-bad9-255c25f77980 Sep 04 18:11:43 devstack sudo[107606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:44 devstack sudo[107606]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-339b927e-db51-4572-ae9b-fc4d8727f2f9 tempest-ProjectMemberTests-488731474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9c2e25fe-bed7-47ac-bad9-255c25f77980" returned: 0 in 0.373s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-339b927e-db51-4572-ae9b-fc4d8727f2f9 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9c2e25fe-bed7-47ac-bad9-255c25f77980.c9bcaec2-d62a-43d5-9b12-7b50b3e451b7 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:44 devstack sudo[107612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9c2e25fe-bed7-47ac-bad9-255c25f77980.c9bcaec2-d62a-43d5-9b12-7b50b3e451b7 Sep 04 18:11:44 devstack sudo[107612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:44 devstack sudo[107612]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-339b927e-db51-4572-ae9b-fc4d8727f2f9 tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9c2e25fe-bed7-47ac-bad9-255c25f77980.c9bcaec2-d62a-43d5-9b12-7b50b3e451b7" returned: 0 in 0.336s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-339b927e-db51-4572-ae9b-fc4d8727f2f9 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9c2e25fe-bed7-47ac-bad9-255c25f77980.c9bcaec2-d62a-43d5-9b12-7b50b3e451b7 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:44 devstack sudo[107617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9c2e25fe-bed7-47ac-bad9-255c25f77980.c9bcaec2-d62a-43d5-9b12-7b50b3e451b7 Sep 04 18:11:44 devstack sudo[107617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:44 devstack sudo[107617]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-339b927e-db51-4572-ae9b-fc4d8727f2f9 tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9c2e25fe-bed7-47ac-bad9-255c25f77980.c9bcaec2-d62a-43d5-9b12-7b50b3e451b7" returned: 0 in 0.235s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:44 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-339b927e-db51-4572-ae9b-fc4d8727f2f9 tempest-ProjectMemberTests-488731474 None] Lock "cinder-quobyte-c9bcaec2-d62a-43d5-9b12-7b50b3e451b7" released by "_delete_snapshot" :: held 1.412s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:11:44 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-339b927e-db51-4572-ae9b-fc4d8727f2f9 tempest-ProjectMemberTests-488731474 None] Lock "cinder-quobyte-9c2e25fe-bed7-47ac-bad9-255c25f77980" released by "delete_snapshot" :: held 1.437s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:11:44 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-339b927e-db51-4572-ae9b-fc4d8727f2f9 tempest-ProjectMemberTests-488731474 None] Created reservations ['eb7f2e3e-bf70-42f1-b244-3f4a2d64699b', '67e25ef7-6420-47f8-8423-005ecfde0948', 'ccb933e8-46b3-4574-b0fa-ff5bab08420d', '7fb4cfec-9dba-4b70-abf8-7d505fc1d194'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:11:45 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-339b927e-db51-4572-ae9b-fc4d8727f2f9 tempest-ProjectMemberTests-488731474 None] Delete snapshot completed successfully. Sep 04 18:11:45 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-339b927e-db51-4572-ae9b-fc4d8727f2f9 tempest-ProjectMemberTests-488731474 None] Lock "cinder-c9bcaec2-d62a-43d5-9b12-7b50b3e451b7-delete_snapshot" released by "delete_snapshot" :: held 1.594s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:11:45 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a1d9b6fb-1740-404f-a872-a3352cb8a1c2 tempest-ProjectMemberTests-488731474 None] Acquiring lock "cinder-9c2e25fe-bed7-47ac-bad9-255c25f77980-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:11:45 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a1d9b6fb-1740-404f-a872-a3352cb8a1c2 tempest-ProjectMemberTests-488731474 None] Lock "cinder-9c2e25fe-bed7-47ac-bad9-255c25f77980-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:11:45 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a1d9b6fb-1740-404f-a872-a3352cb8a1c2 tempest-ProjectMemberTests-488731474 None] Acquiring lock "cinder-quobyte-9c2e25fe-bed7-47ac-bad9-255c25f77980" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:11:45 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a1d9b6fb-1740-404f-a872-a3352cb8a1c2 tempest-ProjectMemberTests-488731474 None] Lock "cinder-quobyte-9c2e25fe-bed7-47ac-bad9-255c25f77980" acquired by "delete_volume" :: waited 0.016s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:11:45 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be51506-65e1-4100-bf98-8825f2693015]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:11:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a1d9b6fb-1740-404f-a872-a3352cb8a1c2 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9c2e25fe-bed7-47ac-bad9-255c25f77980 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:45 devstack sudo[107620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9c2e25fe-bed7-47ac-bad9-255c25f77980 Sep 04 18:11:45 devstack sudo[107620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:46 devstack sudo[107620]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a1d9b6fb-1740-404f-a872-a3352cb8a1c2 tempest-ProjectMemberTests-488731474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9c2e25fe-bed7-47ac-bad9-255c25f77980" returned: 0 in 0.394s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a1d9b6fb-1740-404f-a872-a3352cb8a1c2 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9c2e25fe-bed7-47ac-bad9-255c25f77980 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:46 devstack sudo[107626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9c2e25fe-bed7-47ac-bad9-255c25f77980 Sep 04 18:11:46 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:46 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a1d9b6fb-1740-404f-a872-a3352cb8a1c2 tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9c2e25fe-bed7-47ac-bad9-255c25f77980" returned: 0 in 0.282s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:46 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a1d9b6fb-1740-404f-a872-a3352cb8a1c2 tempest-ProjectMemberTests-488731474 None] Lock "cinder-quobyte-9c2e25fe-bed7-47ac-bad9-255c25f77980" released by "delete_volume" :: held 0.740s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:11:46 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-a1d9b6fb-1740-404f-a872-a3352cb8a1c2 tempest-ProjectMemberTests-488731474 None] Created reservations ['0a690819-127c-4df8-89cf-5ff2d4323f76', '1e0ed456-d3fe-4e09-b3b3-01cf592f830e', '1e5f21ee-5a52-4519-9eff-e131534999c5', '24fbab69-3ca4-4f49-bec7-5fcc8c0a9ed9'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:11:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a1d9b6fb-1740-404f-a872-a3352cb8a1c2 tempest-ProjectMemberTests-488731474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:11:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a1d9b6fb-1740-404f-a872-a3352cb8a1c2 tempest-ProjectMemberTests-488731474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:11:46 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a1d9b6fb-1740-404f-a872-a3352cb8a1c2 tempest-ProjectMemberTests-488731474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:11:46 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a1d9b6fb-1740-404f-a872-a3352cb8a1c2 tempest-ProjectMemberTests-488731474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:11:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a1d9b6fb-1740-404f-a872-a3352cb8a1c2 tempest-ProjectMemberTests-488731474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:11:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a1d9b6fb-1740-404f-a872-a3352cb8a1c2 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:46 devstack sudo[107629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:11:46 devstack sudo[107629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:46 devstack sudo[107629]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a1d9b6fb-1740-404f-a872-a3352cb8a1c2 tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.276s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:46 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-a1d9b6fb-1740-404f-a872-a3352cb8a1c2 tempest-ProjectMemberTests-488731474 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:11:46 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-a1d9b6fb-1740-404f-a872-a3352cb8a1c2 tempest-ProjectMemberTests-488731474 None] Deleted volume successfully. Sep 04 18:11:46 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a1d9b6fb-1740-404f-a872-a3352cb8a1c2 tempest-ProjectMemberTests-488731474 None] Lock "cinder-9c2e25fe-bed7-47ac-bad9-255c25f77980-delete_volume" released by "delete_volume" :: held 1.228s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:11:47 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5699a72-e3b7-4f5e-b229-1647438b0a00 tempest-ProjectMemberTests-488731474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:11:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a5699a72-e3b7-4f5e-b229-1647438b0a00 tempest-ProjectMemberTests-488731474 None] Flow 'volume_create_manager' (c765f49a-f756-4a4b-bde0-a22058edfd20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:11:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a5699a72-e3b7-4f5e-b229-1647438b0a00 tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40d961ef-abda-4443-b17f-2ae29ae2799d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:11:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a5699a72-e3b7-4f5e-b229-1647438b0a00 tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40d961ef-abda-4443-b17f-2ae29ae2799d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1217914567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4aeb05b-5955-4bb1-8754-e22521b2ede3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b5af8d2d70740348028c34578cb1393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:11:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:11:47Z,use_quota=True,user_id='21f3365c7a9a490387324872cde069aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:11:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a5699a72-e3b7-4f5e-b229-1647438b0a00 tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (670c5505-3323-41f1-b681-c0d17af127d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:11:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a5699a72-e3b7-4f5e-b229-1647438b0a00 tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (670c5505-3323-41f1-b681-c0d17af127d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:11:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a5699a72-e3b7-4f5e-b229-1647438b0a00 tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc1a0308-c7fe-4404-974b-9468c8e0d83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:11:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a5699a72-e3b7-4f5e-b229-1647438b0a00 tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc1a0308-c7fe-4404-974b-9468c8e0d83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4aeb05b-5955-4bb1-8754-e22521b2ede3', 'volume_name': 'volume-a4aeb05b-5955-4bb1-8754-e22521b2ede3', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:11:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a5699a72-e3b7-4f5e-b229-1647438b0a00 tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4db86fcf-7b25-455e-a56e-522b3a7506a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:11:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a5699a72-e3b7-4f5e-b229-1647438b0a00 tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4db86fcf-7b25-455e-a56e-522b3a7506a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:11:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a5699a72-e3b7-4f5e-b229-1647438b0a00 tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5c56cc5-13de-4cb9-bbef-d3134363e7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:11:47 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-a5699a72-e3b7-4f5e-b229-1647438b0a00 tempest-ProjectMemberTests-488731474 None] Volume a4aeb05b-5955-4bb1-8754-e22521b2ede3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4aeb05b-5955-4bb1-8754-e22521b2ede3', 'volume_size': 1} Sep 04 18:11:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a5699a72-e3b7-4f5e-b229-1647438b0a00 tempest-ProjectMemberTests-488731474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:11:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a5699a72-e3b7-4f5e-b229-1647438b0a00 tempest-ProjectMemberTests-488731474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:11:47 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a5699a72-e3b7-4f5e-b229-1647438b0a00 tempest-ProjectMemberTests-488731474 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1217914567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4aeb05b-5955-4bb1-8754-e22521b2ede3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b5af8d2d70740348028c34578cb1393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:11:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:11:47Z,use_quota=True,user_id='21f3365c7a9a490387324872cde069aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:11:47 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-a5699a72-e3b7-4f5e-b229-1647438b0a00 tempest-ProjectMemberTests-488731474 None] Creating volume a4aeb05b-5955-4bb1-8754-e22521b2ede3 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:11:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a5699a72-e3b7-4f5e-b229-1647438b0a00 tempest-ProjectMemberTests-488731474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:11:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a5699a72-e3b7-4f5e-b229-1647438b0a00 tempest-ProjectMemberTests-488731474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:11:47 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a5699a72-e3b7-4f5e-b229-1647438b0a00 tempest-ProjectMemberTests-488731474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:11:47 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a5699a72-e3b7-4f5e-b229-1647438b0a00 tempest-ProjectMemberTests-488731474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:11:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a5699a72-e3b7-4f5e-b229-1647438b0a00 tempest-ProjectMemberTests-488731474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:11:47 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a5699a72-e3b7-4f5e-b229-1647438b0a00 tempest-ProjectMemberTests-488731474 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:11:47 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-a5699a72-e3b7-4f5e-b229-1647438b0a00 tempest-ProjectMemberTests-488731474 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:11:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a5699a72-e3b7-4f5e-b229-1647438b0a00 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a4aeb05b-5955-4bb1-8754-e22521b2ede3 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:47 devstack sudo[107632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a4aeb05b-5955-4bb1-8754-e22521b2ede3 1073741824 Sep 04 18:11:47 devstack sudo[107632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:47 devstack sudo[107632]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a5699a72-e3b7-4f5e-b229-1647438b0a00 tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a4aeb05b-5955-4bb1-8754-e22521b2ede3 1073741824" returned: 0 in 0.461s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a5699a72-e3b7-4f5e-b229-1647438b0a00 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a4aeb05b-5955-4bb1-8754-e22521b2ede3 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:47 devstack sudo[107637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a4aeb05b-5955-4bb1-8754-e22521b2ede3 Sep 04 18:11:47 devstack sudo[107637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:48 devstack sudo[107637]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a5699a72-e3b7-4f5e-b229-1647438b0a00 tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a4aeb05b-5955-4bb1-8754-e22521b2ede3" returned: 0 in 0.249s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:48 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a5699a72-e3b7-4f5e-b229-1647438b0a00 tempest-ProjectMemberTests-488731474 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:11:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a5699a72-e3b7-4f5e-b229-1647438b0a00 tempest-ProjectMemberTests-488731474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:11:48 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a5699a72-e3b7-4f5e-b229-1647438b0a00 tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5c56cc5-13de-4cb9-bbef-d3134363e7a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4aeb05b-5955-4bb1-8754-e22521b2ede3', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:11:48 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a5699a72-e3b7-4f5e-b229-1647438b0a00 tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cebd1660-17d5-41be-b10b-86ea5bcb8545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:11:48 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-a5699a72-e3b7-4f5e-b229-1647438b0a00 tempest-ProjectMemberTests-488731474 None] Volume volume-a4aeb05b-5955-4bb1-8754-e22521b2ede3 (a4aeb05b-5955-4bb1-8754-e22521b2ede3): created successfully Sep 04 18:11:48 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a5699a72-e3b7-4f5e-b229-1647438b0a00 tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cebd1660-17d5-41be-b10b-86ea5bcb8545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:11:48 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a5699a72-e3b7-4f5e-b229-1647438b0a00 tempest-ProjectMemberTests-488731474 None] Flow 'volume_create_manager' (c765f49a-f756-4a4b-bde0-a22058edfd20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:11:48 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-a5699a72-e3b7-4f5e-b229-1647438b0a00 tempest-ProjectMemberTests-488731474 None] Created volume successfully. Sep 04 18:11:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-318989f2-2cd1-4ebe-ae6f-29b7c44f23a1 tempest-ProjectMemberTests-488731474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:11:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-318989f2-2cd1-4ebe-ae6f-29b7c44f23a1 tempest-ProjectMemberTests-488731474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:11:48 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-318989f2-2cd1-4ebe-ae6f-29b7c44f23a1 tempest-ProjectMemberTests-488731474 None] Creating offline snapshot 3fd97028-5d0d-44cc-9936-08eeff5dfcdb of volume a4aeb05b-5955-4bb1-8754-e22521b2ede3 {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 18:11:48 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a02a912-b508-407b-a690-eb61f0ad0cf2]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:11:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-318989f2-2cd1-4ebe-ae6f-29b7c44f23a1 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a4aeb05b-5955-4bb1-8754-e22521b2ede3 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:48 devstack sudo[107640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a4aeb05b-5955-4bb1-8754-e22521b2ede3 Sep 04 18:11:48 devstack sudo[107640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:48 devstack sudo[107640]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-318989f2-2cd1-4ebe-ae6f-29b7c44f23a1 tempest-ProjectMemberTests-488731474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a4aeb05b-5955-4bb1-8754-e22521b2ede3" returned: 0 in 0.332s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-318989f2-2cd1-4ebe-ae6f-29b7c44f23a1 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a4aeb05b-5955-4bb1-8754-e22521b2ede3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a4aeb05b-5955-4bb1-8754-e22521b2ede3.3fd97028-5d0d-44cc-9936-08eeff5dfcdb 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:48 devstack sudo[107645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a4aeb05b-5955-4bb1-8754-e22521b2ede3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a4aeb05b-5955-4bb1-8754-e22521b2ede3.3fd97028-5d0d-44cc-9936-08eeff5dfcdb 1G Sep 04 18:11:48 devstack sudo[107645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:49 devstack sudo[107645]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-318989f2-2cd1-4ebe-ae6f-29b7c44f23a1 tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a4aeb05b-5955-4bb1-8754-e22521b2ede3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a4aeb05b-5955-4bb1-8754-e22521b2ede3.3fd97028-5d0d-44cc-9936-08eeff5dfcdb 1G" returned: 0 in 0.379s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-318989f2-2cd1-4ebe-ae6f-29b7c44f23a1 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4aeb05b-5955-4bb1-8754-e22521b2ede3 -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a4aeb05b-5955-4bb1-8754-e22521b2ede3.3fd97028-5d0d-44cc-9936-08eeff5dfcdb {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:49 devstack sudo[107650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4aeb05b-5955-4bb1-8754-e22521b2ede3 -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a4aeb05b-5955-4bb1-8754-e22521b2ede3.3fd97028-5d0d-44cc-9936-08eeff5dfcdb Sep 04 18:11:49 devstack sudo[107650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:49 devstack sudo[107650]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-318989f2-2cd1-4ebe-ae6f-29b7c44f23a1 tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4aeb05b-5955-4bb1-8754-e22521b2ede3 -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a4aeb05b-5955-4bb1-8754-e22521b2ede3.3fd97028-5d0d-44cc-9936-08eeff5dfcdb" returned: 0 in 0.277s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:49 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-318989f2-2cd1-4ebe-ae6f-29b7c44f23a1 tempest-ProjectMemberTests-488731474 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a4aeb05b-5955-4bb1-8754-e22521b2ede3.3fd97028-5d0d-44cc-9936-08eeff5dfcdb is being set with open permissions: ugo+rw Sep 04 18:11:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-318989f2-2cd1-4ebe-ae6f-29b7c44f23a1 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a4aeb05b-5955-4bb1-8754-e22521b2ede3.3fd97028-5d0d-44cc-9936-08eeff5dfcdb {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:49 devstack sudo[107655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a4aeb05b-5955-4bb1-8754-e22521b2ede3.3fd97028-5d0d-44cc-9936-08eeff5dfcdb Sep 04 18:11:49 devstack sudo[107655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:49 devstack sudo[107655]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-318989f2-2cd1-4ebe-ae6f-29b7c44f23a1 tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a4aeb05b-5955-4bb1-8754-e22521b2ede3.3fd97028-5d0d-44cc-9936-08eeff5dfcdb" returned: 0 in 0.231s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-318989f2-2cd1-4ebe-ae6f-29b7c44f23a1 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a4aeb05b-5955-4bb1-8754-e22521b2ede3.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:49 devstack sudo[107658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a4aeb05b-5955-4bb1-8754-e22521b2ede3.info Sep 04 18:11:49 devstack sudo[107658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:50 devstack sudo[107658]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-318989f2-2cd1-4ebe-ae6f-29b7c44f23a1 tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a4aeb05b-5955-4bb1-8754-e22521b2ede3.info" returned: 0 in 0.236s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:50 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-318989f2-2cd1-4ebe-ae6f-29b7c44f23a1 tempest-ProjectMemberTests-488731474 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a4aeb05b-5955-4bb1-8754-e22521b2ede3.info is being set with open permissions: ugo+rw Sep 04 18:11:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-318989f2-2cd1-4ebe-ae6f-29b7c44f23a1 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a4aeb05b-5955-4bb1-8754-e22521b2ede3.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:50 devstack sudo[107664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a4aeb05b-5955-4bb1-8754-e22521b2ede3.info Sep 04 18:11:50 devstack sudo[107664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:50 devstack sudo[107664]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-318989f2-2cd1-4ebe-ae6f-29b7c44f23a1 tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a4aeb05b-5955-4bb1-8754-e22521b2ede3.info" returned: 0 in 0.243s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-318989f2-2cd1-4ebe-ae6f-29b7c44f23a1 tempest-ProjectMemberTests-488731474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.773s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:11:50 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-318989f2-2cd1-4ebe-ae6f-29b7c44f23a1 tempest-ProjectMemberTests-488731474 None] Create snapshot completed successfully Sep 04 18:11:50 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-32ecb6fa-5caa-4974-b461-4260fc6eba65 tempest-ProjectMemberTests-488731474 None] Acquiring lock "cinder-3fd97028-5d0d-44cc-9936-08eeff5dfcdb-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:11:50 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-32ecb6fa-5caa-4974-b461-4260fc6eba65 tempest-ProjectMemberTests-488731474 None] Lock "cinder-3fd97028-5d0d-44cc-9936-08eeff5dfcdb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:11:50 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-32ecb6fa-5caa-4974-b461-4260fc6eba65 tempest-ProjectMemberTests-488731474 None] Acquiring lock "cinder-quobyte-a4aeb05b-5955-4bb1-8754-e22521b2ede3" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:11:50 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-32ecb6fa-5caa-4974-b461-4260fc6eba65 tempest-ProjectMemberTests-488731474 None] Lock "cinder-quobyte-a4aeb05b-5955-4bb1-8754-e22521b2ede3" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:11:50 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-32ecb6fa-5caa-4974-b461-4260fc6eba65 tempest-ProjectMemberTests-488731474 None] Acquiring lock "cinder-quobyte-3fd97028-5d0d-44cc-9936-08eeff5dfcdb" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:11:50 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-32ecb6fa-5caa-4974-b461-4260fc6eba65 tempest-ProjectMemberTests-488731474 None] Lock "cinder-quobyte-3fd97028-5d0d-44cc-9936-08eeff5dfcdb" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:11:50 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-32ecb6fa-5caa-4974-b461-4260fc6eba65 tempest-ProjectMemberTests-488731474 None] Deleting offline snapshot 3fd97028-5d0d-44cc-9936-08eeff5dfcdb of volume a4aeb05b-5955-4bb1-8754-e22521b2ede3 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 18:11:50 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-32ecb6fa-5caa-4974-b461-4260fc6eba65 tempest-ProjectMemberTests-488731474 None] snapshot_file for this snap is: volume-a4aeb05b-5955-4bb1-8754-e22521b2ede3.3fd97028-5d0d-44cc-9936-08eeff5dfcdb {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 18:11:50 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f0daa67-8df5-4389-8bc7-cb8b3f7923e2]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:11:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-32ecb6fa-5caa-4974-b461-4260fc6eba65 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a4aeb05b-5955-4bb1-8754-e22521b2ede3.3fd97028-5d0d-44cc-9936-08eeff5dfcdb {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:50 devstack sudo[107700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a4aeb05b-5955-4bb1-8754-e22521b2ede3.3fd97028-5d0d-44cc-9936-08eeff5dfcdb Sep 04 18:11:50 devstack sudo[107700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:51 devstack sudo[107700]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-32ecb6fa-5caa-4974-b461-4260fc6eba65 tempest-ProjectMemberTests-488731474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a4aeb05b-5955-4bb1-8754-e22521b2ede3.3fd97028-5d0d-44cc-9936-08eeff5dfcdb" returned: 0 in 0.361s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:51 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-32ecb6fa-5caa-4974-b461-4260fc6eba65 tempest-ProjectMemberTests-488731474 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4aeb05b-5955-4bb1-8754-e22521b2ede3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 18:11:51 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f885f3-6894-4728-85c6-07a0085edfa4]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:11:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-32ecb6fa-5caa-4974-b461-4260fc6eba65 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a4aeb05b-5955-4bb1-8754-e22521b2ede3 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:51 devstack sudo[107705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a4aeb05b-5955-4bb1-8754-e22521b2ede3 Sep 04 18:11:51 devstack sudo[107705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:51 devstack sudo[107705]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-32ecb6fa-5caa-4974-b461-4260fc6eba65 tempest-ProjectMemberTests-488731474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a4aeb05b-5955-4bb1-8754-e22521b2ede3" returned: 0 in 0.357s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-32ecb6fa-5caa-4974-b461-4260fc6eba65 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a4aeb05b-5955-4bb1-8754-e22521b2ede3.3fd97028-5d0d-44cc-9936-08eeff5dfcdb {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:51 devstack sudo[107710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a4aeb05b-5955-4bb1-8754-e22521b2ede3.3fd97028-5d0d-44cc-9936-08eeff5dfcdb Sep 04 18:11:51 devstack sudo[107710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:51 devstack sudo[107710]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-32ecb6fa-5caa-4974-b461-4260fc6eba65 tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a4aeb05b-5955-4bb1-8754-e22521b2ede3.3fd97028-5d0d-44cc-9936-08eeff5dfcdb" returned: 0 in 0.330s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-32ecb6fa-5caa-4974-b461-4260fc6eba65 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a4aeb05b-5955-4bb1-8754-e22521b2ede3.3fd97028-5d0d-44cc-9936-08eeff5dfcdb {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:51 devstack sudo[107715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a4aeb05b-5955-4bb1-8754-e22521b2ede3.3fd97028-5d0d-44cc-9936-08eeff5dfcdb Sep 04 18:11:51 devstack sudo[107715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:52 devstack sudo[107715]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-32ecb6fa-5caa-4974-b461-4260fc6eba65 tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a4aeb05b-5955-4bb1-8754-e22521b2ede3.3fd97028-5d0d-44cc-9936-08eeff5dfcdb" returned: 0 in 0.252s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-32ecb6fa-5caa-4974-b461-4260fc6eba65 tempest-ProjectMemberTests-488731474 None] Lock "cinder-quobyte-3fd97028-5d0d-44cc-9936-08eeff5dfcdb" released by "_delete_snapshot" :: held 1.384s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:11:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-32ecb6fa-5caa-4974-b461-4260fc6eba65 tempest-ProjectMemberTests-488731474 None] Lock "cinder-quobyte-a4aeb05b-5955-4bb1-8754-e22521b2ede3" released by "delete_snapshot" :: held 1.406s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:11:52 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-32ecb6fa-5caa-4974-b461-4260fc6eba65 tempest-ProjectMemberTests-488731474 None] Created reservations ['b8bd591d-4f4e-440f-8683-79fb432f4475', '7a53ae56-4812-4780-9317-4ac1fc08ddb2', '387e0838-efb9-4ef6-8b1d-c68879fc764e', '8ed0bed2-befe-4303-aeca-9da55c47436d'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:11:52 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-32ecb6fa-5caa-4974-b461-4260fc6eba65 tempest-ProjectMemberTests-488731474 None] Delete snapshot completed successfully. Sep 04 18:11:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-32ecb6fa-5caa-4974-b461-4260fc6eba65 tempest-ProjectMemberTests-488731474 None] Lock "cinder-3fd97028-5d0d-44cc-9936-08eeff5dfcdb-delete_snapshot" released by "delete_snapshot" :: held 1.543s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:11:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0f9ed9e2-3b9a-42f8-9b8d-dfa7d88aaf62 tempest-ProjectMemberTests-488731474 None] Acquiring lock "cinder-a4aeb05b-5955-4bb1-8754-e22521b2ede3-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:11:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0f9ed9e2-3b9a-42f8-9b8d-dfa7d88aaf62 tempest-ProjectMemberTests-488731474 None] Lock "cinder-a4aeb05b-5955-4bb1-8754-e22521b2ede3-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:11:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0f9ed9e2-3b9a-42f8-9b8d-dfa7d88aaf62 tempest-ProjectMemberTests-488731474 None] Acquiring lock "cinder-quobyte-a4aeb05b-5955-4bb1-8754-e22521b2ede3" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:11:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0f9ed9e2-3b9a-42f8-9b8d-dfa7d88aaf62 tempest-ProjectMemberTests-488731474 None] Lock "cinder-quobyte-a4aeb05b-5955-4bb1-8754-e22521b2ede3" acquired by "delete_volume" :: waited 0.015s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:11:52 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7e97a4-204b-4a61-bcb8-0b16d3c226cd]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:11:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0f9ed9e2-3b9a-42f8-9b8d-dfa7d88aaf62 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a4aeb05b-5955-4bb1-8754-e22521b2ede3 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:52 devstack sudo[107718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a4aeb05b-5955-4bb1-8754-e22521b2ede3 Sep 04 18:11:52 devstack sudo[107718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:53 devstack sudo[107718]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0f9ed9e2-3b9a-42f8-9b8d-dfa7d88aaf62 tempest-ProjectMemberTests-488731474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a4aeb05b-5955-4bb1-8754-e22521b2ede3" returned: 0 in 0.345s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0f9ed9e2-3b9a-42f8-9b8d-dfa7d88aaf62 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a4aeb05b-5955-4bb1-8754-e22521b2ede3 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:53 devstack sudo[107723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a4aeb05b-5955-4bb1-8754-e22521b2ede3 Sep 04 18:11:53 devstack sudo[107723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:53 devstack sudo[107723]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0f9ed9e2-3b9a-42f8-9b8d-dfa7d88aaf62 tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a4aeb05b-5955-4bb1-8754-e22521b2ede3" returned: 0 in 0.239s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:53 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0f9ed9e2-3b9a-42f8-9b8d-dfa7d88aaf62 tempest-ProjectMemberTests-488731474 None] Lock "cinder-quobyte-a4aeb05b-5955-4bb1-8754-e22521b2ede3" released by "delete_volume" :: held 0.640s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:11:53 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-0f9ed9e2-3b9a-42f8-9b8d-dfa7d88aaf62 tempest-ProjectMemberTests-488731474 None] Created reservations ['cfeebaef-952d-4d7b-abca-70afdb465857', '566c4480-6802-42ea-8060-15625b89afa4', 'a2a09d09-66de-4b65-8dae-e767660436bc', '5e39eb74-c878-4b0c-aba7-dc4a3f1f14b0'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:11:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0f9ed9e2-3b9a-42f8-9b8d-dfa7d88aaf62 tempest-ProjectMemberTests-488731474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:11:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0f9ed9e2-3b9a-42f8-9b8d-dfa7d88aaf62 tempest-ProjectMemberTests-488731474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:11:53 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0f9ed9e2-3b9a-42f8-9b8d-dfa7d88aaf62 tempest-ProjectMemberTests-488731474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:11:53 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-0f9ed9e2-3b9a-42f8-9b8d-dfa7d88aaf62 tempest-ProjectMemberTests-488731474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:11:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-0f9ed9e2-3b9a-42f8-9b8d-dfa7d88aaf62 tempest-ProjectMemberTests-488731474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:11:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0f9ed9e2-3b9a-42f8-9b8d-dfa7d88aaf62 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:53 devstack sudo[107726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:11:53 devstack sudo[107726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:53 devstack sudo[107726]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-0f9ed9e2-3b9a-42f8-9b8d-dfa7d88aaf62 tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.238s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:53 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-0f9ed9e2-3b9a-42f8-9b8d-dfa7d88aaf62 tempest-ProjectMemberTests-488731474 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:11:53 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-0f9ed9e2-3b9a-42f8-9b8d-dfa7d88aaf62 tempest-ProjectMemberTests-488731474 None] Deleted volume successfully. Sep 04 18:11:53 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-0f9ed9e2-3b9a-42f8-9b8d-dfa7d88aaf62 tempest-ProjectMemberTests-488731474 None] Lock "cinder-a4aeb05b-5955-4bb1-8754-e22521b2ede3-delete_volume" released by "delete_volume" :: held 1.082s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:11:54 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd93a787-75ad-4d77-8772-647f204fc266 tempest-ProjectMemberTests-488731474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:11:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bd93a787-75ad-4d77-8772-647f204fc266 tempest-ProjectMemberTests-488731474 None] Flow 'volume_create_manager' (95d99f9f-49db-4d19-835b-0700a26901d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:11:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bd93a787-75ad-4d77-8772-647f204fc266 tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f3f2f04-edee-4975-93e7-a2bad7677b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:11:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bd93a787-75ad-4d77-8772-647f204fc266 tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f3f2f04-edee-4975-93e7-a2bad7677b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:11:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1910565311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9f27ee6-a626-4fec-bfab-64c0c88c03d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b5af8d2d70740348028c34578cb1393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:11:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:11:54Z,use_quota=True,user_id='21f3365c7a9a490387324872cde069aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:11:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bd93a787-75ad-4d77-8772-647f204fc266 tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5f2675e-48b0-49d7-8f08-66eda309b841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:11:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bd93a787-75ad-4d77-8772-647f204fc266 tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5f2675e-48b0-49d7-8f08-66eda309b841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:11:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bd93a787-75ad-4d77-8772-647f204fc266 tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaa690b9-825a-4b1c-91d1-a988927e34c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:11:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bd93a787-75ad-4d77-8772-647f204fc266 tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaa690b9-825a-4b1c-91d1-a988927e34c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9f27ee6-a626-4fec-bfab-64c0c88c03d3', 'volume_name': 'volume-d9f27ee6-a626-4fec-bfab-64c0c88c03d3', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:11:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bd93a787-75ad-4d77-8772-647f204fc266 tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4959b1d-b9f0-4786-a605-4f7a396ddd89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:11:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bd93a787-75ad-4d77-8772-647f204fc266 tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4959b1d-b9f0-4786-a605-4f7a396ddd89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:11:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bd93a787-75ad-4d77-8772-647f204fc266 tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (328c84b7-89ea-4a08-a728-d144f7bb6d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:11:54 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-bd93a787-75ad-4d77-8772-647f204fc266 tempest-ProjectMemberTests-488731474 None] Volume d9f27ee6-a626-4fec-bfab-64c0c88c03d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9f27ee6-a626-4fec-bfab-64c0c88c03d3', 'volume_size': 1} Sep 04 18:11:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bd93a787-75ad-4d77-8772-647f204fc266 tempest-ProjectMemberTests-488731474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:11:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bd93a787-75ad-4d77-8772-647f204fc266 tempest-ProjectMemberTests-488731474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:11:54 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-bd93a787-75ad-4d77-8772-647f204fc266 tempest-ProjectMemberTests-488731474 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:11:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1910565311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9f27ee6-a626-4fec-bfab-64c0c88c03d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b5af8d2d70740348028c34578cb1393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:11:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:11:54Z,use_quota=True,user_id='21f3365c7a9a490387324872cde069aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:11:54 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-bd93a787-75ad-4d77-8772-647f204fc266 tempest-ProjectMemberTests-488731474 None] Creating volume d9f27ee6-a626-4fec-bfab-64c0c88c03d3 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:11:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bd93a787-75ad-4d77-8772-647f204fc266 tempest-ProjectMemberTests-488731474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:11:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bd93a787-75ad-4d77-8772-647f204fc266 tempest-ProjectMemberTests-488731474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:11:54 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-bd93a787-75ad-4d77-8772-647f204fc266 tempest-ProjectMemberTests-488731474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:11:54 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-bd93a787-75ad-4d77-8772-647f204fc266 tempest-ProjectMemberTests-488731474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:11:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bd93a787-75ad-4d77-8772-647f204fc266 tempest-ProjectMemberTests-488731474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:11:54 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-bd93a787-75ad-4d77-8772-647f204fc266 tempest-ProjectMemberTests-488731474 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:11:54 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-bd93a787-75ad-4d77-8772-647f204fc266 tempest-ProjectMemberTests-488731474 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:11:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bd93a787-75ad-4d77-8772-647f204fc266 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d9f27ee6-a626-4fec-bfab-64c0c88c03d3 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:54 devstack sudo[107730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d9f27ee6-a626-4fec-bfab-64c0c88c03d3 1073741824 Sep 04 18:11:54 devstack sudo[107730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:54 devstack sudo[107730]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bd93a787-75ad-4d77-8772-647f204fc266 tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d9f27ee6-a626-4fec-bfab-64c0c88c03d3 1073741824" returned: 0 in 0.391s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bd93a787-75ad-4d77-8772-647f204fc266 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d9f27ee6-a626-4fec-bfab-64c0c88c03d3 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:54 devstack sudo[107735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d9f27ee6-a626-4fec-bfab-64c0c88c03d3 Sep 04 18:11:54 devstack sudo[107735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:55 devstack sudo[107735]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-bd93a787-75ad-4d77-8772-647f204fc266 tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d9f27ee6-a626-4fec-bfab-64c0c88c03d3" returned: 0 in 0.232s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:55 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-bd93a787-75ad-4d77-8772-647f204fc266 tempest-ProjectMemberTests-488731474 None] <== create_volume: return (667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:11:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-bd93a787-75ad-4d77-8772-647f204fc266 tempest-ProjectMemberTests-488731474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.669s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:11:55 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bd93a787-75ad-4d77-8772-647f204fc266 tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (328c84b7-89ea-4a08-a728-d144f7bb6d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9f27ee6-a626-4fec-bfab-64c0c88c03d3', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:11:55 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bd93a787-75ad-4d77-8772-647f204fc266 tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a816bd10-8bb6-49d8-9514-26804bd1f01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:11:55 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-bd93a787-75ad-4d77-8772-647f204fc266 tempest-ProjectMemberTests-488731474 None] Volume volume-d9f27ee6-a626-4fec-bfab-64c0c88c03d3 (d9f27ee6-a626-4fec-bfab-64c0c88c03d3): created successfully Sep 04 18:11:55 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bd93a787-75ad-4d77-8772-647f204fc266 tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a816bd10-8bb6-49d8-9514-26804bd1f01a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:11:55 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-bd93a787-75ad-4d77-8772-647f204fc266 tempest-ProjectMemberTests-488731474 None] Flow 'volume_create_manager' (95d99f9f-49db-4d19-835b-0700a26901d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:11:55 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-bd93a787-75ad-4d77-8772-647f204fc266 tempest-ProjectMemberTests-488731474 None] Created volume successfully. Sep 04 18:11:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6a2c31b6-e157-4bc7-b32d-dfda42db75c5 tempest-ProjectMemberTests-488731474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:11:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6a2c31b6-e157-4bc7-b32d-dfda42db75c5 tempest-ProjectMemberTests-488731474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:11:55 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-6a2c31b6-e157-4bc7-b32d-dfda42db75c5 tempest-ProjectMemberTests-488731474 None] Creating offline snapshot 8d1cdc68-eca6-4995-9796-5a168192589d of volume d9f27ee6-a626-4fec-bfab-64c0c88c03d3 {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 18:11:55 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb498d8f-dae0-4f28-859c-ab82309c2fd0]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:11:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6a2c31b6-e157-4bc7-b32d-dfda42db75c5 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d9f27ee6-a626-4fec-bfab-64c0c88c03d3 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:55 devstack sudo[107738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d9f27ee6-a626-4fec-bfab-64c0c88c03d3 Sep 04 18:11:55 devstack sudo[107738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:55 devstack sudo[107738]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6a2c31b6-e157-4bc7-b32d-dfda42db75c5 tempest-ProjectMemberTests-488731474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d9f27ee6-a626-4fec-bfab-64c0c88c03d3" returned: 0 in 0.344s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6a2c31b6-e157-4bc7-b32d-dfda42db75c5 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d9f27ee6-a626-4fec-bfab-64c0c88c03d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d9f27ee6-a626-4fec-bfab-64c0c88c03d3.8d1cdc68-eca6-4995-9796-5a168192589d 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:55 devstack sudo[107743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d9f27ee6-a626-4fec-bfab-64c0c88c03d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d9f27ee6-a626-4fec-bfab-64c0c88c03d3.8d1cdc68-eca6-4995-9796-5a168192589d 1G Sep 04 18:11:55 devstack sudo[107743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:56 devstack sudo[107743]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6a2c31b6-e157-4bc7-b32d-dfda42db75c5 tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d9f27ee6-a626-4fec-bfab-64c0c88c03d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d9f27ee6-a626-4fec-bfab-64c0c88c03d3.8d1cdc68-eca6-4995-9796-5a168192589d 1G" returned: 0 in 0.394s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6a2c31b6-e157-4bc7-b32d-dfda42db75c5 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9f27ee6-a626-4fec-bfab-64c0c88c03d3 -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d9f27ee6-a626-4fec-bfab-64c0c88c03d3.8d1cdc68-eca6-4995-9796-5a168192589d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:56 devstack sudo[107748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9f27ee6-a626-4fec-bfab-64c0c88c03d3 -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d9f27ee6-a626-4fec-bfab-64c0c88c03d3.8d1cdc68-eca6-4995-9796-5a168192589d Sep 04 18:11:56 devstack sudo[107748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:56 devstack sudo[107748]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6a2c31b6-e157-4bc7-b32d-dfda42db75c5 tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9f27ee6-a626-4fec-bfab-64c0c88c03d3 -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d9f27ee6-a626-4fec-bfab-64c0c88c03d3.8d1cdc68-eca6-4995-9796-5a168192589d" returned: 0 in 0.296s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:56 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-6a2c31b6-e157-4bc7-b32d-dfda42db75c5 tempest-ProjectMemberTests-488731474 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d9f27ee6-a626-4fec-bfab-64c0c88c03d3.8d1cdc68-eca6-4995-9796-5a168192589d is being set with open permissions: ugo+rw Sep 04 18:11:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6a2c31b6-e157-4bc7-b32d-dfda42db75c5 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d9f27ee6-a626-4fec-bfab-64c0c88c03d3.8d1cdc68-eca6-4995-9796-5a168192589d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:56 devstack sudo[107754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d9f27ee6-a626-4fec-bfab-64c0c88c03d3.8d1cdc68-eca6-4995-9796-5a168192589d Sep 04 18:11:56 devstack sudo[107754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:56 devstack sudo[107754]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6a2c31b6-e157-4bc7-b32d-dfda42db75c5 tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d9f27ee6-a626-4fec-bfab-64c0c88c03d3.8d1cdc68-eca6-4995-9796-5a168192589d" returned: 0 in 0.233s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6a2c31b6-e157-4bc7-b32d-dfda42db75c5 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d9f27ee6-a626-4fec-bfab-64c0c88c03d3.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:56 devstack sudo[107757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d9f27ee6-a626-4fec-bfab-64c0c88c03d3.info Sep 04 18:11:56 devstack sudo[107757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:57 devstack sudo[107757]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6a2c31b6-e157-4bc7-b32d-dfda42db75c5 tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d9f27ee6-a626-4fec-bfab-64c0c88c03d3.info" returned: 0 in 0.233s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:57 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-6a2c31b6-e157-4bc7-b32d-dfda42db75c5 tempest-ProjectMemberTests-488731474 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d9f27ee6-a626-4fec-bfab-64c0c88c03d3.info is being set with open permissions: ugo+rw Sep 04 18:11:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6a2c31b6-e157-4bc7-b32d-dfda42db75c5 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d9f27ee6-a626-4fec-bfab-64c0c88c03d3.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:57 devstack sudo[107760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d9f27ee6-a626-4fec-bfab-64c0c88c03d3.info Sep 04 18:11:57 devstack sudo[107760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:57 devstack sudo[107760]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-6a2c31b6-e157-4bc7-b32d-dfda42db75c5 tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d9f27ee6-a626-4fec-bfab-64c0c88c03d3.info" returned: 0 in 0.249s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-6a2c31b6-e157-4bc7-b32d-dfda42db75c5 tempest-ProjectMemberTests-488731474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.831s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:11:57 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-6a2c31b6-e157-4bc7-b32d-dfda42db75c5 tempest-ProjectMemberTests-488731474 None] Create snapshot completed successfully Sep 04 18:11:57 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3d017d5f-feca-4143-bce1-3892f35bc3f4 tempest-ProjectMemberTests-488731474 None] Acquiring lock "cinder-8d1cdc68-eca6-4995-9796-5a168192589d-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:11:57 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3d017d5f-feca-4143-bce1-3892f35bc3f4 tempest-ProjectMemberTests-488731474 None] Lock "cinder-8d1cdc68-eca6-4995-9796-5a168192589d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:11:57 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3d017d5f-feca-4143-bce1-3892f35bc3f4 tempest-ProjectMemberTests-488731474 None] Acquiring lock "cinder-quobyte-d9f27ee6-a626-4fec-bfab-64c0c88c03d3" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:11:57 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3d017d5f-feca-4143-bce1-3892f35bc3f4 tempest-ProjectMemberTests-488731474 None] Lock "cinder-quobyte-d9f27ee6-a626-4fec-bfab-64c0c88c03d3" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:11:57 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3d017d5f-feca-4143-bce1-3892f35bc3f4 tempest-ProjectMemberTests-488731474 None] Acquiring lock "cinder-quobyte-8d1cdc68-eca6-4995-9796-5a168192589d" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:11:57 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3d017d5f-feca-4143-bce1-3892f35bc3f4 tempest-ProjectMemberTests-488731474 None] Lock "cinder-quobyte-8d1cdc68-eca6-4995-9796-5a168192589d" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:11:57 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-3d017d5f-feca-4143-bce1-3892f35bc3f4 tempest-ProjectMemberTests-488731474 None] Deleting offline snapshot 8d1cdc68-eca6-4995-9796-5a168192589d of volume d9f27ee6-a626-4fec-bfab-64c0c88c03d3 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 18:11:57 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-3d017d5f-feca-4143-bce1-3892f35bc3f4 tempest-ProjectMemberTests-488731474 None] snapshot_file for this snap is: volume-d9f27ee6-a626-4fec-bfab-64c0c88c03d3.8d1cdc68-eca6-4995-9796-5a168192589d {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 18:11:57 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8dfb4f8-ef30-428d-a2ae-0cbd91cb4d4e]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:11:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3d017d5f-feca-4143-bce1-3892f35bc3f4 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d9f27ee6-a626-4fec-bfab-64c0c88c03d3.8d1cdc68-eca6-4995-9796-5a168192589d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:57 devstack sudo[107764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d9f27ee6-a626-4fec-bfab-64c0c88c03d3.8d1cdc68-eca6-4995-9796-5a168192589d Sep 04 18:11:57 devstack sudo[107764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:58 devstack sudo[107764]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3d017d5f-feca-4143-bce1-3892f35bc3f4 tempest-ProjectMemberTests-488731474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d9f27ee6-a626-4fec-bfab-64c0c88c03d3.8d1cdc68-eca6-4995-9796-5a168192589d" returned: 0 in 0.353s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-3d017d5f-feca-4143-bce1-3892f35bc3f4 tempest-ProjectMemberTests-488731474 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9f27ee6-a626-4fec-bfab-64c0c88c03d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 18:11:58 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5c3c0d-04cc-41b3-abb3-0b07b874b84f]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:11:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3d017d5f-feca-4143-bce1-3892f35bc3f4 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d9f27ee6-a626-4fec-bfab-64c0c88c03d3 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:58 devstack sudo[107769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d9f27ee6-a626-4fec-bfab-64c0c88c03d3 Sep 04 18:11:58 devstack sudo[107769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:58 devstack sudo[107769]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3d017d5f-feca-4143-bce1-3892f35bc3f4 tempest-ProjectMemberTests-488731474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d9f27ee6-a626-4fec-bfab-64c0c88c03d3" returned: 0 in 0.353s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3d017d5f-feca-4143-bce1-3892f35bc3f4 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d9f27ee6-a626-4fec-bfab-64c0c88c03d3.8d1cdc68-eca6-4995-9796-5a168192589d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:58 devstack sudo[107774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d9f27ee6-a626-4fec-bfab-64c0c88c03d3.8d1cdc68-eca6-4995-9796-5a168192589d Sep 04 18:11:58 devstack sudo[107774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:58 devstack sudo[107774]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3d017d5f-feca-4143-bce1-3892f35bc3f4 tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d9f27ee6-a626-4fec-bfab-64c0c88c03d3.8d1cdc68-eca6-4995-9796-5a168192589d" returned: 0 in 0.341s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3d017d5f-feca-4143-bce1-3892f35bc3f4 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d9f27ee6-a626-4fec-bfab-64c0c88c03d3.8d1cdc68-eca6-4995-9796-5a168192589d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:11:58 devstack sudo[107780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d9f27ee6-a626-4fec-bfab-64c0c88c03d3.8d1cdc68-eca6-4995-9796-5a168192589d Sep 04 18:11:58 devstack sudo[107780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:11:59 devstack sudo[107780]: pam_unix(sudo:session): session closed for user root Sep 04 18:11:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3d017d5f-feca-4143-bce1-3892f35bc3f4 tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d9f27ee6-a626-4fec-bfab-64c0c88c03d3.8d1cdc68-eca6-4995-9796-5a168192589d" returned: 0 in 0.264s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:11:59 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3d017d5f-feca-4143-bce1-3892f35bc3f4 tempest-ProjectMemberTests-488731474 None] Lock "cinder-quobyte-8d1cdc68-eca6-4995-9796-5a168192589d" released by "_delete_snapshot" :: held 1.404s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:11:59 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3d017d5f-feca-4143-bce1-3892f35bc3f4 tempest-ProjectMemberTests-488731474 None] Lock "cinder-quobyte-d9f27ee6-a626-4fec-bfab-64c0c88c03d3" released by "delete_snapshot" :: held 1.427s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:11:59 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-3d017d5f-feca-4143-bce1-3892f35bc3f4 tempest-ProjectMemberTests-488731474 None] Created reservations ['df9bb39a-affa-4ccd-b1ca-7151b5a611be', 'd05ff049-804b-45f0-97c6-d164b3f25e94', '7eb8b6f0-ce83-4d30-ac4d-1c65033a0a33', 'bfa04db2-bb4c-4605-81a4-5ffcd21136d2'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:11:59 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-3d017d5f-feca-4143-bce1-3892f35bc3f4 tempest-ProjectMemberTests-488731474 None] Delete snapshot completed successfully. Sep 04 18:11:59 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3d017d5f-feca-4143-bce1-3892f35bc3f4 tempest-ProjectMemberTests-488731474 None] Lock "cinder-8d1cdc68-eca6-4995-9796-5a168192589d-delete_snapshot" released by "delete_snapshot" :: held 1.592s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:11:59 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-be3642f5-1460-401b-bbe4-fe70c01f496a tempest-ProjectMemberTests-488731474 None] Acquiring lock "cinder-d9f27ee6-a626-4fec-bfab-64c0c88c03d3-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:11:59 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-be3642f5-1460-401b-bbe4-fe70c01f496a tempest-ProjectMemberTests-488731474 None] Lock "cinder-d9f27ee6-a626-4fec-bfab-64c0c88c03d3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:11:59 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-be3642f5-1460-401b-bbe4-fe70c01f496a tempest-ProjectMemberTests-488731474 None] Acquiring lock "cinder-quobyte-d9f27ee6-a626-4fec-bfab-64c0c88c03d3" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:11:59 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-be3642f5-1460-401b-bbe4-fe70c01f496a tempest-ProjectMemberTests-488731474 None] Lock "cinder-quobyte-d9f27ee6-a626-4fec-bfab-64c0c88c03d3" acquired by "delete_volume" :: waited 0.019s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:11:59 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dedc339-908c-4b73-9be0-fe9debba3d75]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:11:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-be3642f5-1460-401b-bbe4-fe70c01f496a tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d9f27ee6-a626-4fec-bfab-64c0c88c03d3 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:00 devstack sudo[107783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d9f27ee6-a626-4fec-bfab-64c0c88c03d3 Sep 04 18:12:00 devstack sudo[107783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:00 devstack sudo[107783]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-be3642f5-1460-401b-bbe4-fe70c01f496a tempest-ProjectMemberTests-488731474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d9f27ee6-a626-4fec-bfab-64c0c88c03d3" returned: 0 in 0.358s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-be3642f5-1460-401b-bbe4-fe70c01f496a tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d9f27ee6-a626-4fec-bfab-64c0c88c03d3 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:00 devstack sudo[107789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d9f27ee6-a626-4fec-bfab-64c0c88c03d3 Sep 04 18:12:00 devstack sudo[107789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:00 devstack sudo[107789]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-be3642f5-1460-401b-bbe4-fe70c01f496a tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-d9f27ee6-a626-4fec-bfab-64c0c88c03d3" returned: 0 in 0.250s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:00 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-be3642f5-1460-401b-bbe4-fe70c01f496a tempest-ProjectMemberTests-488731474 None] Lock "cinder-quobyte-d9f27ee6-a626-4fec-bfab-64c0c88c03d3" released by "delete_volume" :: held 0.664s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:12:00 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=130,cinder:INSERT=49,cinder:UPDATE=163,cinder:DELETE=14 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 18:12:00 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=131,cinder:UPDATE=163,cinder:INSERT=36,cinder:DELETE=14 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 18:12:00 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-be3642f5-1460-401b-bbe4-fe70c01f496a tempest-ProjectMemberTests-488731474 None] Created reservations ['8b7be5d2-c3e3-478d-add2-5e4492676b53', '13bc91a4-19cc-4cdd-a569-13b87a12fe64', 'b4ebd156-d030-427f-8f9c-47c9a3eb86e2', '3df855ae-60f1-47b3-add7-8cf8061dcb3b'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:12:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-be3642f5-1460-401b-bbe4-fe70c01f496a tempest-ProjectMemberTests-488731474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:12:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-be3642f5-1460-401b-bbe4-fe70c01f496a tempest-ProjectMemberTests-488731474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:12:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-be3642f5-1460-401b-bbe4-fe70c01f496a tempest-ProjectMemberTests-488731474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:12:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-be3642f5-1460-401b-bbe4-fe70c01f496a tempest-ProjectMemberTests-488731474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:12:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-be3642f5-1460-401b-bbe4-fe70c01f496a tempest-ProjectMemberTests-488731474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:12:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-be3642f5-1460-401b-bbe4-fe70c01f496a tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:00 devstack sudo[107792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:12:00 devstack sudo[107792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:00 devstack sudo[107792]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-be3642f5-1460-401b-bbe4-fe70c01f496a tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.262s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:00 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-be3642f5-1460-401b-bbe4-fe70c01f496a tempest-ProjectMemberTests-488731474 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:12:01 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-be3642f5-1460-401b-bbe4-fe70c01f496a tempest-ProjectMemberTests-488731474 None] Deleted volume successfully. Sep 04 18:12:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-be3642f5-1460-401b-bbe4-fe70c01f496a tempest-ProjectMemberTests-488731474 None] Lock "cinder-d9f27ee6-a626-4fec-bfab-64c0c88c03d3-delete_volume" released by "delete_volume" :: held 1.138s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:12:01 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-dff7dbcf-568a-41c7-a9fb-658d0cb4ed7e tempest-ProjectMemberTests-488731474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:12:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dff7dbcf-568a-41c7-a9fb-658d0cb4ed7e tempest-ProjectMemberTests-488731474 None] Flow 'volume_create_manager' (c449e93f-7fec-42be-8a80-7cf297f65b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:12:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dff7dbcf-568a-41c7-a9fb-658d0cb4ed7e tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (740b044a-82c8-4fd0-a5fb-7749631ce58f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:12:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dff7dbcf-568a-41c7-a9fb-658d0cb4ed7e tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (740b044a-82c8-4fd0-a5fb-7749631ce58f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:12:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-738594161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5e70e9a-e699-4156-84f7-49709221aeb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b5af8d2d70740348028c34578cb1393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:12:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:12:01Z,use_quota=True,user_id='21f3365c7a9a490387324872cde069aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:12:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dff7dbcf-568a-41c7-a9fb-658d0cb4ed7e tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bbc7574-5e85-487e-a730-a1d58addc184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:12:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dff7dbcf-568a-41c7-a9fb-658d0cb4ed7e tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bbc7574-5e85-487e-a730-a1d58addc184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:12:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dff7dbcf-568a-41c7-a9fb-658d0cb4ed7e tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fee9340d-c20f-4025-aa20-3399d1fc67e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:12:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dff7dbcf-568a-41c7-a9fb-658d0cb4ed7e tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fee9340d-c20f-4025-aa20-3399d1fc67e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5e70e9a-e699-4156-84f7-49709221aeb8', 'volume_name': 'volume-a5e70e9a-e699-4156-84f7-49709221aeb8', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:12:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dff7dbcf-568a-41c7-a9fb-658d0cb4ed7e tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4355dfba-9699-4548-936b-4efc1b8f8898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:12:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dff7dbcf-568a-41c7-a9fb-658d0cb4ed7e tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4355dfba-9699-4548-936b-4efc1b8f8898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:12:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dff7dbcf-568a-41c7-a9fb-658d0cb4ed7e tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae4c8c93-c824-4f1b-bbf7-83ed2be2d06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:12:01 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-dff7dbcf-568a-41c7-a9fb-658d0cb4ed7e tempest-ProjectMemberTests-488731474 None] Volume a5e70e9a-e699-4156-84f7-49709221aeb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5e70e9a-e699-4156-84f7-49709221aeb8', 'volume_size': 1} Sep 04 18:12:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-dff7dbcf-568a-41c7-a9fb-658d0cb4ed7e tempest-ProjectMemberTests-488731474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:12:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-dff7dbcf-568a-41c7-a9fb-658d0cb4ed7e tempest-ProjectMemberTests-488731474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:12:01 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-dff7dbcf-568a-41c7-a9fb-658d0cb4ed7e tempest-ProjectMemberTests-488731474 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:12:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-738594161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5e70e9a-e699-4156-84f7-49709221aeb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b5af8d2d70740348028c34578cb1393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:12:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:12:01Z,use_quota=True,user_id='21f3365c7a9a490387324872cde069aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:12:01 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-dff7dbcf-568a-41c7-a9fb-658d0cb4ed7e tempest-ProjectMemberTests-488731474 None] Creating volume a5e70e9a-e699-4156-84f7-49709221aeb8 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:12:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-dff7dbcf-568a-41c7-a9fb-658d0cb4ed7e tempest-ProjectMemberTests-488731474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:12:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-dff7dbcf-568a-41c7-a9fb-658d0cb4ed7e tempest-ProjectMemberTests-488731474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:12:01 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-dff7dbcf-568a-41c7-a9fb-658d0cb4ed7e tempest-ProjectMemberTests-488731474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:12:01 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-dff7dbcf-568a-41c7-a9fb-658d0cb4ed7e tempest-ProjectMemberTests-488731474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:12:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-dff7dbcf-568a-41c7-a9fb-658d0cb4ed7e tempest-ProjectMemberTests-488731474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:12:01 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-dff7dbcf-568a-41c7-a9fb-658d0cb4ed7e tempest-ProjectMemberTests-488731474 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:12:01 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-dff7dbcf-568a-41c7-a9fb-658d0cb4ed7e tempest-ProjectMemberTests-488731474 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:12:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dff7dbcf-568a-41c7-a9fb-658d0cb4ed7e tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a5e70e9a-e699-4156-84f7-49709221aeb8 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:01 devstack sudo[107801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a5e70e9a-e699-4156-84f7-49709221aeb8 1073741824 Sep 04 18:12:01 devstack sudo[107801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:02 devstack sudo[107801]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dff7dbcf-568a-41c7-a9fb-658d0cb4ed7e tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a5e70e9a-e699-4156-84f7-49709221aeb8 1073741824" returned: 0 in 0.435s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dff7dbcf-568a-41c7-a9fb-658d0cb4ed7e tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a5e70e9a-e699-4156-84f7-49709221aeb8 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:02 devstack sudo[107807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a5e70e9a-e699-4156-84f7-49709221aeb8 Sep 04 18:12:02 devstack sudo[107807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:02 devstack sudo[107807]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-dff7dbcf-568a-41c7-a9fb-658d0cb4ed7e tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a5e70e9a-e699-4156-84f7-49709221aeb8" returned: 0 in 0.262s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:02 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-dff7dbcf-568a-41c7-a9fb-658d0cb4ed7e tempest-ProjectMemberTests-488731474 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:12:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-dff7dbcf-568a-41c7-a9fb-658d0cb4ed7e tempest-ProjectMemberTests-488731474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:12:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dff7dbcf-568a-41c7-a9fb-658d0cb4ed7e tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae4c8c93-c824-4f1b-bbf7-83ed2be2d06d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5e70e9a-e699-4156-84f7-49709221aeb8', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:12:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dff7dbcf-568a-41c7-a9fb-658d0cb4ed7e tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60bbfde8-84bd-4ccd-9542-226411f1d498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:12:02 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-dff7dbcf-568a-41c7-a9fb-658d0cb4ed7e tempest-ProjectMemberTests-488731474 None] Volume volume-a5e70e9a-e699-4156-84f7-49709221aeb8 (a5e70e9a-e699-4156-84f7-49709221aeb8): created successfully Sep 04 18:12:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dff7dbcf-568a-41c7-a9fb-658d0cb4ed7e tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60bbfde8-84bd-4ccd-9542-226411f1d498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:12:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-dff7dbcf-568a-41c7-a9fb-658d0cb4ed7e tempest-ProjectMemberTests-488731474 None] Flow 'volume_create_manager' (c449e93f-7fec-42be-8a80-7cf297f65b99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:12:02 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-dff7dbcf-568a-41c7-a9fb-658d0cb4ed7e tempest-ProjectMemberTests-488731474 None] Created volume successfully. Sep 04 18:12:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-46bed751-61e5-4aa7-bc70-8785508d85fd tempest-ProjectMemberTests-488731474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:12:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-46bed751-61e5-4aa7-bc70-8785508d85fd tempest-ProjectMemberTests-488731474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:12:02 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-46bed751-61e5-4aa7-bc70-8785508d85fd tempest-ProjectMemberTests-488731474 None] Creating offline snapshot ef08c42b-444f-4da7-a6db-a54025995a1e of volume a5e70e9a-e699-4156-84f7-49709221aeb8 {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 18:12:02 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[92955847-2c92-46ea-92c2-ba95d24f0e5f]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:12:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-46bed751-61e5-4aa7-bc70-8785508d85fd tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a5e70e9a-e699-4156-84f7-49709221aeb8 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:02 devstack sudo[107812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a5e70e9a-e699-4156-84f7-49709221aeb8 Sep 04 18:12:02 devstack sudo[107812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:03 devstack sudo[107812]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-46bed751-61e5-4aa7-bc70-8785508d85fd tempest-ProjectMemberTests-488731474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a5e70e9a-e699-4156-84f7-49709221aeb8" returned: 0 in 0.386s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-46bed751-61e5-4aa7-bc70-8785508d85fd tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a5e70e9a-e699-4156-84f7-49709221aeb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a5e70e9a-e699-4156-84f7-49709221aeb8.ef08c42b-444f-4da7-a6db-a54025995a1e 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:03 devstack sudo[107817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a5e70e9a-e699-4156-84f7-49709221aeb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a5e70e9a-e699-4156-84f7-49709221aeb8.ef08c42b-444f-4da7-a6db-a54025995a1e 1G Sep 04 18:12:03 devstack sudo[107817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:03 devstack sudo[107817]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-46bed751-61e5-4aa7-bc70-8785508d85fd tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a5e70e9a-e699-4156-84f7-49709221aeb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a5e70e9a-e699-4156-84f7-49709221aeb8.ef08c42b-444f-4da7-a6db-a54025995a1e 1G" returned: 0 in 0.408s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-46bed751-61e5-4aa7-bc70-8785508d85fd tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5e70e9a-e699-4156-84f7-49709221aeb8 -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a5e70e9a-e699-4156-84f7-49709221aeb8.ef08c42b-444f-4da7-a6db-a54025995a1e {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:03 devstack sudo[107823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5e70e9a-e699-4156-84f7-49709221aeb8 -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a5e70e9a-e699-4156-84f7-49709221aeb8.ef08c42b-444f-4da7-a6db-a54025995a1e Sep 04 18:12:03 devstack sudo[107823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:03 devstack sudo[107823]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-46bed751-61e5-4aa7-bc70-8785508d85fd tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5e70e9a-e699-4156-84f7-49709221aeb8 -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a5e70e9a-e699-4156-84f7-49709221aeb8.ef08c42b-444f-4da7-a6db-a54025995a1e" returned: 0 in 0.282s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:03 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-46bed751-61e5-4aa7-bc70-8785508d85fd tempest-ProjectMemberTests-488731474 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a5e70e9a-e699-4156-84f7-49709221aeb8.ef08c42b-444f-4da7-a6db-a54025995a1e is being set with open permissions: ugo+rw Sep 04 18:12:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-46bed751-61e5-4aa7-bc70-8785508d85fd tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a5e70e9a-e699-4156-84f7-49709221aeb8.ef08c42b-444f-4da7-a6db-a54025995a1e {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:03 devstack sudo[107828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a5e70e9a-e699-4156-84f7-49709221aeb8.ef08c42b-444f-4da7-a6db-a54025995a1e Sep 04 18:12:03 devstack sudo[107828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:04 devstack sudo[107828]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-46bed751-61e5-4aa7-bc70-8785508d85fd tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a5e70e9a-e699-4156-84f7-49709221aeb8.ef08c42b-444f-4da7-a6db-a54025995a1e" returned: 0 in 0.241s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-46bed751-61e5-4aa7-bc70-8785508d85fd tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a5e70e9a-e699-4156-84f7-49709221aeb8.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:04 devstack sudo[107832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a5e70e9a-e699-4156-84f7-49709221aeb8.info Sep 04 18:12:04 devstack sudo[107832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:04 devstack sudo[107832]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-46bed751-61e5-4aa7-bc70-8785508d85fd tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a5e70e9a-e699-4156-84f7-49709221aeb8.info" returned: 0 in 0.243s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:04 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-46bed751-61e5-4aa7-bc70-8785508d85fd tempest-ProjectMemberTests-488731474 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a5e70e9a-e699-4156-84f7-49709221aeb8.info is being set with open permissions: ugo+rw Sep 04 18:12:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-46bed751-61e5-4aa7-bc70-8785508d85fd tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a5e70e9a-e699-4156-84f7-49709221aeb8.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:04 devstack sudo[107835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a5e70e9a-e699-4156-84f7-49709221aeb8.info Sep 04 18:12:04 devstack sudo[107835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:04 devstack sudo[107835]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-46bed751-61e5-4aa7-bc70-8785508d85fd tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a5e70e9a-e699-4156-84f7-49709221aeb8.info" returned: 0 in 0.240s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-46bed751-61e5-4aa7-bc70-8785508d85fd tempest-ProjectMemberTests-488731474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.878s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:12:04 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-46bed751-61e5-4aa7-bc70-8785508d85fd tempest-ProjectMemberTests-488731474 None] Create snapshot completed successfully Sep 04 18:12:04 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-011b8973-f0ff-438f-b2f0-baac463d7cec tempest-ProjectMemberTests-488731474 None] Acquiring lock "cinder-ef08c42b-444f-4da7-a6db-a54025995a1e-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:12:04 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-011b8973-f0ff-438f-b2f0-baac463d7cec tempest-ProjectMemberTests-488731474 None] Lock "cinder-ef08c42b-444f-4da7-a6db-a54025995a1e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:12:04 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-011b8973-f0ff-438f-b2f0-baac463d7cec tempest-ProjectMemberTests-488731474 None] Acquiring lock "cinder-quobyte-a5e70e9a-e699-4156-84f7-49709221aeb8" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:12:04 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-011b8973-f0ff-438f-b2f0-baac463d7cec tempest-ProjectMemberTests-488731474 None] Lock "cinder-quobyte-a5e70e9a-e699-4156-84f7-49709221aeb8" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:12:04 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-011b8973-f0ff-438f-b2f0-baac463d7cec tempest-ProjectMemberTests-488731474 None] Acquiring lock "cinder-quobyte-ef08c42b-444f-4da7-a6db-a54025995a1e" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:12:04 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-011b8973-f0ff-438f-b2f0-baac463d7cec tempest-ProjectMemberTests-488731474 None] Lock "cinder-quobyte-ef08c42b-444f-4da7-a6db-a54025995a1e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:12:04 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-011b8973-f0ff-438f-b2f0-baac463d7cec tempest-ProjectMemberTests-488731474 None] Deleting offline snapshot ef08c42b-444f-4da7-a6db-a54025995a1e of volume a5e70e9a-e699-4156-84f7-49709221aeb8 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 18:12:04 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-011b8973-f0ff-438f-b2f0-baac463d7cec tempest-ProjectMemberTests-488731474 None] snapshot_file for this snap is: volume-a5e70e9a-e699-4156-84f7-49709221aeb8.ef08c42b-444f-4da7-a6db-a54025995a1e {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 18:12:04 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf6b329-e5aa-49da-9dab-e8449a29218c]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:12:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-011b8973-f0ff-438f-b2f0-baac463d7cec tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a5e70e9a-e699-4156-84f7-49709221aeb8.ef08c42b-444f-4da7-a6db-a54025995a1e {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:05 devstack sudo[107838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a5e70e9a-e699-4156-84f7-49709221aeb8.ef08c42b-444f-4da7-a6db-a54025995a1e Sep 04 18:12:05 devstack sudo[107838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:05 devstack sudo[107838]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-011b8973-f0ff-438f-b2f0-baac463d7cec tempest-ProjectMemberTests-488731474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a5e70e9a-e699-4156-84f7-49709221aeb8.ef08c42b-444f-4da7-a6db-a54025995a1e" returned: 0 in 0.349s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:05 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-011b8973-f0ff-438f-b2f0-baac463d7cec tempest-ProjectMemberTests-488731474 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5e70e9a-e699-4156-84f7-49709221aeb8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 18:12:05 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23018cc-27b8-49a2-a6c4-d138071668a5]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:12:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-011b8973-f0ff-438f-b2f0-baac463d7cec tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a5e70e9a-e699-4156-84f7-49709221aeb8 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:05 devstack sudo[107844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a5e70e9a-e699-4156-84f7-49709221aeb8 Sep 04 18:12:05 devstack sudo[107844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:05 devstack sudo[107844]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-011b8973-f0ff-438f-b2f0-baac463d7cec tempest-ProjectMemberTests-488731474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a5e70e9a-e699-4156-84f7-49709221aeb8" returned: 0 in 0.362s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-011b8973-f0ff-438f-b2f0-baac463d7cec tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a5e70e9a-e699-4156-84f7-49709221aeb8.ef08c42b-444f-4da7-a6db-a54025995a1e {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:05 devstack sudo[107849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a5e70e9a-e699-4156-84f7-49709221aeb8.ef08c42b-444f-4da7-a6db-a54025995a1e Sep 04 18:12:05 devstack sudo[107849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:06 devstack sudo[107849]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-011b8973-f0ff-438f-b2f0-baac463d7cec tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a5e70e9a-e699-4156-84f7-49709221aeb8.ef08c42b-444f-4da7-a6db-a54025995a1e" returned: 0 in 0.322s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-011b8973-f0ff-438f-b2f0-baac463d7cec tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a5e70e9a-e699-4156-84f7-49709221aeb8.ef08c42b-444f-4da7-a6db-a54025995a1e {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:06 devstack sudo[107855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a5e70e9a-e699-4156-84f7-49709221aeb8.ef08c42b-444f-4da7-a6db-a54025995a1e Sep 04 18:12:06 devstack sudo[107855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:06 devstack sudo[107855]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-011b8973-f0ff-438f-b2f0-baac463d7cec tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a5e70e9a-e699-4156-84f7-49709221aeb8.ef08c42b-444f-4da7-a6db-a54025995a1e" returned: 0 in 0.241s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:06 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-011b8973-f0ff-438f-b2f0-baac463d7cec tempest-ProjectMemberTests-488731474 None] Lock "cinder-quobyte-ef08c42b-444f-4da7-a6db-a54025995a1e" released by "_delete_snapshot" :: held 1.362s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:12:06 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-011b8973-f0ff-438f-b2f0-baac463d7cec tempest-ProjectMemberTests-488731474 None] Lock "cinder-quobyte-a5e70e9a-e699-4156-84f7-49709221aeb8" released by "delete_snapshot" :: held 1.384s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:12:06 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-011b8973-f0ff-438f-b2f0-baac463d7cec tempest-ProjectMemberTests-488731474 None] Created reservations ['65dcfe27-2db3-4e90-bc7e-74bce3b4d21f', '55fae99c-64e7-4fda-9436-f13e9e4172e2', 'c292ba0c-9a85-4ff5-b6b9-d2777f9205a7', '6bf8a73e-5442-4c73-8d07-e93164f68a46'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:12:06 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-011b8973-f0ff-438f-b2f0-baac463d7cec tempest-ProjectMemberTests-488731474 None] Delete snapshot completed successfully. Sep 04 18:12:06 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-011b8973-f0ff-438f-b2f0-baac463d7cec tempest-ProjectMemberTests-488731474 None] Lock "cinder-ef08c42b-444f-4da7-a6db-a54025995a1e-delete_snapshot" released by "delete_snapshot" :: held 1.513s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:12:07 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-886d291b-6eb8-4e1b-887e-86134e737b4e tempest-ProjectMemberTests-488731474 None] Acquiring lock "cinder-a5e70e9a-e699-4156-84f7-49709221aeb8-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:12:07 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-886d291b-6eb8-4e1b-887e-86134e737b4e tempest-ProjectMemberTests-488731474 None] Lock "cinder-a5e70e9a-e699-4156-84f7-49709221aeb8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:12:07 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-886d291b-6eb8-4e1b-887e-86134e737b4e tempest-ProjectMemberTests-488731474 None] Acquiring lock "cinder-quobyte-a5e70e9a-e699-4156-84f7-49709221aeb8" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:12:07 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-886d291b-6eb8-4e1b-887e-86134e737b4e tempest-ProjectMemberTests-488731474 None] Lock "cinder-quobyte-a5e70e9a-e699-4156-84f7-49709221aeb8" acquired by "delete_volume" :: waited 0.016s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:12:07 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[926ff83c-99f7-4f6b-9153-0714548d97f4]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:12:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-886d291b-6eb8-4e1b-887e-86134e737b4e tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a5e70e9a-e699-4156-84f7-49709221aeb8 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:07 devstack sudo[107858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a5e70e9a-e699-4156-84f7-49709221aeb8 Sep 04 18:12:07 devstack sudo[107858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:07 devstack sudo[107858]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-886d291b-6eb8-4e1b-887e-86134e737b4e tempest-ProjectMemberTests-488731474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a5e70e9a-e699-4156-84f7-49709221aeb8" returned: 0 in 0.351s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-886d291b-6eb8-4e1b-887e-86134e737b4e tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a5e70e9a-e699-4156-84f7-49709221aeb8 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:07 devstack sudo[107863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a5e70e9a-e699-4156-84f7-49709221aeb8 Sep 04 18:12:07 devstack sudo[107863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:07 devstack sudo[107863]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-886d291b-6eb8-4e1b-887e-86134e737b4e tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-a5e70e9a-e699-4156-84f7-49709221aeb8" returned: 0 in 0.246s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:07 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-886d291b-6eb8-4e1b-887e-86134e737b4e tempest-ProjectMemberTests-488731474 None] Lock "cinder-quobyte-a5e70e9a-e699-4156-84f7-49709221aeb8" released by "delete_volume" :: held 0.656s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:12:07 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-886d291b-6eb8-4e1b-887e-86134e737b4e tempest-ProjectMemberTests-488731474 None] Created reservations ['05faad4b-6385-4f6d-81c2-2bc0289131c5', '87b7a26f-e2d5-46ba-850f-be054f7d339d', 'bf6e62a9-bba7-441c-97bd-39978bc3adfb', 'e4e7f9fb-e3dd-41c4-9e82-4fee2340d2f5'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:12:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-886d291b-6eb8-4e1b-887e-86134e737b4e tempest-ProjectMemberTests-488731474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:12:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-886d291b-6eb8-4e1b-887e-86134e737b4e tempest-ProjectMemberTests-488731474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:12:07 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-886d291b-6eb8-4e1b-887e-86134e737b4e tempest-ProjectMemberTests-488731474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:12:07 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-886d291b-6eb8-4e1b-887e-86134e737b4e tempest-ProjectMemberTests-488731474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:12:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-886d291b-6eb8-4e1b-887e-86134e737b4e tempest-ProjectMemberTests-488731474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:12:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-886d291b-6eb8-4e1b-887e-86134e737b4e tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:07 devstack sudo[107866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:12:07 devstack sudo[107866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:08 devstack sudo[107866]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-886d291b-6eb8-4e1b-887e-86134e737b4e tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.245s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:08 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-886d291b-6eb8-4e1b-887e-86134e737b4e tempest-ProjectMemberTests-488731474 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:12:08 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-886d291b-6eb8-4e1b-887e-86134e737b4e tempest-ProjectMemberTests-488731474 None] Deleted volume successfully. Sep 04 18:12:08 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-886d291b-6eb8-4e1b-887e-86134e737b4e tempest-ProjectMemberTests-488731474 None] Lock "cinder-a5e70e9a-e699-4156-84f7-49709221aeb8-delete_volume" released by "delete_volume" :: held 1.094s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:12:08 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-40fb9a95-5580-4703-9c20-19ddf53601d7 tempest-ProjectMemberTests-488731474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:12:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-40fb9a95-5580-4703-9c20-19ddf53601d7 tempest-ProjectMemberTests-488731474 None] Flow 'volume_create_manager' (2e80b240-f016-4c52-8a78-81279913f43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:12:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-40fb9a95-5580-4703-9c20-19ddf53601d7 tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3c87d3b-eb9d-4b04-b954-45158379d2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:12:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-40fb9a95-5580-4703-9c20-19ddf53601d7 tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3c87d3b-eb9d-4b04-b954-45158379d2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1310338473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eb415b0-67b5-4f4f-9ed4-797bc30011f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b5af8d2d70740348028c34578cb1393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:12:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:12:09Z,use_quota=True,user_id='21f3365c7a9a490387324872cde069aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:12:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-40fb9a95-5580-4703-9c20-19ddf53601d7 tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02cb0553-35c1-44c1-aedb-602ec663e667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:12:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-40fb9a95-5580-4703-9c20-19ddf53601d7 tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02cb0553-35c1-44c1-aedb-602ec663e667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:12:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-40fb9a95-5580-4703-9c20-19ddf53601d7 tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2cdf423-914e-4b1d-bf7e-563469a469fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:12:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-40fb9a95-5580-4703-9c20-19ddf53601d7 tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2cdf423-914e-4b1d-bf7e-563469a469fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1eb415b0-67b5-4f4f-9ed4-797bc30011f5', 'volume_name': 'volume-1eb415b0-67b5-4f4f-9ed4-797bc30011f5', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:12:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-40fb9a95-5580-4703-9c20-19ddf53601d7 tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90c4da8f-8290-4141-814d-3191b2f62559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:12:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-40fb9a95-5580-4703-9c20-19ddf53601d7 tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90c4da8f-8290-4141-814d-3191b2f62559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:12:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-40fb9a95-5580-4703-9c20-19ddf53601d7 tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a60612d-eec8-4e5b-b8e0-6937c2f7027e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:12:08 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-40fb9a95-5580-4703-9c20-19ddf53601d7 tempest-ProjectMemberTests-488731474 None] Volume 1eb415b0-67b5-4f4f-9ed4-797bc30011f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1eb415b0-67b5-4f4f-9ed4-797bc30011f5', 'volume_size': 1} Sep 04 18:12:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-40fb9a95-5580-4703-9c20-19ddf53601d7 tempest-ProjectMemberTests-488731474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:12:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-40fb9a95-5580-4703-9c20-19ddf53601d7 tempest-ProjectMemberTests-488731474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:12:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-40fb9a95-5580-4703-9c20-19ddf53601d7 tempest-ProjectMemberTests-488731474 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1310338473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eb415b0-67b5-4f4f-9ed4-797bc30011f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b5af8d2d70740348028c34578cb1393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:12:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:12:09Z,use_quota=True,user_id='21f3365c7a9a490387324872cde069aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:12:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-40fb9a95-5580-4703-9c20-19ddf53601d7 tempest-ProjectMemberTests-488731474 None] Creating volume 1eb415b0-67b5-4f4f-9ed4-797bc30011f5 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:12:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-40fb9a95-5580-4703-9c20-19ddf53601d7 tempest-ProjectMemberTests-488731474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:12:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-40fb9a95-5580-4703-9c20-19ddf53601d7 tempest-ProjectMemberTests-488731474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:12:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-40fb9a95-5580-4703-9c20-19ddf53601d7 tempest-ProjectMemberTests-488731474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:12:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-40fb9a95-5580-4703-9c20-19ddf53601d7 tempest-ProjectMemberTests-488731474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:12:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-40fb9a95-5580-4703-9c20-19ddf53601d7 tempest-ProjectMemberTests-488731474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:12:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-40fb9a95-5580-4703-9c20-19ddf53601d7 tempest-ProjectMemberTests-488731474 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:12:08 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-40fb9a95-5580-4703-9c20-19ddf53601d7 tempest-ProjectMemberTests-488731474 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:12:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-40fb9a95-5580-4703-9c20-19ddf53601d7 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1eb415b0-67b5-4f4f-9ed4-797bc30011f5 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:08 devstack sudo[107869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1eb415b0-67b5-4f4f-9ed4-797bc30011f5 1073741824 Sep 04 18:12:08 devstack sudo[107869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:09 devstack sudo[107869]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-40fb9a95-5580-4703-9c20-19ddf53601d7 tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1eb415b0-67b5-4f4f-9ed4-797bc30011f5 1073741824" returned: 0 in 0.381s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-40fb9a95-5580-4703-9c20-19ddf53601d7 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1eb415b0-67b5-4f4f-9ed4-797bc30011f5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:09 devstack sudo[107874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1eb415b0-67b5-4f4f-9ed4-797bc30011f5 Sep 04 18:12:09 devstack sudo[107874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:09 devstack sudo[107874]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-40fb9a95-5580-4703-9c20-19ddf53601d7 tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1eb415b0-67b5-4f4f-9ed4-797bc30011f5" returned: 0 in 0.234s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:09 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-40fb9a95-5580-4703-9c20-19ddf53601d7 tempest-ProjectMemberTests-488731474 None] <== create_volume: return (654ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:12:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-40fb9a95-5580-4703-9c20-19ddf53601d7 tempest-ProjectMemberTests-488731474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.658s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:12:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-40fb9a95-5580-4703-9c20-19ddf53601d7 tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a60612d-eec8-4e5b-b8e0-6937c2f7027e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1eb415b0-67b5-4f4f-9ed4-797bc30011f5', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:12:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-40fb9a95-5580-4703-9c20-19ddf53601d7 tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deb12c0a-746b-40c9-bbb4-276a82f6bb52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:12:09 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-40fb9a95-5580-4703-9c20-19ddf53601d7 tempest-ProjectMemberTests-488731474 None] Volume volume-1eb415b0-67b5-4f4f-9ed4-797bc30011f5 (1eb415b0-67b5-4f4f-9ed4-797bc30011f5): created successfully Sep 04 18:12:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-40fb9a95-5580-4703-9c20-19ddf53601d7 tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deb12c0a-746b-40c9-bbb4-276a82f6bb52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:12:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-40fb9a95-5580-4703-9c20-19ddf53601d7 tempest-ProjectMemberTests-488731474 None] Flow 'volume_create_manager' (2e80b240-f016-4c52-8a78-81279913f43b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:12:09 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-40fb9a95-5580-4703-9c20-19ddf53601d7 tempest-ProjectMemberTests-488731474 None] Created volume successfully. Sep 04 18:12:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c832aee3-3488-4f9d-bc74-bb91ac16f81e tempest-ProjectMemberTests-488731474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:12:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c832aee3-3488-4f9d-bc74-bb91ac16f81e tempest-ProjectMemberTests-488731474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:12:09 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-c832aee3-3488-4f9d-bc74-bb91ac16f81e tempest-ProjectMemberTests-488731474 None] Creating offline snapshot a730815e-fcff-434f-98ce-98762c4a2e4e of volume 1eb415b0-67b5-4f4f-9ed4-797bc30011f5 {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 18:12:09 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[58672313-836f-428e-837a-1c20b355cbc8]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:12:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c832aee3-3488-4f9d-bc74-bb91ac16f81e tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1eb415b0-67b5-4f4f-9ed4-797bc30011f5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:09 devstack sudo[107877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1eb415b0-67b5-4f4f-9ed4-797bc30011f5 Sep 04 18:12:09 devstack sudo[107877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:10 devstack sudo[107877]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c832aee3-3488-4f9d-bc74-bb91ac16f81e tempest-ProjectMemberTests-488731474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1eb415b0-67b5-4f4f-9ed4-797bc30011f5" returned: 0 in 0.353s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c832aee3-3488-4f9d-bc74-bb91ac16f81e tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1eb415b0-67b5-4f4f-9ed4-797bc30011f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1eb415b0-67b5-4f4f-9ed4-797bc30011f5.a730815e-fcff-434f-98ce-98762c4a2e4e 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:10 devstack sudo[107882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1eb415b0-67b5-4f4f-9ed4-797bc30011f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1eb415b0-67b5-4f4f-9ed4-797bc30011f5.a730815e-fcff-434f-98ce-98762c4a2e4e 1G Sep 04 18:12:10 devstack sudo[107882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:10 devstack sudo[107882]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c832aee3-3488-4f9d-bc74-bb91ac16f81e tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1eb415b0-67b5-4f4f-9ed4-797bc30011f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1eb415b0-67b5-4f4f-9ed4-797bc30011f5.a730815e-fcff-434f-98ce-98762c4a2e4e 1G" returned: 0 in 0.353s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c832aee3-3488-4f9d-bc74-bb91ac16f81e tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1eb415b0-67b5-4f4f-9ed4-797bc30011f5 -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1eb415b0-67b5-4f4f-9ed4-797bc30011f5.a730815e-fcff-434f-98ce-98762c4a2e4e {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:10 devstack sudo[107887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1eb415b0-67b5-4f4f-9ed4-797bc30011f5 -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1eb415b0-67b5-4f4f-9ed4-797bc30011f5.a730815e-fcff-434f-98ce-98762c4a2e4e Sep 04 18:12:10 devstack sudo[107887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:10 devstack sudo[107887]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c832aee3-3488-4f9d-bc74-bb91ac16f81e tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1eb415b0-67b5-4f4f-9ed4-797bc30011f5 -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1eb415b0-67b5-4f4f-9ed4-797bc30011f5.a730815e-fcff-434f-98ce-98762c4a2e4e" returned: 0 in 0.281s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:10 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-c832aee3-3488-4f9d-bc74-bb91ac16f81e tempest-ProjectMemberTests-488731474 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1eb415b0-67b5-4f4f-9ed4-797bc30011f5.a730815e-fcff-434f-98ce-98762c4a2e4e is being set with open permissions: ugo+rw Sep 04 18:12:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c832aee3-3488-4f9d-bc74-bb91ac16f81e tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1eb415b0-67b5-4f4f-9ed4-797bc30011f5.a730815e-fcff-434f-98ce-98762c4a2e4e {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:10 devstack sudo[107893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1eb415b0-67b5-4f4f-9ed4-797bc30011f5.a730815e-fcff-434f-98ce-98762c4a2e4e Sep 04 18:12:10 devstack sudo[107893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:11 devstack sudo[107893]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c832aee3-3488-4f9d-bc74-bb91ac16f81e tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1eb415b0-67b5-4f4f-9ed4-797bc30011f5.a730815e-fcff-434f-98ce-98762c4a2e4e" returned: 0 in 0.238s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c832aee3-3488-4f9d-bc74-bb91ac16f81e tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1eb415b0-67b5-4f4f-9ed4-797bc30011f5.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:11 devstack sudo[107896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1eb415b0-67b5-4f4f-9ed4-797bc30011f5.info Sep 04 18:12:11 devstack sudo[107896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:11 devstack sudo[107896]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c832aee3-3488-4f9d-bc74-bb91ac16f81e tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1eb415b0-67b5-4f4f-9ed4-797bc30011f5.info" returned: 0 in 0.248s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:11 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-c832aee3-3488-4f9d-bc74-bb91ac16f81e tempest-ProjectMemberTests-488731474 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1eb415b0-67b5-4f4f-9ed4-797bc30011f5.info is being set with open permissions: ugo+rw Sep 04 18:12:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c832aee3-3488-4f9d-bc74-bb91ac16f81e tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1eb415b0-67b5-4f4f-9ed4-797bc30011f5.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:11 devstack sudo[107899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1eb415b0-67b5-4f4f-9ed4-797bc30011f5.info Sep 04 18:12:11 devstack sudo[107899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:11 devstack sudo[107899]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c832aee3-3488-4f9d-bc74-bb91ac16f81e tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1eb415b0-67b5-4f4f-9ed4-797bc30011f5.info" returned: 0 in 0.228s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c832aee3-3488-4f9d-bc74-bb91ac16f81e tempest-ProjectMemberTests-488731474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.781s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:12:11 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-c832aee3-3488-4f9d-bc74-bb91ac16f81e tempest-ProjectMemberTests-488731474 None] Create snapshot completed successfully Sep 04 18:12:11 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-be5c432e-a37d-4c59-90b5-92097cb8f275 tempest-ProjectMemberTests-488731474 None] Acquiring lock "cinder-a730815e-fcff-434f-98ce-98762c4a2e4e-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:12:11 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-be5c432e-a37d-4c59-90b5-92097cb8f275 tempest-ProjectMemberTests-488731474 None] Lock "cinder-a730815e-fcff-434f-98ce-98762c4a2e4e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:12:11 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-be5c432e-a37d-4c59-90b5-92097cb8f275 tempest-ProjectMemberTests-488731474 None] Acquiring lock "cinder-quobyte-1eb415b0-67b5-4f4f-9ed4-797bc30011f5" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:12:11 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-be5c432e-a37d-4c59-90b5-92097cb8f275 tempest-ProjectMemberTests-488731474 None] Lock "cinder-quobyte-1eb415b0-67b5-4f4f-9ed4-797bc30011f5" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:12:11 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-be5c432e-a37d-4c59-90b5-92097cb8f275 tempest-ProjectMemberTests-488731474 None] Acquiring lock "cinder-quobyte-a730815e-fcff-434f-98ce-98762c4a2e4e" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:12:12 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-be5c432e-a37d-4c59-90b5-92097cb8f275 tempest-ProjectMemberTests-488731474 None] Lock "cinder-quobyte-a730815e-fcff-434f-98ce-98762c4a2e4e" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:12:12 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-be5c432e-a37d-4c59-90b5-92097cb8f275 tempest-ProjectMemberTests-488731474 None] Deleting offline snapshot a730815e-fcff-434f-98ce-98762c4a2e4e of volume 1eb415b0-67b5-4f4f-9ed4-797bc30011f5 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 18:12:12 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-be5c432e-a37d-4c59-90b5-92097cb8f275 tempest-ProjectMemberTests-488731474 None] snapshot_file for this snap is: volume-1eb415b0-67b5-4f4f-9ed4-797bc30011f5.a730815e-fcff-434f-98ce-98762c4a2e4e {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 18:12:12 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b2ab26-52eb-475f-87b6-76c2607baaa3]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:12:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-be5c432e-a37d-4c59-90b5-92097cb8f275 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1eb415b0-67b5-4f4f-9ed4-797bc30011f5.a730815e-fcff-434f-98ce-98762c4a2e4e {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:12 devstack sudo[107902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1eb415b0-67b5-4f4f-9ed4-797bc30011f5.a730815e-fcff-434f-98ce-98762c4a2e4e Sep 04 18:12:12 devstack sudo[107902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:12 devstack sudo[107902]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-be5c432e-a37d-4c59-90b5-92097cb8f275 tempest-ProjectMemberTests-488731474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1eb415b0-67b5-4f4f-9ed4-797bc30011f5.a730815e-fcff-434f-98ce-98762c4a2e4e" returned: 0 in 0.351s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:12 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-be5c432e-a37d-4c59-90b5-92097cb8f275 tempest-ProjectMemberTests-488731474 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1eb415b0-67b5-4f4f-9ed4-797bc30011f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 18:12:12 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f4958c-08d8-4d18-8eda-56a7780936d5]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:12:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-be5c432e-a37d-4c59-90b5-92097cb8f275 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1eb415b0-67b5-4f4f-9ed4-797bc30011f5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:12 devstack sudo[107907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1eb415b0-67b5-4f4f-9ed4-797bc30011f5 Sep 04 18:12:12 devstack sudo[107907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:12 devstack sudo[107907]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-be5c432e-a37d-4c59-90b5-92097cb8f275 tempest-ProjectMemberTests-488731474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1eb415b0-67b5-4f4f-9ed4-797bc30011f5" returned: 0 in 0.353s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-be5c432e-a37d-4c59-90b5-92097cb8f275 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1eb415b0-67b5-4f4f-9ed4-797bc30011f5.a730815e-fcff-434f-98ce-98762c4a2e4e {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:12 devstack sudo[107912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1eb415b0-67b5-4f4f-9ed4-797bc30011f5.a730815e-fcff-434f-98ce-98762c4a2e4e Sep 04 18:12:12 devstack sudo[107912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:13 devstack sudo[107912]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-be5c432e-a37d-4c59-90b5-92097cb8f275 tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1eb415b0-67b5-4f4f-9ed4-797bc30011f5.a730815e-fcff-434f-98ce-98762c4a2e4e" returned: 0 in 0.311s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-be5c432e-a37d-4c59-90b5-92097cb8f275 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1eb415b0-67b5-4f4f-9ed4-797bc30011f5.a730815e-fcff-434f-98ce-98762c4a2e4e {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:13 devstack sudo[107919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1eb415b0-67b5-4f4f-9ed4-797bc30011f5.a730815e-fcff-434f-98ce-98762c4a2e4e Sep 04 18:12:13 devstack sudo[107919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:13 devstack sudo[107919]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-be5c432e-a37d-4c59-90b5-92097cb8f275 tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1eb415b0-67b5-4f4f-9ed4-797bc30011f5.a730815e-fcff-434f-98ce-98762c4a2e4e" returned: 0 in 0.231s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:13 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-be5c432e-a37d-4c59-90b5-92097cb8f275 tempest-ProjectMemberTests-488731474 None] Lock "cinder-quobyte-a730815e-fcff-434f-98ce-98762c4a2e4e" released by "_delete_snapshot" :: held 1.333s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:12:13 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-be5c432e-a37d-4c59-90b5-92097cb8f275 tempest-ProjectMemberTests-488731474 None] Lock "cinder-quobyte-1eb415b0-67b5-4f4f-9ed4-797bc30011f5" released by "delete_snapshot" :: held 1.352s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:12:13 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-be5c432e-a37d-4c59-90b5-92097cb8f275 tempest-ProjectMemberTests-488731474 None] Created reservations ['c742cd9f-2942-4c16-a3ca-c01edcb3dd63', 'e6da29a5-9089-4bdb-bad1-e8827538c86a', '63d9b575-6e12-4a7e-bbdf-b54149a2d649', 'de969f1c-9a67-4edc-87df-8b13fbc31ac5'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:12:13 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-be5c432e-a37d-4c59-90b5-92097cb8f275 tempest-ProjectMemberTests-488731474 None] Delete snapshot completed successfully. Sep 04 18:12:13 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-be5c432e-a37d-4c59-90b5-92097cb8f275 tempest-ProjectMemberTests-488731474 None] Lock "cinder-a730815e-fcff-434f-98ce-98762c4a2e4e-delete_snapshot" released by "delete_snapshot" :: held 1.477s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:12:14 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b75f6a97-0db1-4f2f-a898-7dd90ce36729 tempest-ProjectMemberTests-488731474 None] Acquiring lock "cinder-1eb415b0-67b5-4f4f-9ed4-797bc30011f5-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:12:14 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b75f6a97-0db1-4f2f-a898-7dd90ce36729 tempest-ProjectMemberTests-488731474 None] Lock "cinder-1eb415b0-67b5-4f4f-9ed4-797bc30011f5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:12:14 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b75f6a97-0db1-4f2f-a898-7dd90ce36729 tempest-ProjectMemberTests-488731474 None] Acquiring lock "cinder-quobyte-1eb415b0-67b5-4f4f-9ed4-797bc30011f5" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:12:14 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b75f6a97-0db1-4f2f-a898-7dd90ce36729 tempest-ProjectMemberTests-488731474 None] Lock "cinder-quobyte-1eb415b0-67b5-4f4f-9ed4-797bc30011f5" acquired by "delete_volume" :: waited 0.013s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:12:14 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[473fcbfa-72e2-4421-9b4c-9c1affa13df2]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:12:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b75f6a97-0db1-4f2f-a898-7dd90ce36729 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1eb415b0-67b5-4f4f-9ed4-797bc30011f5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:14 devstack sudo[107923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1eb415b0-67b5-4f4f-9ed4-797bc30011f5 Sep 04 18:12:14 devstack sudo[107923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:14 devstack sudo[107923]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b75f6a97-0db1-4f2f-a898-7dd90ce36729 tempest-ProjectMemberTests-488731474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1eb415b0-67b5-4f4f-9ed4-797bc30011f5" returned: 0 in 0.337s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b75f6a97-0db1-4f2f-a898-7dd90ce36729 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1eb415b0-67b5-4f4f-9ed4-797bc30011f5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:14 devstack sudo[107928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1eb415b0-67b5-4f4f-9ed4-797bc30011f5 Sep 04 18:12:14 devstack sudo[107928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:14 devstack sudo[107928]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b75f6a97-0db1-4f2f-a898-7dd90ce36729 tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-1eb415b0-67b5-4f4f-9ed4-797bc30011f5" returned: 0 in 0.236s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:14 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b75f6a97-0db1-4f2f-a898-7dd90ce36729 tempest-ProjectMemberTests-488731474 None] Lock "cinder-quobyte-1eb415b0-67b5-4f4f-9ed4-797bc30011f5" released by "delete_volume" :: held 0.627s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:12:14 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-b75f6a97-0db1-4f2f-a898-7dd90ce36729 tempest-ProjectMemberTests-488731474 None] Created reservations ['8ed65e72-3670-4347-afa1-171401ce3340', '6705e9bf-7acb-42a1-82fe-1e439dbfa3dd', '4790abc7-59a4-4219-83cd-765e28004442', '803d0c93-083b-4e68-bcdc-95bcc9105e9b'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:12:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b75f6a97-0db1-4f2f-a898-7dd90ce36729 tempest-ProjectMemberTests-488731474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:12:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b75f6a97-0db1-4f2f-a898-7dd90ce36729 tempest-ProjectMemberTests-488731474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:12:14 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b75f6a97-0db1-4f2f-a898-7dd90ce36729 tempest-ProjectMemberTests-488731474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:12:14 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b75f6a97-0db1-4f2f-a898-7dd90ce36729 tempest-ProjectMemberTests-488731474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:12:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b75f6a97-0db1-4f2f-a898-7dd90ce36729 tempest-ProjectMemberTests-488731474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:12:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b75f6a97-0db1-4f2f-a898-7dd90ce36729 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:14 devstack sudo[107931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:12:14 devstack sudo[107931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:15 devstack sudo[107931]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b75f6a97-0db1-4f2f-a898-7dd90ce36729 tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.228s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:15 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-b75f6a97-0db1-4f2f-a898-7dd90ce36729 tempest-ProjectMemberTests-488731474 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:12:15 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-b75f6a97-0db1-4f2f-a898-7dd90ce36729 tempest-ProjectMemberTests-488731474 None] Deleted volume successfully. Sep 04 18:12:15 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-b75f6a97-0db1-4f2f-a898-7dd90ce36729 tempest-ProjectMemberTests-488731474 None] Lock "cinder-1eb415b0-67b5-4f4f-9ed4-797bc30011f5-delete_volume" released by "delete_volume" :: held 1.055s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:12:15 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5a96af8-b9a3-45a6-9e33-4f9f382dce64 tempest-ProjectMemberTests-488731474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:12:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a5a96af8-b9a3-45a6-9e33-4f9f382dce64 tempest-ProjectMemberTests-488731474 None] Flow 'volume_create_manager' (588d0168-bccf-4140-8d28-9ada4547d82d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:12:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a5a96af8-b9a3-45a6-9e33-4f9f382dce64 tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8972403-9eb8-4e7e-83c9-5b27c3bb128f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:12:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a5a96af8-b9a3-45a6-9e33-4f9f382dce64 tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8972403-9eb8-4e7e-83c9-5b27c3bb128f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:12:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-858587042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=829817ec-d27c-4b81-a2ff-dd2b495a11bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b5af8d2d70740348028c34578cb1393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:12:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:12:16Z,use_quota=True,user_id='21f3365c7a9a490387324872cde069aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:12:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a5a96af8-b9a3-45a6-9e33-4f9f382dce64 tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79429c29-3189-4e83-9adc-13335db4c9bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:12:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a5a96af8-b9a3-45a6-9e33-4f9f382dce64 tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79429c29-3189-4e83-9adc-13335db4c9bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:12:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a5a96af8-b9a3-45a6-9e33-4f9f382dce64 tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (693b56b4-837f-44ce-a544-4693b16824e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:12:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a5a96af8-b9a3-45a6-9e33-4f9f382dce64 tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (693b56b4-837f-44ce-a544-4693b16824e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '829817ec-d27c-4b81-a2ff-dd2b495a11bc', 'volume_name': 'volume-829817ec-d27c-4b81-a2ff-dd2b495a11bc', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:12:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a5a96af8-b9a3-45a6-9e33-4f9f382dce64 tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97d5f64d-bb53-4570-a930-b50f8aded949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:12:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a5a96af8-b9a3-45a6-9e33-4f9f382dce64 tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97d5f64d-bb53-4570-a930-b50f8aded949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:12:15 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a5a96af8-b9a3-45a6-9e33-4f9f382dce64 tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10c10a9e-908e-4514-9783-5f57a90ef3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:12:15 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-a5a96af8-b9a3-45a6-9e33-4f9f382dce64 tempest-ProjectMemberTests-488731474 None] Volume 829817ec-d27c-4b81-a2ff-dd2b495a11bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-829817ec-d27c-4b81-a2ff-dd2b495a11bc', 'volume_size': 1} Sep 04 18:12:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a5a96af8-b9a3-45a6-9e33-4f9f382dce64 tempest-ProjectMemberTests-488731474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:12:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a5a96af8-b9a3-45a6-9e33-4f9f382dce64 tempest-ProjectMemberTests-488731474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:12:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a5a96af8-b9a3-45a6-9e33-4f9f382dce64 tempest-ProjectMemberTests-488731474 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:12:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-858587042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=829817ec-d27c-4b81-a2ff-dd2b495a11bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b5af8d2d70740348028c34578cb1393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:12:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:12:16Z,use_quota=True,user_id='21f3365c7a9a490387324872cde069aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:12:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-a5a96af8-b9a3-45a6-9e33-4f9f382dce64 tempest-ProjectMemberTests-488731474 None] Creating volume 829817ec-d27c-4b81-a2ff-dd2b495a11bc {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:12:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a5a96af8-b9a3-45a6-9e33-4f9f382dce64 tempest-ProjectMemberTests-488731474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:12:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a5a96af8-b9a3-45a6-9e33-4f9f382dce64 tempest-ProjectMemberTests-488731474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:12:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a5a96af8-b9a3-45a6-9e33-4f9f382dce64 tempest-ProjectMemberTests-488731474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:12:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a5a96af8-b9a3-45a6-9e33-4f9f382dce64 tempest-ProjectMemberTests-488731474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:12:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a5a96af8-b9a3-45a6-9e33-4f9f382dce64 tempest-ProjectMemberTests-488731474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:12:15 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a5a96af8-b9a3-45a6-9e33-4f9f382dce64 tempest-ProjectMemberTests-488731474 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:12:15 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-a5a96af8-b9a3-45a6-9e33-4f9f382dce64 tempest-ProjectMemberTests-488731474 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:12:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a5a96af8-b9a3-45a6-9e33-4f9f382dce64 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-829817ec-d27c-4b81-a2ff-dd2b495a11bc 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:15 devstack sudo[107934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-829817ec-d27c-4b81-a2ff-dd2b495a11bc 1073741824 Sep 04 18:12:15 devstack sudo[107934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:16 devstack sudo[107934]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a5a96af8-b9a3-45a6-9e33-4f9f382dce64 tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-829817ec-d27c-4b81-a2ff-dd2b495a11bc 1073741824" returned: 0 in 0.433s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a5a96af8-b9a3-45a6-9e33-4f9f382dce64 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-829817ec-d27c-4b81-a2ff-dd2b495a11bc {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:16 devstack sudo[107940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-829817ec-d27c-4b81-a2ff-dd2b495a11bc Sep 04 18:12:16 devstack sudo[107940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:16 devstack sudo[107940]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a5a96af8-b9a3-45a6-9e33-4f9f382dce64 tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-829817ec-d27c-4b81-a2ff-dd2b495a11bc" returned: 0 in 0.268s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:16 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a5a96af8-b9a3-45a6-9e33-4f9f382dce64 tempest-ProjectMemberTests-488731474 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:12:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a5a96af8-b9a3-45a6-9e33-4f9f382dce64 tempest-ProjectMemberTests-488731474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:12:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a5a96af8-b9a3-45a6-9e33-4f9f382dce64 tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10c10a9e-908e-4514-9783-5f57a90ef3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-829817ec-d27c-4b81-a2ff-dd2b495a11bc', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:12:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a5a96af8-b9a3-45a6-9e33-4f9f382dce64 tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8869e3f5-88e0-44ec-af88-648ea7e07470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:12:16 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-a5a96af8-b9a3-45a6-9e33-4f9f382dce64 tempest-ProjectMemberTests-488731474 None] Volume volume-829817ec-d27c-4b81-a2ff-dd2b495a11bc (829817ec-d27c-4b81-a2ff-dd2b495a11bc): created successfully Sep 04 18:12:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a5a96af8-b9a3-45a6-9e33-4f9f382dce64 tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8869e3f5-88e0-44ec-af88-648ea7e07470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:12:16 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a5a96af8-b9a3-45a6-9e33-4f9f382dce64 tempest-ProjectMemberTests-488731474 None] Flow 'volume_create_manager' (588d0168-bccf-4140-8d28-9ada4547d82d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:12:16 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-a5a96af8-b9a3-45a6-9e33-4f9f382dce64 tempest-ProjectMemberTests-488731474 None] Created volume successfully. Sep 04 18:12:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b0aadd5b-5daf-4bf7-b35e-862eca104d70 tempest-ProjectMemberTests-488731474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:12:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b0aadd5b-5daf-4bf7-b35e-862eca104d70 tempest-ProjectMemberTests-488731474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:12:16 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-b0aadd5b-5daf-4bf7-b35e-862eca104d70 tempest-ProjectMemberTests-488731474 None] Creating offline snapshot fc6d2a6d-3310-4cbe-968e-d815972b6e92 of volume 829817ec-d27c-4b81-a2ff-dd2b495a11bc {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 18:12:16 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3a15ae-0354-42fe-8df0-d11f6e4aa5f5]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:12:16 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b0aadd5b-5daf-4bf7-b35e-862eca104d70 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-829817ec-d27c-4b81-a2ff-dd2b495a11bc {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:16 devstack sudo[107943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-829817ec-d27c-4b81-a2ff-dd2b495a11bc Sep 04 18:12:16 devstack sudo[107943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:17 devstack sudo[107943]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b0aadd5b-5daf-4bf7-b35e-862eca104d70 tempest-ProjectMemberTests-488731474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-829817ec-d27c-4b81-a2ff-dd2b495a11bc" returned: 0 in 0.336s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b0aadd5b-5daf-4bf7-b35e-862eca104d70 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-829817ec-d27c-4b81-a2ff-dd2b495a11bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-829817ec-d27c-4b81-a2ff-dd2b495a11bc.fc6d2a6d-3310-4cbe-968e-d815972b6e92 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:17 devstack sudo[107948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-829817ec-d27c-4b81-a2ff-dd2b495a11bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-829817ec-d27c-4b81-a2ff-dd2b495a11bc.fc6d2a6d-3310-4cbe-968e-d815972b6e92 1G Sep 04 18:12:17 devstack sudo[107948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:17 devstack sudo[107948]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b0aadd5b-5daf-4bf7-b35e-862eca104d70 tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-829817ec-d27c-4b81-a2ff-dd2b495a11bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-829817ec-d27c-4b81-a2ff-dd2b495a11bc.fc6d2a6d-3310-4cbe-968e-d815972b6e92 1G" returned: 0 in 0.364s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b0aadd5b-5daf-4bf7-b35e-862eca104d70 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-829817ec-d27c-4b81-a2ff-dd2b495a11bc -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-829817ec-d27c-4b81-a2ff-dd2b495a11bc.fc6d2a6d-3310-4cbe-968e-d815972b6e92 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:17 devstack sudo[107953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-829817ec-d27c-4b81-a2ff-dd2b495a11bc -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-829817ec-d27c-4b81-a2ff-dd2b495a11bc.fc6d2a6d-3310-4cbe-968e-d815972b6e92 Sep 04 18:12:17 devstack sudo[107953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:17 devstack sudo[107953]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b0aadd5b-5daf-4bf7-b35e-862eca104d70 tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-829817ec-d27c-4b81-a2ff-dd2b495a11bc -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-829817ec-d27c-4b81-a2ff-dd2b495a11bc.fc6d2a6d-3310-4cbe-968e-d815972b6e92" returned: 0 in 0.308s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:17 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-b0aadd5b-5daf-4bf7-b35e-862eca104d70 tempest-ProjectMemberTests-488731474 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-829817ec-d27c-4b81-a2ff-dd2b495a11bc.fc6d2a6d-3310-4cbe-968e-d815972b6e92 is being set with open permissions: ugo+rw Sep 04 18:12:17 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b0aadd5b-5daf-4bf7-b35e-862eca104d70 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-829817ec-d27c-4b81-a2ff-dd2b495a11bc.fc6d2a6d-3310-4cbe-968e-d815972b6e92 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:17 devstack sudo[107958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-829817ec-d27c-4b81-a2ff-dd2b495a11bc.fc6d2a6d-3310-4cbe-968e-d815972b6e92 Sep 04 18:12:17 devstack sudo[107958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:18 devstack sudo[107958]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b0aadd5b-5daf-4bf7-b35e-862eca104d70 tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-829817ec-d27c-4b81-a2ff-dd2b495a11bc.fc6d2a6d-3310-4cbe-968e-d815972b6e92" returned: 0 in 0.232s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b0aadd5b-5daf-4bf7-b35e-862eca104d70 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-829817ec-d27c-4b81-a2ff-dd2b495a11bc.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:18 devstack sudo[107961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-829817ec-d27c-4b81-a2ff-dd2b495a11bc.info Sep 04 18:12:18 devstack sudo[107961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:18 devstack sudo[107961]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b0aadd5b-5daf-4bf7-b35e-862eca104d70 tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-829817ec-d27c-4b81-a2ff-dd2b495a11bc.info" returned: 0 in 0.244s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:18 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-b0aadd5b-5daf-4bf7-b35e-862eca104d70 tempest-ProjectMemberTests-488731474 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-829817ec-d27c-4b81-a2ff-dd2b495a11bc.info is being set with open permissions: ugo+rw Sep 04 18:12:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b0aadd5b-5daf-4bf7-b35e-862eca104d70 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-829817ec-d27c-4b81-a2ff-dd2b495a11bc.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:18 devstack sudo[107964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-829817ec-d27c-4b81-a2ff-dd2b495a11bc.info Sep 04 18:12:18 devstack sudo[107964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:18 devstack sudo[107964]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b0aadd5b-5daf-4bf7-b35e-862eca104d70 tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-829817ec-d27c-4b81-a2ff-dd2b495a11bc.info" returned: 0 in 0.238s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:18 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b0aadd5b-5daf-4bf7-b35e-862eca104d70 tempest-ProjectMemberTests-488731474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.795s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:12:18 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-b0aadd5b-5daf-4bf7-b35e-862eca104d70 tempest-ProjectMemberTests-488731474 None] Create snapshot completed successfully Sep 04 18:12:18 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d44cc1b2-dbf6-4186-ad92-90b794e0f9bb tempest-ProjectMemberTests-488731474 None] Acquiring lock "cinder-fc6d2a6d-3310-4cbe-968e-d815972b6e92-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:12:19 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d44cc1b2-dbf6-4186-ad92-90b794e0f9bb tempest-ProjectMemberTests-488731474 None] Lock "cinder-fc6d2a6d-3310-4cbe-968e-d815972b6e92-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:12:19 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d44cc1b2-dbf6-4186-ad92-90b794e0f9bb tempest-ProjectMemberTests-488731474 None] Acquiring lock "cinder-quobyte-829817ec-d27c-4b81-a2ff-dd2b495a11bc" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:12:19 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d44cc1b2-dbf6-4186-ad92-90b794e0f9bb tempest-ProjectMemberTests-488731474 None] Lock "cinder-quobyte-829817ec-d27c-4b81-a2ff-dd2b495a11bc" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:12:19 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d44cc1b2-dbf6-4186-ad92-90b794e0f9bb tempest-ProjectMemberTests-488731474 None] Acquiring lock "cinder-quobyte-fc6d2a6d-3310-4cbe-968e-d815972b6e92" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:12:19 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d44cc1b2-dbf6-4186-ad92-90b794e0f9bb tempest-ProjectMemberTests-488731474 None] Lock "cinder-quobyte-fc6d2a6d-3310-4cbe-968e-d815972b6e92" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:12:19 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-d44cc1b2-dbf6-4186-ad92-90b794e0f9bb tempest-ProjectMemberTests-488731474 None] Deleting offline snapshot fc6d2a6d-3310-4cbe-968e-d815972b6e92 of volume 829817ec-d27c-4b81-a2ff-dd2b495a11bc {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 18:12:19 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-d44cc1b2-dbf6-4186-ad92-90b794e0f9bb tempest-ProjectMemberTests-488731474 None] snapshot_file for this snap is: volume-829817ec-d27c-4b81-a2ff-dd2b495a11bc.fc6d2a6d-3310-4cbe-968e-d815972b6e92 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 18:12:19 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[42057cd3-2155-4acd-9dda-f74b62fb086b]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:12:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d44cc1b2-dbf6-4186-ad92-90b794e0f9bb tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-829817ec-d27c-4b81-a2ff-dd2b495a11bc.fc6d2a6d-3310-4cbe-968e-d815972b6e92 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:19 devstack sudo[107967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-829817ec-d27c-4b81-a2ff-dd2b495a11bc.fc6d2a6d-3310-4cbe-968e-d815972b6e92 Sep 04 18:12:19 devstack sudo[107967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:19 devstack sudo[107967]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d44cc1b2-dbf6-4186-ad92-90b794e0f9bb tempest-ProjectMemberTests-488731474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-829817ec-d27c-4b81-a2ff-dd2b495a11bc.fc6d2a6d-3310-4cbe-968e-d815972b6e92" returned: 0 in 0.359s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:19 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-d44cc1b2-dbf6-4186-ad92-90b794e0f9bb tempest-ProjectMemberTests-488731474 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-829817ec-d27c-4b81-a2ff-dd2b495a11bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 18:12:19 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f4ed9a-ca26-4eb1-a566-d52a1e37fbfa]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:12:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d44cc1b2-dbf6-4186-ad92-90b794e0f9bb tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-829817ec-d27c-4b81-a2ff-dd2b495a11bc {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:19 devstack sudo[107972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-829817ec-d27c-4b81-a2ff-dd2b495a11bc Sep 04 18:12:19 devstack sudo[107972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:19 devstack sudo[107972]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d44cc1b2-dbf6-4186-ad92-90b794e0f9bb tempest-ProjectMemberTests-488731474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-829817ec-d27c-4b81-a2ff-dd2b495a11bc" returned: 0 in 0.355s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:19 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d44cc1b2-dbf6-4186-ad92-90b794e0f9bb tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-829817ec-d27c-4b81-a2ff-dd2b495a11bc.fc6d2a6d-3310-4cbe-968e-d815972b6e92 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:19 devstack sudo[107977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-829817ec-d27c-4b81-a2ff-dd2b495a11bc.fc6d2a6d-3310-4cbe-968e-d815972b6e92 Sep 04 18:12:19 devstack sudo[107977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:20 devstack sudo[107977]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d44cc1b2-dbf6-4186-ad92-90b794e0f9bb tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-829817ec-d27c-4b81-a2ff-dd2b495a11bc.fc6d2a6d-3310-4cbe-968e-d815972b6e92" returned: 0 in 0.360s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d44cc1b2-dbf6-4186-ad92-90b794e0f9bb tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-829817ec-d27c-4b81-a2ff-dd2b495a11bc.fc6d2a6d-3310-4cbe-968e-d815972b6e92 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:20 devstack sudo[107982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-829817ec-d27c-4b81-a2ff-dd2b495a11bc.fc6d2a6d-3310-4cbe-968e-d815972b6e92 Sep 04 18:12:20 devstack sudo[107982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:20 devstack sudo[107982]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:20 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d44cc1b2-dbf6-4186-ad92-90b794e0f9bb tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-829817ec-d27c-4b81-a2ff-dd2b495a11bc.fc6d2a6d-3310-4cbe-968e-d815972b6e92" returned: 0 in 0.259s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:20 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d44cc1b2-dbf6-4186-ad92-90b794e0f9bb tempest-ProjectMemberTests-488731474 None] Lock "cinder-quobyte-fc6d2a6d-3310-4cbe-968e-d815972b6e92" released by "_delete_snapshot" :: held 1.423s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:12:20 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d44cc1b2-dbf6-4186-ad92-90b794e0f9bb tempest-ProjectMemberTests-488731474 None] Lock "cinder-quobyte-829817ec-d27c-4b81-a2ff-dd2b495a11bc" released by "delete_snapshot" :: held 1.449s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:12:20 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-d44cc1b2-dbf6-4186-ad92-90b794e0f9bb tempest-ProjectMemberTests-488731474 None] Created reservations ['67dbbd1a-2e0b-487e-b681-b36176b6cd85', '17d63236-3c48-4147-9dfb-c7c5cbdd6f4e', '81f4700b-e963-4e4b-bcbe-78df7d6b94c4', '3115494f-8b85-4c02-a64e-66ad93baa0d9'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:12:20 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-d44cc1b2-dbf6-4186-ad92-90b794e0f9bb tempest-ProjectMemberTests-488731474 None] Delete snapshot completed successfully. Sep 04 18:12:20 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-d44cc1b2-dbf6-4186-ad92-90b794e0f9bb tempest-ProjectMemberTests-488731474 None] Lock "cinder-fc6d2a6d-3310-4cbe-968e-d815972b6e92-delete_snapshot" released by "delete_snapshot" :: held 1.583s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:12:21 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7a4cc41f-78d7-4fc3-ad4e-7c762d2d4d50 tempest-ProjectMemberTests-488731474 None] Acquiring lock "cinder-829817ec-d27c-4b81-a2ff-dd2b495a11bc-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:12:21 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7a4cc41f-78d7-4fc3-ad4e-7c762d2d4d50 tempest-ProjectMemberTests-488731474 None] Lock "cinder-829817ec-d27c-4b81-a2ff-dd2b495a11bc-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:12:21 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7a4cc41f-78d7-4fc3-ad4e-7c762d2d4d50 tempest-ProjectMemberTests-488731474 None] Acquiring lock "cinder-quobyte-829817ec-d27c-4b81-a2ff-dd2b495a11bc" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:12:21 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7a4cc41f-78d7-4fc3-ad4e-7c762d2d4d50 tempest-ProjectMemberTests-488731474 None] Lock "cinder-quobyte-829817ec-d27c-4b81-a2ff-dd2b495a11bc" acquired by "delete_volume" :: waited 0.020s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:12:21 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb8fb5d-d0a9-490c-b403-0ec7ad010c32]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:12:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7a4cc41f-78d7-4fc3-ad4e-7c762d2d4d50 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-829817ec-d27c-4b81-a2ff-dd2b495a11bc {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:21 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 18:12:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:12:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:12:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:12:21 devstack sudo[107986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-829817ec-d27c-4b81-a2ff-dd2b495a11bc Sep 04 18:12:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:12:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:12:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:21 devstack sudo[107986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:21 devstack sudo[107988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:12:21 devstack sudo[107988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:21 devstack sudo[107988]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.251s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:21 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:12:21 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running periodic task VolumeManager._thread_info {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 18:12:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] thread count: 28 {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 18:12:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] thread info: [<_MainThread(MainThread, started 139900377723008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 18:12:21 devstack sudo[107986]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7a4cc41f-78d7-4fc3-ad4e-7c762d2d4d50 tempest-ProjectMemberTests-488731474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-829817ec-d27c-4b81-a2ff-dd2b495a11bc" returned: 0 in 0.385s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7a4cc41f-78d7-4fc3-ad4e-7c762d2d4d50 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-829817ec-d27c-4b81-a2ff-dd2b495a11bc {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:21 devstack sudo[107994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-829817ec-d27c-4b81-a2ff-dd2b495a11bc Sep 04 18:12:21 devstack sudo[107994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:21 devstack sudo[107994]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7a4cc41f-78d7-4fc3-ad4e-7c762d2d4d50 tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-829817ec-d27c-4b81-a2ff-dd2b495a11bc" returned: 0 in 0.232s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:21 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7a4cc41f-78d7-4fc3-ad4e-7c762d2d4d50 tempest-ProjectMemberTests-488731474 None] Lock "cinder-quobyte-829817ec-d27c-4b81-a2ff-dd2b495a11bc" released by "delete_volume" :: held 0.683s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:12:21 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-7a4cc41f-78d7-4fc3-ad4e-7c762d2d4d50 tempest-ProjectMemberTests-488731474 None] Created reservations ['33ab6ad0-e0cc-4a4f-ac41-a8d655771735', '7375cbc0-c09c-4b4e-84ad-797d5c239fa8', '1a00fc21-8443-4a85-98e3-a7aba443a88a', '18825e08-ac2d-4204-a6c4-20c9fa887d88'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:12:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7a4cc41f-78d7-4fc3-ad4e-7c762d2d4d50 tempest-ProjectMemberTests-488731474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:12:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7a4cc41f-78d7-4fc3-ad4e-7c762d2d4d50 tempest-ProjectMemberTests-488731474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:12:22 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7a4cc41f-78d7-4fc3-ad4e-7c762d2d4d50 tempest-ProjectMemberTests-488731474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:12:22 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-7a4cc41f-78d7-4fc3-ad4e-7c762d2d4d50 tempest-ProjectMemberTests-488731474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:12:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-7a4cc41f-78d7-4fc3-ad4e-7c762d2d4d50 tempest-ProjectMemberTests-488731474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:12:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7a4cc41f-78d7-4fc3-ad4e-7c762d2d4d50 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:22 devstack sudo[107997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:12:22 devstack sudo[107997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:22 devstack sudo[107997]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-7a4cc41f-78d7-4fc3-ad4e-7c762d2d4d50 tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.245s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:22 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-7a4cc41f-78d7-4fc3-ad4e-7c762d2d4d50 tempest-ProjectMemberTests-488731474 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:12:22 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-7a4cc41f-78d7-4fc3-ad4e-7c762d2d4d50 tempest-ProjectMemberTests-488731474 None] Deleted volume successfully. Sep 04 18:12:22 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-7a4cc41f-78d7-4fc3-ad4e-7c762d2d4d50 tempest-ProjectMemberTests-488731474 None] Lock "cinder-829817ec-d27c-4b81-a2ff-dd2b495a11bc-delete_volume" released by "delete_volume" :: held 1.155s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:12:22 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa9817fc-67ef-4e56-875c-c7c8d0ef0d3a tempest-ProjectMemberTests-488731474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:12:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fa9817fc-67ef-4e56-875c-c7c8d0ef0d3a tempest-ProjectMemberTests-488731474 None] Flow 'volume_create_manager' (4eabdc0d-3182-4bed-82e7-27d3a8f1ca9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:12:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fa9817fc-67ef-4e56-875c-c7c8d0ef0d3a tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0db705d5-007d-4dd5-9e66-49ef3def66eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:12:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fa9817fc-67ef-4e56-875c-c7c8d0ef0d3a tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0db705d5-007d-4dd5-9e66-49ef3def66eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:12:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-591039269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d5e34bf-c526-4cc8-84ed-3da98906948b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b5af8d2d70740348028c34578cb1393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:12:23Z,use_quota=True,user_id='21f3365c7a9a490387324872cde069aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:12:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fa9817fc-67ef-4e56-875c-c7c8d0ef0d3a tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a97ad902-46a5-4fd4-9349-1b6703707a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:12:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fa9817fc-67ef-4e56-875c-c7c8d0ef0d3a tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a97ad902-46a5-4fd4-9349-1b6703707a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:12:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fa9817fc-67ef-4e56-875c-c7c8d0ef0d3a tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8241ae93-dab0-4238-888f-a7abdc87779a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:12:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fa9817fc-67ef-4e56-875c-c7c8d0ef0d3a tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8241ae93-dab0-4238-888f-a7abdc87779a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d5e34bf-c526-4cc8-84ed-3da98906948b', 'volume_name': 'volume-6d5e34bf-c526-4cc8-84ed-3da98906948b', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:12:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fa9817fc-67ef-4e56-875c-c7c8d0ef0d3a tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9489a714-770c-420c-ac79-5c1d1bc5b6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:12:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fa9817fc-67ef-4e56-875c-c7c8d0ef0d3a tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9489a714-770c-420c-ac79-5c1d1bc5b6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:12:22 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fa9817fc-67ef-4e56-875c-c7c8d0ef0d3a tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05c2dbbb-bcc1-4f41-bdbb-3779bd04a1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:12:22 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-fa9817fc-67ef-4e56-875c-c7c8d0ef0d3a tempest-ProjectMemberTests-488731474 None] Volume 6d5e34bf-c526-4cc8-84ed-3da98906948b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d5e34bf-c526-4cc8-84ed-3da98906948b', 'volume_size': 1} Sep 04 18:12:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fa9817fc-67ef-4e56-875c-c7c8d0ef0d3a tempest-ProjectMemberTests-488731474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:12:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fa9817fc-67ef-4e56-875c-c7c8d0ef0d3a tempest-ProjectMemberTests-488731474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:12:22 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-fa9817fc-67ef-4e56-875c-c7c8d0ef0d3a tempest-ProjectMemberTests-488731474 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:12:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-591039269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d5e34bf-c526-4cc8-84ed-3da98906948b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b5af8d2d70740348028c34578cb1393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:12:23Z,use_quota=True,user_id='21f3365c7a9a490387324872cde069aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:12:22 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-fa9817fc-67ef-4e56-875c-c7c8d0ef0d3a tempest-ProjectMemberTests-488731474 None] Creating volume 6d5e34bf-c526-4cc8-84ed-3da98906948b {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:12:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fa9817fc-67ef-4e56-875c-c7c8d0ef0d3a tempest-ProjectMemberTests-488731474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:12:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fa9817fc-67ef-4e56-875c-c7c8d0ef0d3a tempest-ProjectMemberTests-488731474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:12:22 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-fa9817fc-67ef-4e56-875c-c7c8d0ef0d3a tempest-ProjectMemberTests-488731474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:12:22 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-fa9817fc-67ef-4e56-875c-c7c8d0ef0d3a tempest-ProjectMemberTests-488731474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:12:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fa9817fc-67ef-4e56-875c-c7c8d0ef0d3a tempest-ProjectMemberTests-488731474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:12:22 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-fa9817fc-67ef-4e56-875c-c7c8d0ef0d3a tempest-ProjectMemberTests-488731474 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:12:22 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-fa9817fc-67ef-4e56-875c-c7c8d0ef0d3a tempest-ProjectMemberTests-488731474 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:12:22 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fa9817fc-67ef-4e56-875c-c7c8d0ef0d3a tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6d5e34bf-c526-4cc8-84ed-3da98906948b 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:22 devstack sudo[108000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6d5e34bf-c526-4cc8-84ed-3da98906948b 1073741824 Sep 04 18:12:22 devstack sudo[108000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:23 devstack sudo[108000]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fa9817fc-67ef-4e56-875c-c7c8d0ef0d3a tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6d5e34bf-c526-4cc8-84ed-3da98906948b 1073741824" returned: 0 in 0.395s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fa9817fc-67ef-4e56-875c-c7c8d0ef0d3a tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6d5e34bf-c526-4cc8-84ed-3da98906948b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:23 devstack sudo[108006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6d5e34bf-c526-4cc8-84ed-3da98906948b Sep 04 18:12:23 devstack sudo[108006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:23 devstack sudo[108006]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-fa9817fc-67ef-4e56-875c-c7c8d0ef0d3a tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6d5e34bf-c526-4cc8-84ed-3da98906948b" returned: 0 in 0.242s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:23 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-fa9817fc-67ef-4e56-875c-c7c8d0ef0d3a tempest-ProjectMemberTests-488731474 None] <== create_volume: return (677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:12:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-fa9817fc-67ef-4e56-875c-c7c8d0ef0d3a tempest-ProjectMemberTests-488731474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.679s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:12:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fa9817fc-67ef-4e56-875c-c7c8d0ef0d3a tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05c2dbbb-bcc1-4f41-bdbb-3779bd04a1ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d5e34bf-c526-4cc8-84ed-3da98906948b', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:12:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fa9817fc-67ef-4e56-875c-c7c8d0ef0d3a tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc808018-3ad8-4b60-8b05-3d4f2d21f991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:12:23 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-fa9817fc-67ef-4e56-875c-c7c8d0ef0d3a tempest-ProjectMemberTests-488731474 None] Volume volume-6d5e34bf-c526-4cc8-84ed-3da98906948b (6d5e34bf-c526-4cc8-84ed-3da98906948b): created successfully Sep 04 18:12:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fa9817fc-67ef-4e56-875c-c7c8d0ef0d3a tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc808018-3ad8-4b60-8b05-3d4f2d21f991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:12:23 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-fa9817fc-67ef-4e56-875c-c7c8d0ef0d3a tempest-ProjectMemberTests-488731474 None] Flow 'volume_create_manager' (4eabdc0d-3182-4bed-82e7-27d3a8f1ca9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:12:23 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-fa9817fc-67ef-4e56-875c-c7c8d0ef0d3a tempest-ProjectMemberTests-488731474 None] Created volume successfully. Sep 04 18:12:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3fe8a6d1-615b-4210-a583-2e7433e6ca87 tempest-ProjectMemberTests-488731474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:12:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3fe8a6d1-615b-4210-a583-2e7433e6ca87 tempest-ProjectMemberTests-488731474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:12:23 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-3fe8a6d1-615b-4210-a583-2e7433e6ca87 tempest-ProjectMemberTests-488731474 None] Creating offline snapshot c24a738c-e90d-4df0-a86d-4c10d97b3acc of volume 6d5e34bf-c526-4cc8-84ed-3da98906948b {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 18:12:23 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c45196a-59cd-4dc4-ac6b-00c1583f21aa]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:12:23 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3fe8a6d1-615b-4210-a583-2e7433e6ca87 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6d5e34bf-c526-4cc8-84ed-3da98906948b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:24 devstack sudo[108009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6d5e34bf-c526-4cc8-84ed-3da98906948b Sep 04 18:12:24 devstack sudo[108009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:24 devstack sudo[108009]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3fe8a6d1-615b-4210-a583-2e7433e6ca87 tempest-ProjectMemberTests-488731474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6d5e34bf-c526-4cc8-84ed-3da98906948b" returned: 0 in 0.360s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3fe8a6d1-615b-4210-a583-2e7433e6ca87 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6d5e34bf-c526-4cc8-84ed-3da98906948b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6d5e34bf-c526-4cc8-84ed-3da98906948b.c24a738c-e90d-4df0-a86d-4c10d97b3acc 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:24 devstack sudo[108015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6d5e34bf-c526-4cc8-84ed-3da98906948b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6d5e34bf-c526-4cc8-84ed-3da98906948b.c24a738c-e90d-4df0-a86d-4c10d97b3acc 1G Sep 04 18:12:24 devstack sudo[108015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:24 devstack sudo[108015]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3fe8a6d1-615b-4210-a583-2e7433e6ca87 tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6d5e34bf-c526-4cc8-84ed-3da98906948b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6d5e34bf-c526-4cc8-84ed-3da98906948b.c24a738c-e90d-4df0-a86d-4c10d97b3acc 1G" returned: 0 in 0.375s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:24 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3fe8a6d1-615b-4210-a583-2e7433e6ca87 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d5e34bf-c526-4cc8-84ed-3da98906948b -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6d5e34bf-c526-4cc8-84ed-3da98906948b.c24a738c-e90d-4df0-a86d-4c10d97b3acc {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:24 devstack sudo[108021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d5e34bf-c526-4cc8-84ed-3da98906948b -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6d5e34bf-c526-4cc8-84ed-3da98906948b.c24a738c-e90d-4df0-a86d-4c10d97b3acc Sep 04 18:12:24 devstack sudo[108021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:25 devstack sudo[108021]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3fe8a6d1-615b-4210-a583-2e7433e6ca87 tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d5e34bf-c526-4cc8-84ed-3da98906948b -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6d5e34bf-c526-4cc8-84ed-3da98906948b.c24a738c-e90d-4df0-a86d-4c10d97b3acc" returned: 0 in 0.281s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:25 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-3fe8a6d1-615b-4210-a583-2e7433e6ca87 tempest-ProjectMemberTests-488731474 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6d5e34bf-c526-4cc8-84ed-3da98906948b.c24a738c-e90d-4df0-a86d-4c10d97b3acc is being set with open permissions: ugo+rw Sep 04 18:12:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3fe8a6d1-615b-4210-a583-2e7433e6ca87 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6d5e34bf-c526-4cc8-84ed-3da98906948b.c24a738c-e90d-4df0-a86d-4c10d97b3acc {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:25 devstack sudo[108026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6d5e34bf-c526-4cc8-84ed-3da98906948b.c24a738c-e90d-4df0-a86d-4c10d97b3acc Sep 04 18:12:25 devstack sudo[108026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:25 devstack sudo[108026]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3fe8a6d1-615b-4210-a583-2e7433e6ca87 tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6d5e34bf-c526-4cc8-84ed-3da98906948b.c24a738c-e90d-4df0-a86d-4c10d97b3acc" returned: 0 in 0.264s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3fe8a6d1-615b-4210-a583-2e7433e6ca87 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6d5e34bf-c526-4cc8-84ed-3da98906948b.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:25 devstack sudo[108029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6d5e34bf-c526-4cc8-84ed-3da98906948b.info Sep 04 18:12:25 devstack sudo[108029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:25 devstack sudo[108029]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3fe8a6d1-615b-4210-a583-2e7433e6ca87 tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6d5e34bf-c526-4cc8-84ed-3da98906948b.info" returned: 0 in 0.250s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:25 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-3fe8a6d1-615b-4210-a583-2e7433e6ca87 tempest-ProjectMemberTests-488731474 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6d5e34bf-c526-4cc8-84ed-3da98906948b.info is being set with open permissions: ugo+rw Sep 04 18:12:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3fe8a6d1-615b-4210-a583-2e7433e6ca87 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6d5e34bf-c526-4cc8-84ed-3da98906948b.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:25 devstack sudo[108032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6d5e34bf-c526-4cc8-84ed-3da98906948b.info Sep 04 18:12:25 devstack sudo[108032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:25 devstack sudo[108032]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3fe8a6d1-615b-4210-a583-2e7433e6ca87 tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6d5e34bf-c526-4cc8-84ed-3da98906948b.info" returned: 0 in 0.245s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:25 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3fe8a6d1-615b-4210-a583-2e7433e6ca87 tempest-ProjectMemberTests-488731474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.848s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:12:25 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-3fe8a6d1-615b-4210-a583-2e7433e6ca87 tempest-ProjectMemberTests-488731474 None] Create snapshot completed successfully Sep 04 18:12:26 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a9a1a7c1-32cd-4d81-8ead-f4864904da3b tempest-ProjectMemberTests-488731474 None] Acquiring lock "cinder-c24a738c-e90d-4df0-a86d-4c10d97b3acc-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:12:26 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a9a1a7c1-32cd-4d81-8ead-f4864904da3b tempest-ProjectMemberTests-488731474 None] Lock "cinder-c24a738c-e90d-4df0-a86d-4c10d97b3acc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:12:26 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a9a1a7c1-32cd-4d81-8ead-f4864904da3b tempest-ProjectMemberTests-488731474 None] Acquiring lock "cinder-quobyte-6d5e34bf-c526-4cc8-84ed-3da98906948b" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:12:26 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a9a1a7c1-32cd-4d81-8ead-f4864904da3b tempest-ProjectMemberTests-488731474 None] Lock "cinder-quobyte-6d5e34bf-c526-4cc8-84ed-3da98906948b" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:12:26 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a9a1a7c1-32cd-4d81-8ead-f4864904da3b tempest-ProjectMemberTests-488731474 None] Acquiring lock "cinder-quobyte-c24a738c-e90d-4df0-a86d-4c10d97b3acc" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:12:26 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a9a1a7c1-32cd-4d81-8ead-f4864904da3b tempest-ProjectMemberTests-488731474 None] Lock "cinder-quobyte-c24a738c-e90d-4df0-a86d-4c10d97b3acc" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:12:26 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-a9a1a7c1-32cd-4d81-8ead-f4864904da3b tempest-ProjectMemberTests-488731474 None] Deleting offline snapshot c24a738c-e90d-4df0-a86d-4c10d97b3acc of volume 6d5e34bf-c526-4cc8-84ed-3da98906948b {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 18:12:26 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-a9a1a7c1-32cd-4d81-8ead-f4864904da3b tempest-ProjectMemberTests-488731474 None] snapshot_file for this snap is: volume-6d5e34bf-c526-4cc8-84ed-3da98906948b.c24a738c-e90d-4df0-a86d-4c10d97b3acc {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 18:12:26 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[a566d50c-5669-4593-9ac0-94a3cc790764]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:12:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a9a1a7c1-32cd-4d81-8ead-f4864904da3b tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6d5e34bf-c526-4cc8-84ed-3da98906948b.c24a738c-e90d-4df0-a86d-4c10d97b3acc {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:26 devstack sudo[108035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6d5e34bf-c526-4cc8-84ed-3da98906948b.c24a738c-e90d-4df0-a86d-4c10d97b3acc Sep 04 18:12:26 devstack sudo[108035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:26 devstack sudo[108035]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a9a1a7c1-32cd-4d81-8ead-f4864904da3b tempest-ProjectMemberTests-488731474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6d5e34bf-c526-4cc8-84ed-3da98906948b.c24a738c-e90d-4df0-a86d-4c10d97b3acc" returned: 0 in 0.337s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:26 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-a9a1a7c1-32cd-4d81-8ead-f4864904da3b tempest-ProjectMemberTests-488731474 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d5e34bf-c526-4cc8-84ed-3da98906948b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 18:12:26 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[586f73d4-6564-497d-b5e2-178b23cfc968]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:12:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a9a1a7c1-32cd-4d81-8ead-f4864904da3b tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6d5e34bf-c526-4cc8-84ed-3da98906948b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:26 devstack sudo[108040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6d5e34bf-c526-4cc8-84ed-3da98906948b Sep 04 18:12:26 devstack sudo[108040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:26 devstack sudo[108040]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a9a1a7c1-32cd-4d81-8ead-f4864904da3b tempest-ProjectMemberTests-488731474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6d5e34bf-c526-4cc8-84ed-3da98906948b" returned: 0 in 0.339s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:26 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a9a1a7c1-32cd-4d81-8ead-f4864904da3b tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6d5e34bf-c526-4cc8-84ed-3da98906948b.c24a738c-e90d-4df0-a86d-4c10d97b3acc {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:26 devstack sudo[108045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6d5e34bf-c526-4cc8-84ed-3da98906948b.c24a738c-e90d-4df0-a86d-4c10d97b3acc Sep 04 18:12:26 devstack sudo[108045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:27 devstack sudo[108045]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a9a1a7c1-32cd-4d81-8ead-f4864904da3b tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6d5e34bf-c526-4cc8-84ed-3da98906948b.c24a738c-e90d-4df0-a86d-4c10d97b3acc" returned: 0 in 0.337s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a9a1a7c1-32cd-4d81-8ead-f4864904da3b tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6d5e34bf-c526-4cc8-84ed-3da98906948b.c24a738c-e90d-4df0-a86d-4c10d97b3acc {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:27 devstack sudo[108051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6d5e34bf-c526-4cc8-84ed-3da98906948b.c24a738c-e90d-4df0-a86d-4c10d97b3acc Sep 04 18:12:27 devstack sudo[108051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:27 devstack sudo[108051]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:27 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a9a1a7c1-32cd-4d81-8ead-f4864904da3b tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6d5e34bf-c526-4cc8-84ed-3da98906948b.c24a738c-e90d-4df0-a86d-4c10d97b3acc" returned: 0 in 0.251s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:27 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a9a1a7c1-32cd-4d81-8ead-f4864904da3b tempest-ProjectMemberTests-488731474 None] Lock "cinder-quobyte-c24a738c-e90d-4df0-a86d-4c10d97b3acc" released by "_delete_snapshot" :: held 1.353s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:12:27 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a9a1a7c1-32cd-4d81-8ead-f4864904da3b tempest-ProjectMemberTests-488731474 None] Lock "cinder-quobyte-6d5e34bf-c526-4cc8-84ed-3da98906948b" released by "delete_snapshot" :: held 1.374s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:12:27 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-a9a1a7c1-32cd-4d81-8ead-f4864904da3b tempest-ProjectMemberTests-488731474 None] Created reservations ['7efcf618-6fa2-4920-a1f9-64e32a440cb3', 'ac27c81f-9bce-4cdc-8467-541dc303ad1f', 'f250d0aa-b2e2-4830-8be9-ab0276458be5', '56645f9f-2440-45c8-aaeb-c25d96c9c4d6'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:12:27 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-a9a1a7c1-32cd-4d81-8ead-f4864904da3b tempest-ProjectMemberTests-488731474 None] Delete snapshot completed successfully. Sep 04 18:12:27 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-a9a1a7c1-32cd-4d81-8ead-f4864904da3b tempest-ProjectMemberTests-488731474 None] Lock "cinder-c24a738c-e90d-4df0-a86d-4c10d97b3acc-delete_snapshot" released by "delete_snapshot" :: held 1.517s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:12:28 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-05249558-1e78-45d5-a8c9-8858092034a8 tempest-ProjectMemberTests-488731474 None] Acquiring lock "cinder-6d5e34bf-c526-4cc8-84ed-3da98906948b-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:12:28 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-05249558-1e78-45d5-a8c9-8858092034a8 tempest-ProjectMemberTests-488731474 None] Lock "cinder-6d5e34bf-c526-4cc8-84ed-3da98906948b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:12:28 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-05249558-1e78-45d5-a8c9-8858092034a8 tempest-ProjectMemberTests-488731474 None] Acquiring lock "cinder-quobyte-6d5e34bf-c526-4cc8-84ed-3da98906948b" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:12:28 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-05249558-1e78-45d5-a8c9-8858092034a8 tempest-ProjectMemberTests-488731474 None] Lock "cinder-quobyte-6d5e34bf-c526-4cc8-84ed-3da98906948b" acquired by "delete_volume" :: waited 0.014s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:12:28 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6030dec-2eee-4d02-bf31-1e5cc072a96b]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:12:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-05249558-1e78-45d5-a8c9-8858092034a8 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6d5e34bf-c526-4cc8-84ed-3da98906948b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:28 devstack sudo[108054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6d5e34bf-c526-4cc8-84ed-3da98906948b Sep 04 18:12:28 devstack sudo[108054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:28 devstack sudo[108054]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-05249558-1e78-45d5-a8c9-8858092034a8 tempest-ProjectMemberTests-488731474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6d5e34bf-c526-4cc8-84ed-3da98906948b" returned: 0 in 0.357s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-05249558-1e78-45d5-a8c9-8858092034a8 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6d5e34bf-c526-4cc8-84ed-3da98906948b {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:28 devstack sudo[108059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6d5e34bf-c526-4cc8-84ed-3da98906948b Sep 04 18:12:28 devstack sudo[108059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:28 devstack sudo[108059]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:28 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-05249558-1e78-45d5-a8c9-8858092034a8 tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-6d5e34bf-c526-4cc8-84ed-3da98906948b" returned: 0 in 0.250s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:29 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-05249558-1e78-45d5-a8c9-8858092034a8 tempest-ProjectMemberTests-488731474 None] Lock "cinder-quobyte-6d5e34bf-c526-4cc8-84ed-3da98906948b" released by "delete_volume" :: held 0.668s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:12:29 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-05249558-1e78-45d5-a8c9-8858092034a8 tempest-ProjectMemberTests-488731474 None] Created reservations ['f9a4ccb5-e5d7-4d20-897a-e19e2811a639', 'fbfae7e4-6221-41c9-b2dd-860a683e883d', 'dd70c004-b075-4ebb-bd29-68344c462a19', '459963d1-2d66-405d-af53-743a485727f0'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:12:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-05249558-1e78-45d5-a8c9-8858092034a8 tempest-ProjectMemberTests-488731474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:12:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-05249558-1e78-45d5-a8c9-8858092034a8 tempest-ProjectMemberTests-488731474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:12:29 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-05249558-1e78-45d5-a8c9-8858092034a8 tempest-ProjectMemberTests-488731474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:12:29 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-05249558-1e78-45d5-a8c9-8858092034a8 tempest-ProjectMemberTests-488731474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:12:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-05249558-1e78-45d5-a8c9-8858092034a8 tempest-ProjectMemberTests-488731474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:12:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-05249558-1e78-45d5-a8c9-8858092034a8 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:29 devstack sudo[108062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:12:29 devstack sudo[108062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:29 devstack sudo[108062]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-05249558-1e78-45d5-a8c9-8858092034a8 tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.264s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:29 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-05249558-1e78-45d5-a8c9-8858092034a8 tempest-ProjectMemberTests-488731474 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:12:29 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-05249558-1e78-45d5-a8c9-8858092034a8 tempest-ProjectMemberTests-488731474 None] Deleted volume successfully. Sep 04 18:12:29 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-05249558-1e78-45d5-a8c9-8858092034a8 tempest-ProjectMemberTests-488731474 None] Lock "cinder-6d5e34bf-c526-4cc8-84ed-3da98906948b-delete_volume" released by "delete_volume" :: held 1.140s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:12:29 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-920f3be5-7d5a-4cda-b9cf-9347ccdfc20f tempest-ProjectMemberTests-488731474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:12:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-920f3be5-7d5a-4cda-b9cf-9347ccdfc20f tempest-ProjectMemberTests-488731474 None] Flow 'volume_create_manager' (5c375c22-053d-440e-8c56-8ad594a8f526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:12:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-920f3be5-7d5a-4cda-b9cf-9347ccdfc20f tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f57fa158-f1e1-44c8-ac92-f384bb62117e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:12:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-920f3be5-7d5a-4cda-b9cf-9347ccdfc20f tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f57fa158-f1e1-44c8-ac92-f384bb62117e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:12:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-879477714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47cbb5fc-0063-4885-9f46-8889895edb29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b5af8d2d70740348028c34578cb1393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:12:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:12:30Z,use_quota=True,user_id='21f3365c7a9a490387324872cde069aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:12:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-920f3be5-7d5a-4cda-b9cf-9347ccdfc20f tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c35be78e-42fe-4dce-a01d-c20178be5368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:12:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-920f3be5-7d5a-4cda-b9cf-9347ccdfc20f tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c35be78e-42fe-4dce-a01d-c20178be5368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:12:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-920f3be5-7d5a-4cda-b9cf-9347ccdfc20f tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a099dcee-9dc5-421c-a9ed-444b077c5dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:12:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-920f3be5-7d5a-4cda-b9cf-9347ccdfc20f tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a099dcee-9dc5-421c-a9ed-444b077c5dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47cbb5fc-0063-4885-9f46-8889895edb29', 'volume_name': 'volume-47cbb5fc-0063-4885-9f46-8889895edb29', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:12:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-920f3be5-7d5a-4cda-b9cf-9347ccdfc20f tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33a2cfa8-be79-4eef-916c-ac25d1f00815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:12:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-920f3be5-7d5a-4cda-b9cf-9347ccdfc20f tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33a2cfa8-be79-4eef-916c-ac25d1f00815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:12:29 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-920f3be5-7d5a-4cda-b9cf-9347ccdfc20f tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37484e99-7458-41bc-a929-179941a696a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:12:29 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-920f3be5-7d5a-4cda-b9cf-9347ccdfc20f tempest-ProjectMemberTests-488731474 None] Volume 47cbb5fc-0063-4885-9f46-8889895edb29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47cbb5fc-0063-4885-9f46-8889895edb29', 'volume_size': 1} Sep 04 18:12:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-920f3be5-7d5a-4cda-b9cf-9347ccdfc20f tempest-ProjectMemberTests-488731474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:12:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-920f3be5-7d5a-4cda-b9cf-9347ccdfc20f tempest-ProjectMemberTests-488731474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:12:29 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-920f3be5-7d5a-4cda-b9cf-9347ccdfc20f tempest-ProjectMemberTests-488731474 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:12:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-879477714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47cbb5fc-0063-4885-9f46-8889895edb29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b5af8d2d70740348028c34578cb1393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:12:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:12:30Z,use_quota=True,user_id='21f3365c7a9a490387324872cde069aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:12:29 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-920f3be5-7d5a-4cda-b9cf-9347ccdfc20f tempest-ProjectMemberTests-488731474 None] Creating volume 47cbb5fc-0063-4885-9f46-8889895edb29 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:12:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-920f3be5-7d5a-4cda-b9cf-9347ccdfc20f tempest-ProjectMemberTests-488731474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:12:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-920f3be5-7d5a-4cda-b9cf-9347ccdfc20f tempest-ProjectMemberTests-488731474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:12:29 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-920f3be5-7d5a-4cda-b9cf-9347ccdfc20f tempest-ProjectMemberTests-488731474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:12:29 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-920f3be5-7d5a-4cda-b9cf-9347ccdfc20f tempest-ProjectMemberTests-488731474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:12:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-920f3be5-7d5a-4cda-b9cf-9347ccdfc20f tempest-ProjectMemberTests-488731474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:12:29 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-920f3be5-7d5a-4cda-b9cf-9347ccdfc20f tempest-ProjectMemberTests-488731474 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:12:29 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-920f3be5-7d5a-4cda-b9cf-9347ccdfc20f tempest-ProjectMemberTests-488731474 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:12:29 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-920f3be5-7d5a-4cda-b9cf-9347ccdfc20f tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-47cbb5fc-0063-4885-9f46-8889895edb29 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:29 devstack sudo[108065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-47cbb5fc-0063-4885-9f46-8889895edb29 1073741824 Sep 04 18:12:29 devstack sudo[108065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:30 devstack sudo[108065]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-920f3be5-7d5a-4cda-b9cf-9347ccdfc20f tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-47cbb5fc-0063-4885-9f46-8889895edb29 1073741824" returned: 0 in 0.410s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-920f3be5-7d5a-4cda-b9cf-9347ccdfc20f tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-47cbb5fc-0063-4885-9f46-8889895edb29 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:30 devstack sudo[108071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-47cbb5fc-0063-4885-9f46-8889895edb29 Sep 04 18:12:30 devstack sudo[108071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:30 devstack sudo[108071]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-920f3be5-7d5a-4cda-b9cf-9347ccdfc20f tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-47cbb5fc-0063-4885-9f46-8889895edb29" returned: 0 in 0.246s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:30 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-920f3be5-7d5a-4cda-b9cf-9347ccdfc20f tempest-ProjectMemberTests-488731474 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:12:30 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-920f3be5-7d5a-4cda-b9cf-9347ccdfc20f tempest-ProjectMemberTests-488731474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:12:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-920f3be5-7d5a-4cda-b9cf-9347ccdfc20f tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37484e99-7458-41bc-a929-179941a696a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47cbb5fc-0063-4885-9f46-8889895edb29', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:12:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-920f3be5-7d5a-4cda-b9cf-9347ccdfc20f tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (028032c0-a633-4e1a-8396-93589f96b8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:12:30 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-920f3be5-7d5a-4cda-b9cf-9347ccdfc20f tempest-ProjectMemberTests-488731474 None] Volume volume-47cbb5fc-0063-4885-9f46-8889895edb29 (47cbb5fc-0063-4885-9f46-8889895edb29): created successfully Sep 04 18:12:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-920f3be5-7d5a-4cda-b9cf-9347ccdfc20f tempest-ProjectMemberTests-488731474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (028032c0-a633-4e1a-8396-93589f96b8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:12:30 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-920f3be5-7d5a-4cda-b9cf-9347ccdfc20f tempest-ProjectMemberTests-488731474 None] Flow 'volume_create_manager' (5c375c22-053d-440e-8c56-8ad594a8f526) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:12:30 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-920f3be5-7d5a-4cda-b9cf-9347ccdfc20f tempest-ProjectMemberTests-488731474 None] Created volume successfully. Sep 04 18:12:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f7bdf45c-2cd6-4f92-8b02-071519e78812 tempest-ProjectMemberTests-488731474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:12:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f7bdf45c-2cd6-4f92-8b02-071519e78812 tempest-ProjectMemberTests-488731474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:12:31 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-f7bdf45c-2cd6-4f92-8b02-071519e78812 tempest-ProjectMemberTests-488731474 None] Creating offline snapshot da1535e8-6057-4c86-8ef0-32ae279e0135 of volume 47cbb5fc-0063-4885-9f46-8889895edb29 {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 18:12:31 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd8645b-7710-48f9-b1ba-5c30fee1ee73]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:12:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f7bdf45c-2cd6-4f92-8b02-071519e78812 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-47cbb5fc-0063-4885-9f46-8889895edb29 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:31 devstack sudo[108074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-47cbb5fc-0063-4885-9f46-8889895edb29 Sep 04 18:12:31 devstack sudo[108074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:31 devstack sudo[108074]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f7bdf45c-2cd6-4f92-8b02-071519e78812 tempest-ProjectMemberTests-488731474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-47cbb5fc-0063-4885-9f46-8889895edb29" returned: 0 in 0.372s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f7bdf45c-2cd6-4f92-8b02-071519e78812 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-47cbb5fc-0063-4885-9f46-8889895edb29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-47cbb5fc-0063-4885-9f46-8889895edb29.da1535e8-6057-4c86-8ef0-32ae279e0135 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:31 devstack sudo[108079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-47cbb5fc-0063-4885-9f46-8889895edb29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-47cbb5fc-0063-4885-9f46-8889895edb29.da1535e8-6057-4c86-8ef0-32ae279e0135 1G Sep 04 18:12:31 devstack sudo[108079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:31 devstack sudo[108079]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f7bdf45c-2cd6-4f92-8b02-071519e78812 tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-47cbb5fc-0063-4885-9f46-8889895edb29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-47cbb5fc-0063-4885-9f46-8889895edb29.da1535e8-6057-4c86-8ef0-32ae279e0135 1G" returned: 0 in 0.396s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:31 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f7bdf45c-2cd6-4f92-8b02-071519e78812 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47cbb5fc-0063-4885-9f46-8889895edb29 -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-47cbb5fc-0063-4885-9f46-8889895edb29.da1535e8-6057-4c86-8ef0-32ae279e0135 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:31 devstack sudo[108084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47cbb5fc-0063-4885-9f46-8889895edb29 -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-47cbb5fc-0063-4885-9f46-8889895edb29.da1535e8-6057-4c86-8ef0-32ae279e0135 Sep 04 18:12:31 devstack sudo[108084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:32 devstack sudo[108084]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f7bdf45c-2cd6-4f92-8b02-071519e78812 tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47cbb5fc-0063-4885-9f46-8889895edb29 -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-47cbb5fc-0063-4885-9f46-8889895edb29.da1535e8-6057-4c86-8ef0-32ae279e0135" returned: 0 in 0.292s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:32 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-f7bdf45c-2cd6-4f92-8b02-071519e78812 tempest-ProjectMemberTests-488731474 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-47cbb5fc-0063-4885-9f46-8889895edb29.da1535e8-6057-4c86-8ef0-32ae279e0135 is being set with open permissions: ugo+rw Sep 04 18:12:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f7bdf45c-2cd6-4f92-8b02-071519e78812 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-47cbb5fc-0063-4885-9f46-8889895edb29.da1535e8-6057-4c86-8ef0-32ae279e0135 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:32 devstack sudo[108089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-47cbb5fc-0063-4885-9f46-8889895edb29.da1535e8-6057-4c86-8ef0-32ae279e0135 Sep 04 18:12:32 devstack sudo[108089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:32 devstack sudo[108089]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f7bdf45c-2cd6-4f92-8b02-071519e78812 tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-47cbb5fc-0063-4885-9f46-8889895edb29.da1535e8-6057-4c86-8ef0-32ae279e0135" returned: 0 in 0.249s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f7bdf45c-2cd6-4f92-8b02-071519e78812 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-47cbb5fc-0063-4885-9f46-8889895edb29.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:32 devstack sudo[108092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-47cbb5fc-0063-4885-9f46-8889895edb29.info Sep 04 18:12:32 devstack sudo[108092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:32 devstack sudo[108092]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f7bdf45c-2cd6-4f92-8b02-071519e78812 tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-47cbb5fc-0063-4885-9f46-8889895edb29.info" returned: 0 in 0.253s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:32 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-f7bdf45c-2cd6-4f92-8b02-071519e78812 tempest-ProjectMemberTests-488731474 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-47cbb5fc-0063-4885-9f46-8889895edb29.info is being set with open permissions: ugo+rw Sep 04 18:12:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f7bdf45c-2cd6-4f92-8b02-071519e78812 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-47cbb5fc-0063-4885-9f46-8889895edb29.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:32 devstack sudo[108095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-47cbb5fc-0063-4885-9f46-8889895edb29.info Sep 04 18:12:32 devstack sudo[108095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:32 devstack sudo[108095]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f7bdf45c-2cd6-4f92-8b02-071519e78812 tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-47cbb5fc-0063-4885-9f46-8889895edb29.info" returned: 0 in 0.243s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:32 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f7bdf45c-2cd6-4f92-8b02-071519e78812 tempest-ProjectMemberTests-488731474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.893s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:12:32 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-f7bdf45c-2cd6-4f92-8b02-071519e78812 tempest-ProjectMemberTests-488731474 None] Create snapshot completed successfully Sep 04 18:12:33 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9628dd2b-df0c-429a-8a32-70b8cbd12fb9 tempest-ProjectMemberTests-488731474 None] Acquiring lock "cinder-da1535e8-6057-4c86-8ef0-32ae279e0135-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:12:33 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9628dd2b-df0c-429a-8a32-70b8cbd12fb9 tempest-ProjectMemberTests-488731474 None] Lock "cinder-da1535e8-6057-4c86-8ef0-32ae279e0135-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:12:33 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9628dd2b-df0c-429a-8a32-70b8cbd12fb9 tempest-ProjectMemberTests-488731474 None] Acquiring lock "cinder-quobyte-47cbb5fc-0063-4885-9f46-8889895edb29" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:12:33 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9628dd2b-df0c-429a-8a32-70b8cbd12fb9 tempest-ProjectMemberTests-488731474 None] Lock "cinder-quobyte-47cbb5fc-0063-4885-9f46-8889895edb29" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:12:33 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9628dd2b-df0c-429a-8a32-70b8cbd12fb9 tempest-ProjectMemberTests-488731474 None] Acquiring lock "cinder-quobyte-da1535e8-6057-4c86-8ef0-32ae279e0135" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:12:33 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9628dd2b-df0c-429a-8a32-70b8cbd12fb9 tempest-ProjectMemberTests-488731474 None] Lock "cinder-quobyte-da1535e8-6057-4c86-8ef0-32ae279e0135" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:12:33 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-9628dd2b-df0c-429a-8a32-70b8cbd12fb9 tempest-ProjectMemberTests-488731474 None] Deleting offline snapshot da1535e8-6057-4c86-8ef0-32ae279e0135 of volume 47cbb5fc-0063-4885-9f46-8889895edb29 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 18:12:33 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-9628dd2b-df0c-429a-8a32-70b8cbd12fb9 tempest-ProjectMemberTests-488731474 None] snapshot_file for this snap is: volume-47cbb5fc-0063-4885-9f46-8889895edb29.da1535e8-6057-4c86-8ef0-32ae279e0135 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 18:12:33 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ef50df-4821-430c-8941-b91e3fd51ae8]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:12:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9628dd2b-df0c-429a-8a32-70b8cbd12fb9 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-47cbb5fc-0063-4885-9f46-8889895edb29.da1535e8-6057-4c86-8ef0-32ae279e0135 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:33 devstack sudo[108098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-47cbb5fc-0063-4885-9f46-8889895edb29.da1535e8-6057-4c86-8ef0-32ae279e0135 Sep 04 18:12:33 devstack sudo[108098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:33 devstack sudo[108098]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9628dd2b-df0c-429a-8a32-70b8cbd12fb9 tempest-ProjectMemberTests-488731474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-47cbb5fc-0063-4885-9f46-8889895edb29.da1535e8-6057-4c86-8ef0-32ae279e0135" returned: 0 in 0.353s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:33 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-9628dd2b-df0c-429a-8a32-70b8cbd12fb9 tempest-ProjectMemberTests-488731474 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47cbb5fc-0063-4885-9f46-8889895edb29(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 18:12:33 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[04430ee5-3bea-4dcf-8eca-4dabad522bdb]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:12:33 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9628dd2b-df0c-429a-8a32-70b8cbd12fb9 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-47cbb5fc-0063-4885-9f46-8889895edb29 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:33 devstack sudo[108103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-47cbb5fc-0063-4885-9f46-8889895edb29 Sep 04 18:12:33 devstack sudo[108103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:34 devstack sudo[108103]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9628dd2b-df0c-429a-8a32-70b8cbd12fb9 tempest-ProjectMemberTests-488731474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-47cbb5fc-0063-4885-9f46-8889895edb29" returned: 0 in 0.346s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9628dd2b-df0c-429a-8a32-70b8cbd12fb9 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-47cbb5fc-0063-4885-9f46-8889895edb29.da1535e8-6057-4c86-8ef0-32ae279e0135 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:34 devstack sudo[108109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-47cbb5fc-0063-4885-9f46-8889895edb29.da1535e8-6057-4c86-8ef0-32ae279e0135 Sep 04 18:12:34 devstack sudo[108109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:34 devstack sudo[108109]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9628dd2b-df0c-429a-8a32-70b8cbd12fb9 tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-47cbb5fc-0063-4885-9f46-8889895edb29.da1535e8-6057-4c86-8ef0-32ae279e0135" returned: 0 in 0.327s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9628dd2b-df0c-429a-8a32-70b8cbd12fb9 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-47cbb5fc-0063-4885-9f46-8889895edb29.da1535e8-6057-4c86-8ef0-32ae279e0135 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:34 devstack sudo[108114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-47cbb5fc-0063-4885-9f46-8889895edb29.da1535e8-6057-4c86-8ef0-32ae279e0135 Sep 04 18:12:34 devstack sudo[108114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:34 devstack sudo[108114]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:34 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-9628dd2b-df0c-429a-8a32-70b8cbd12fb9 tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-47cbb5fc-0063-4885-9f46-8889895edb29.da1535e8-6057-4c86-8ef0-32ae279e0135" returned: 0 in 0.239s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:34 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9628dd2b-df0c-429a-8a32-70b8cbd12fb9 tempest-ProjectMemberTests-488731474 None] Lock "cinder-quobyte-da1535e8-6057-4c86-8ef0-32ae279e0135" released by "_delete_snapshot" :: held 1.353s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:12:34 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9628dd2b-df0c-429a-8a32-70b8cbd12fb9 tempest-ProjectMemberTests-488731474 None] Lock "cinder-quobyte-47cbb5fc-0063-4885-9f46-8889895edb29" released by "delete_snapshot" :: held 1.373s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:12:34 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-9628dd2b-df0c-429a-8a32-70b8cbd12fb9 tempest-ProjectMemberTests-488731474 None] Created reservations ['7a3b5198-0e3c-4297-9d2e-cb9fece86304', 'a465edf4-d050-4520-bc8e-390e6df52788', '90c47e30-42c9-4efc-8430-3fe15cf82fc5', 'a312ac71-4493-4895-94d3-4aa5fc3d4a4a'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:12:34 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-9628dd2b-df0c-429a-8a32-70b8cbd12fb9 tempest-ProjectMemberTests-488731474 None] Delete snapshot completed successfully. Sep 04 18:12:34 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-9628dd2b-df0c-429a-8a32-70b8cbd12fb9 tempest-ProjectMemberTests-488731474 None] Lock "cinder-da1535e8-6057-4c86-8ef0-32ae279e0135-delete_snapshot" released by "delete_snapshot" :: held 1.506s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:12:35 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3cfab5ce-c7d0-4357-a70c-077639b4cde6 tempest-ProjectMemberTests-488731474 None] Acquiring lock "cinder-47cbb5fc-0063-4885-9f46-8889895edb29-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:12:35 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3cfab5ce-c7d0-4357-a70c-077639b4cde6 tempest-ProjectMemberTests-488731474 None] Lock "cinder-47cbb5fc-0063-4885-9f46-8889895edb29-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:12:35 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3cfab5ce-c7d0-4357-a70c-077639b4cde6 tempest-ProjectMemberTests-488731474 None] Acquiring lock "cinder-quobyte-47cbb5fc-0063-4885-9f46-8889895edb29" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:12:35 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3cfab5ce-c7d0-4357-a70c-077639b4cde6 tempest-ProjectMemberTests-488731474 None] Lock "cinder-quobyte-47cbb5fc-0063-4885-9f46-8889895edb29" acquired by "delete_volume" :: waited 0.017s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:12:35 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[72082dcf-7e67-4058-99b5-b84e9c9c43ab]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:12:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3cfab5ce-c7d0-4357-a70c-077639b4cde6 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-47cbb5fc-0063-4885-9f46-8889895edb29 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:35 devstack sudo[108117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-47cbb5fc-0063-4885-9f46-8889895edb29 Sep 04 18:12:35 devstack sudo[108117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:35 devstack sudo[108117]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3cfab5ce-c7d0-4357-a70c-077639b4cde6 tempest-ProjectMemberTests-488731474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-47cbb5fc-0063-4885-9f46-8889895edb29" returned: 0 in 0.402s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:35 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3cfab5ce-c7d0-4357-a70c-077639b4cde6 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-47cbb5fc-0063-4885-9f46-8889895edb29 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:35 devstack sudo[108122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-47cbb5fc-0063-4885-9f46-8889895edb29 Sep 04 18:12:35 devstack sudo[108122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:36 devstack sudo[108122]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3cfab5ce-c7d0-4357-a70c-077639b4cde6 tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-47cbb5fc-0063-4885-9f46-8889895edb29" returned: 0 in 0.242s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:36 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3cfab5ce-c7d0-4357-a70c-077639b4cde6 tempest-ProjectMemberTests-488731474 None] Lock "cinder-quobyte-47cbb5fc-0063-4885-9f46-8889895edb29" released by "delete_volume" :: held 0.698s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:12:36 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-3cfab5ce-c7d0-4357-a70c-077639b4cde6 tempest-ProjectMemberTests-488731474 None] Created reservations ['ae6ecfd0-2808-4b12-a0d6-deae611a3b25', '32e31fe4-bac7-4f30-958a-00cc98366eae', '982df75b-3cdf-4f4c-be73-efdd0e1d9083', 'e7f1e292-f1c4-45c2-81dc-493bbb9bcf41'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:12:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3cfab5ce-c7d0-4357-a70c-077639b4cde6 tempest-ProjectMemberTests-488731474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:12:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3cfab5ce-c7d0-4357-a70c-077639b4cde6 tempest-ProjectMemberTests-488731474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:12:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-3cfab5ce-c7d0-4357-a70c-077639b4cde6 tempest-ProjectMemberTests-488731474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:12:36 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-3cfab5ce-c7d0-4357-a70c-077639b4cde6 tempest-ProjectMemberTests-488731474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:12:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3cfab5ce-c7d0-4357-a70c-077639b4cde6 tempest-ProjectMemberTests-488731474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:12:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3cfab5ce-c7d0-4357-a70c-077639b4cde6 tempest-ProjectMemberTests-488731474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:36 devstack sudo[108125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:12:36 devstack sudo[108125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:36 devstack sudo[108125]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:36 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3cfab5ce-c7d0-4357-a70c-077639b4cde6 tempest-ProjectMemberTests-488731474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.246s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:36 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-3cfab5ce-c7d0-4357-a70c-077639b4cde6 tempest-ProjectMemberTests-488731474 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:12:36 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-3cfab5ce-c7d0-4357-a70c-077639b4cde6 tempest-ProjectMemberTests-488731474 None] Deleted volume successfully. Sep 04 18:12:36 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3cfab5ce-c7d0-4357-a70c-077639b4cde6 tempest-ProjectMemberTests-488731474 None] Lock "cinder-47cbb5fc-0063-4885-9f46-8889895edb29-delete_volume" released by "delete_volume" :: held 1.153s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:12:40 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8aa98da-9464-4121-b3de-ad093f045d52 tempest-ProjectReaderTests-1030742843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:12:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b8aa98da-9464-4121-b3de-ad093f045d52 tempest-ProjectReaderTests-1030742843 None] Flow 'volume_create_manager' (3dd70548-6a2a-48aa-9434-0787cd664e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:12:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b8aa98da-9464-4121-b3de-ad093f045d52 tempest-ProjectReaderTests-1030742843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0333b6ed-02ad-4362-876c-bcfeaa5bd6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:12:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b8aa98da-9464-4121-b3de-ad093f045d52 tempest-ProjectReaderTests-1030742843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0333b6ed-02ad-4362-876c-bcfeaa5bd6c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:12:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-565170383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e2732c0-89d6-472a-b7f2-b5eeb3189a7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25f84d71b6db4272853e1c3fe5986eb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:12:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:12:40Z,use_quota=True,user_id='a9c3bac0753c42c8a9ee10b4d904a664',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:12:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b8aa98da-9464-4121-b3de-ad093f045d52 tempest-ProjectReaderTests-1030742843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7676273e-2188-483e-a7f3-dcc500963341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:12:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b8aa98da-9464-4121-b3de-ad093f045d52 tempest-ProjectReaderTests-1030742843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7676273e-2188-483e-a7f3-dcc500963341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:12:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b8aa98da-9464-4121-b3de-ad093f045d52 tempest-ProjectReaderTests-1030742843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99195de4-de25-4b8d-baa7-7da359ee9d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:12:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b8aa98da-9464-4121-b3de-ad093f045d52 tempest-ProjectReaderTests-1030742843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99195de4-de25-4b8d-baa7-7da359ee9d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e2732c0-89d6-472a-b7f2-b5eeb3189a7f', 'volume_name': 'volume-2e2732c0-89d6-472a-b7f2-b5eeb3189a7f', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:12:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b8aa98da-9464-4121-b3de-ad093f045d52 tempest-ProjectReaderTests-1030742843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce99faa2-4166-4062-8b8b-c002402556f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:12:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b8aa98da-9464-4121-b3de-ad093f045d52 tempest-ProjectReaderTests-1030742843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce99faa2-4166-4062-8b8b-c002402556f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:12:40 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b8aa98da-9464-4121-b3de-ad093f045d52 tempest-ProjectReaderTests-1030742843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92ce2100-0bd4-4f5e-ae10-27f460788dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:12:40 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-b8aa98da-9464-4121-b3de-ad093f045d52 tempest-ProjectReaderTests-1030742843 None] Volume 2e2732c0-89d6-472a-b7f2-b5eeb3189a7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e2732c0-89d6-472a-b7f2-b5eeb3189a7f', 'volume_size': 1} Sep 04 18:12:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b8aa98da-9464-4121-b3de-ad093f045d52 tempest-ProjectReaderTests-1030742843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:12:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b8aa98da-9464-4121-b3de-ad093f045d52 tempest-ProjectReaderTests-1030742843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:12:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b8aa98da-9464-4121-b3de-ad093f045d52 tempest-ProjectReaderTests-1030742843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:12:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-565170383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e2732c0-89d6-472a-b7f2-b5eeb3189a7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25f84d71b6db4272853e1c3fe5986eb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:12:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:12:40Z,use_quota=True,user_id='a9c3bac0753c42c8a9ee10b4d904a664',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:12:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-b8aa98da-9464-4121-b3de-ad093f045d52 tempest-ProjectReaderTests-1030742843 None] Creating volume 2e2732c0-89d6-472a-b7f2-b5eeb3189a7f {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:12:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b8aa98da-9464-4121-b3de-ad093f045d52 tempest-ProjectReaderTests-1030742843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:12:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b8aa98da-9464-4121-b3de-ad093f045d52 tempest-ProjectReaderTests-1030742843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:12:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b8aa98da-9464-4121-b3de-ad093f045d52 tempest-ProjectReaderTests-1030742843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:12:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b8aa98da-9464-4121-b3de-ad093f045d52 tempest-ProjectReaderTests-1030742843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:12:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b8aa98da-9464-4121-b3de-ad093f045d52 tempest-ProjectReaderTests-1030742843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:12:40 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b8aa98da-9464-4121-b3de-ad093f045d52 tempest-ProjectReaderTests-1030742843 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:12:40 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-b8aa98da-9464-4121-b3de-ad093f045d52 tempest-ProjectReaderTests-1030742843 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:12:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b8aa98da-9464-4121-b3de-ad093f045d52 tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2e2732c0-89d6-472a-b7f2-b5eeb3189a7f 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:40 devstack sudo[108129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2e2732c0-89d6-472a-b7f2-b5eeb3189a7f 1073741824 Sep 04 18:12:40 devstack sudo[108129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:40 devstack sudo[108129]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b8aa98da-9464-4121-b3de-ad093f045d52 tempest-ProjectReaderTests-1030742843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2e2732c0-89d6-472a-b7f2-b5eeb3189a7f 1073741824" returned: 0 in 0.394s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:40 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b8aa98da-9464-4121-b3de-ad093f045d52 tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2e2732c0-89d6-472a-b7f2-b5eeb3189a7f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:40 devstack sudo[108134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2e2732c0-89d6-472a-b7f2-b5eeb3189a7f Sep 04 18:12:40 devstack sudo[108134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:41 devstack sudo[108134]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-b8aa98da-9464-4121-b3de-ad093f045d52 tempest-ProjectReaderTests-1030742843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2e2732c0-89d6-472a-b7f2-b5eeb3189a7f" returned: 0 in 0.238s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:41 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-b8aa98da-9464-4121-b3de-ad093f045d52 tempest-ProjectReaderTests-1030742843 None] <== create_volume: return (668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:12:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-b8aa98da-9464-4121-b3de-ad093f045d52 tempest-ProjectReaderTests-1030742843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.671s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:12:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b8aa98da-9464-4121-b3de-ad093f045d52 tempest-ProjectReaderTests-1030742843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92ce2100-0bd4-4f5e-ae10-27f460788dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e2732c0-89d6-472a-b7f2-b5eeb3189a7f', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:12:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b8aa98da-9464-4121-b3de-ad093f045d52 tempest-ProjectReaderTests-1030742843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7741e5da-3b02-4a90-987d-e50580eccf78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:12:41 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-b8aa98da-9464-4121-b3de-ad093f045d52 tempest-ProjectReaderTests-1030742843 None] Volume volume-2e2732c0-89d6-472a-b7f2-b5eeb3189a7f (2e2732c0-89d6-472a-b7f2-b5eeb3189a7f): created successfully Sep 04 18:12:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b8aa98da-9464-4121-b3de-ad093f045d52 tempest-ProjectReaderTests-1030742843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7741e5da-3b02-4a90-987d-e50580eccf78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:12:41 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-b8aa98da-9464-4121-b3de-ad093f045d52 tempest-ProjectReaderTests-1030742843 None] Flow 'volume_create_manager' (3dd70548-6a2a-48aa-9434-0787cd664e8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:12:41 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-b8aa98da-9464-4121-b3de-ad093f045d52 tempest-ProjectReaderTests-1030742843 None] Created volume successfully. Sep 04 18:12:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e292dc30-0edb-43f3-9951-e04f895f5ab9 tempest-ProjectReaderTests-1030742843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:12:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e292dc30-0edb-43f3-9951-e04f895f5ab9 tempest-ProjectReaderTests-1030742843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:12:41 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-e292dc30-0edb-43f3-9951-e04f895f5ab9 tempest-ProjectReaderTests-1030742843 None] Creating offline snapshot cf6911b8-14bc-4163-ad5f-6013af940e2e of volume 2e2732c0-89d6-472a-b7f2-b5eeb3189a7f {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 18:12:41 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae20d2e-0b25-44d7-942b-44d204ff59cb]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:12:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e292dc30-0edb-43f3-9951-e04f895f5ab9 tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2e2732c0-89d6-472a-b7f2-b5eeb3189a7f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:41 devstack sudo[108137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2e2732c0-89d6-472a-b7f2-b5eeb3189a7f Sep 04 18:12:41 devstack sudo[108137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:41 devstack sudo[108137]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e292dc30-0edb-43f3-9951-e04f895f5ab9 tempest-ProjectReaderTests-1030742843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2e2732c0-89d6-472a-b7f2-b5eeb3189a7f" returned: 0 in 0.344s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:41 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e292dc30-0edb-43f3-9951-e04f895f5ab9 tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2e2732c0-89d6-472a-b7f2-b5eeb3189a7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2e2732c0-89d6-472a-b7f2-b5eeb3189a7f.cf6911b8-14bc-4163-ad5f-6013af940e2e 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:41 devstack sudo[108142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2e2732c0-89d6-472a-b7f2-b5eeb3189a7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2e2732c0-89d6-472a-b7f2-b5eeb3189a7f.cf6911b8-14bc-4163-ad5f-6013af940e2e 1G Sep 04 18:12:41 devstack sudo[108142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:42 devstack sudo[108142]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e292dc30-0edb-43f3-9951-e04f895f5ab9 tempest-ProjectReaderTests-1030742843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2e2732c0-89d6-472a-b7f2-b5eeb3189a7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2e2732c0-89d6-472a-b7f2-b5eeb3189a7f.cf6911b8-14bc-4163-ad5f-6013af940e2e 1G" returned: 0 in 0.379s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e292dc30-0edb-43f3-9951-e04f895f5ab9 tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e2732c0-89d6-472a-b7f2-b5eeb3189a7f -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2e2732c0-89d6-472a-b7f2-b5eeb3189a7f.cf6911b8-14bc-4163-ad5f-6013af940e2e {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:42 devstack sudo[108147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e2732c0-89d6-472a-b7f2-b5eeb3189a7f -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2e2732c0-89d6-472a-b7f2-b5eeb3189a7f.cf6911b8-14bc-4163-ad5f-6013af940e2e Sep 04 18:12:42 devstack sudo[108147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:42 devstack sudo[108147]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e292dc30-0edb-43f3-9951-e04f895f5ab9 tempest-ProjectReaderTests-1030742843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e2732c0-89d6-472a-b7f2-b5eeb3189a7f -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2e2732c0-89d6-472a-b7f2-b5eeb3189a7f.cf6911b8-14bc-4163-ad5f-6013af940e2e" returned: 0 in 0.280s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:42 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-e292dc30-0edb-43f3-9951-e04f895f5ab9 tempest-ProjectReaderTests-1030742843 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2e2732c0-89d6-472a-b7f2-b5eeb3189a7f.cf6911b8-14bc-4163-ad5f-6013af940e2e is being set with open permissions: ugo+rw Sep 04 18:12:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e292dc30-0edb-43f3-9951-e04f895f5ab9 tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2e2732c0-89d6-472a-b7f2-b5eeb3189a7f.cf6911b8-14bc-4163-ad5f-6013af940e2e {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:42 devstack sudo[108152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2e2732c0-89d6-472a-b7f2-b5eeb3189a7f.cf6911b8-14bc-4163-ad5f-6013af940e2e Sep 04 18:12:42 devstack sudo[108152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:42 devstack sudo[108152]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e292dc30-0edb-43f3-9951-e04f895f5ab9 tempest-ProjectReaderTests-1030742843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2e2732c0-89d6-472a-b7f2-b5eeb3189a7f.cf6911b8-14bc-4163-ad5f-6013af940e2e" returned: 0 in 0.235s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e292dc30-0edb-43f3-9951-e04f895f5ab9 tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2e2732c0-89d6-472a-b7f2-b5eeb3189a7f.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:42 devstack sudo[108155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2e2732c0-89d6-472a-b7f2-b5eeb3189a7f.info Sep 04 18:12:42 devstack sudo[108155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:42 devstack sudo[108155]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e292dc30-0edb-43f3-9951-e04f895f5ab9 tempest-ProjectReaderTests-1030742843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2e2732c0-89d6-472a-b7f2-b5eeb3189a7f.info" returned: 0 in 0.238s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:42 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-e292dc30-0edb-43f3-9951-e04f895f5ab9 tempest-ProjectReaderTests-1030742843 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2e2732c0-89d6-472a-b7f2-b5eeb3189a7f.info is being set with open permissions: ugo+rw Sep 04 18:12:42 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e292dc30-0edb-43f3-9951-e04f895f5ab9 tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2e2732c0-89d6-472a-b7f2-b5eeb3189a7f.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:42 devstack sudo[108158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2e2732c0-89d6-472a-b7f2-b5eeb3189a7f.info Sep 04 18:12:42 devstack sudo[108158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:43 devstack sudo[108158]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e292dc30-0edb-43f3-9951-e04f895f5ab9 tempest-ProjectReaderTests-1030742843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2e2732c0-89d6-472a-b7f2-b5eeb3189a7f.info" returned: 0 in 0.238s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e292dc30-0edb-43f3-9951-e04f895f5ab9 tempest-ProjectReaderTests-1030742843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.790s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:12:43 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-e292dc30-0edb-43f3-9951-e04f895f5ab9 tempest-ProjectReaderTests-1030742843 None] Create snapshot completed successfully Sep 04 18:12:43 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e0aaa4ac-2bb2-4077-8d1e-2f3b48270a67 tempest-ProjectReaderTests-1030742843 None] Acquiring lock "cinder-cf6911b8-14bc-4163-ad5f-6013af940e2e-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:12:43 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e0aaa4ac-2bb2-4077-8d1e-2f3b48270a67 tempest-ProjectReaderTests-1030742843 None] Lock "cinder-cf6911b8-14bc-4163-ad5f-6013af940e2e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:12:43 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e0aaa4ac-2bb2-4077-8d1e-2f3b48270a67 tempest-ProjectReaderTests-1030742843 None] Acquiring lock "cinder-quobyte-2e2732c0-89d6-472a-b7f2-b5eeb3189a7f" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:12:43 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e0aaa4ac-2bb2-4077-8d1e-2f3b48270a67 tempest-ProjectReaderTests-1030742843 None] Lock "cinder-quobyte-2e2732c0-89d6-472a-b7f2-b5eeb3189a7f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:12:43 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e0aaa4ac-2bb2-4077-8d1e-2f3b48270a67 tempest-ProjectReaderTests-1030742843 None] Acquiring lock "cinder-quobyte-cf6911b8-14bc-4163-ad5f-6013af940e2e" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:12:43 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e0aaa4ac-2bb2-4077-8d1e-2f3b48270a67 tempest-ProjectReaderTests-1030742843 None] Lock "cinder-quobyte-cf6911b8-14bc-4163-ad5f-6013af940e2e" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:12:43 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-e0aaa4ac-2bb2-4077-8d1e-2f3b48270a67 tempest-ProjectReaderTests-1030742843 None] Deleting offline snapshot cf6911b8-14bc-4163-ad5f-6013af940e2e of volume 2e2732c0-89d6-472a-b7f2-b5eeb3189a7f {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 18:12:43 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-e0aaa4ac-2bb2-4077-8d1e-2f3b48270a67 tempest-ProjectReaderTests-1030742843 None] snapshot_file for this snap is: volume-2e2732c0-89d6-472a-b7f2-b5eeb3189a7f.cf6911b8-14bc-4163-ad5f-6013af940e2e {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 18:12:43 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7525428-7052-43f2-9c08-115b13911576]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:12:43 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e0aaa4ac-2bb2-4077-8d1e-2f3b48270a67 tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2e2732c0-89d6-472a-b7f2-b5eeb3189a7f.cf6911b8-14bc-4163-ad5f-6013af940e2e {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:43 devstack sudo[108161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2e2732c0-89d6-472a-b7f2-b5eeb3189a7f.cf6911b8-14bc-4163-ad5f-6013af940e2e Sep 04 18:12:43 devstack sudo[108161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:44 devstack sudo[108161]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e0aaa4ac-2bb2-4077-8d1e-2f3b48270a67 tempest-ProjectReaderTests-1030742843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2e2732c0-89d6-472a-b7f2-b5eeb3189a7f.cf6911b8-14bc-4163-ad5f-6013af940e2e" returned: 0 in 0.352s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:44 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-e0aaa4ac-2bb2-4077-8d1e-2f3b48270a67 tempest-ProjectReaderTests-1030742843 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e2732c0-89d6-472a-b7f2-b5eeb3189a7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 18:12:44 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[9418b257-0f78-41a4-b61a-2272dbdcdc91]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:12:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e0aaa4ac-2bb2-4077-8d1e-2f3b48270a67 tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2e2732c0-89d6-472a-b7f2-b5eeb3189a7f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:44 devstack sudo[108167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2e2732c0-89d6-472a-b7f2-b5eeb3189a7f Sep 04 18:12:44 devstack sudo[108167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:44 devstack sudo[108167]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e0aaa4ac-2bb2-4077-8d1e-2f3b48270a67 tempest-ProjectReaderTests-1030742843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2e2732c0-89d6-472a-b7f2-b5eeb3189a7f" returned: 0 in 0.333s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e0aaa4ac-2bb2-4077-8d1e-2f3b48270a67 tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2e2732c0-89d6-472a-b7f2-b5eeb3189a7f.cf6911b8-14bc-4163-ad5f-6013af940e2e {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:44 devstack sudo[108172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2e2732c0-89d6-472a-b7f2-b5eeb3189a7f.cf6911b8-14bc-4163-ad5f-6013af940e2e Sep 04 18:12:44 devstack sudo[108172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:44 devstack sudo[108172]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e0aaa4ac-2bb2-4077-8d1e-2f3b48270a67 tempest-ProjectReaderTests-1030742843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2e2732c0-89d6-472a-b7f2-b5eeb3189a7f.cf6911b8-14bc-4163-ad5f-6013af940e2e" returned: 0 in 0.320s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:44 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e0aaa4ac-2bb2-4077-8d1e-2f3b48270a67 tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2e2732c0-89d6-472a-b7f2-b5eeb3189a7f.cf6911b8-14bc-4163-ad5f-6013af940e2e {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:44 devstack sudo[108178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2e2732c0-89d6-472a-b7f2-b5eeb3189a7f.cf6911b8-14bc-4163-ad5f-6013af940e2e Sep 04 18:12:44 devstack sudo[108178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:45 devstack sudo[108178]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e0aaa4ac-2bb2-4077-8d1e-2f3b48270a67 tempest-ProjectReaderTests-1030742843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2e2732c0-89d6-472a-b7f2-b5eeb3189a7f.cf6911b8-14bc-4163-ad5f-6013af940e2e" returned: 0 in 0.227s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:45 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e0aaa4ac-2bb2-4077-8d1e-2f3b48270a67 tempest-ProjectReaderTests-1030742843 None] Lock "cinder-quobyte-cf6911b8-14bc-4163-ad5f-6013af940e2e" released by "_delete_snapshot" :: held 1.318s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:12:45 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e0aaa4ac-2bb2-4077-8d1e-2f3b48270a67 tempest-ProjectReaderTests-1030742843 None] Lock "cinder-quobyte-2e2732c0-89d6-472a-b7f2-b5eeb3189a7f" released by "delete_snapshot" :: held 1.338s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:12:45 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-e0aaa4ac-2bb2-4077-8d1e-2f3b48270a67 tempest-ProjectReaderTests-1030742843 None] Created reservations ['a1299ec6-5481-4f68-9f2c-bd2ba2cb900a', '4628084f-dc90-4800-b7d2-4a6d45d4f020', '430ddae9-d78f-4eda-8685-ce3fa28b4327', '30c40ae6-d79f-42b8-9ff2-90ac96ba0bba'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:12:45 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-e0aaa4ac-2bb2-4077-8d1e-2f3b48270a67 tempest-ProjectReaderTests-1030742843 None] Delete snapshot completed successfully. Sep 04 18:12:45 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e0aaa4ac-2bb2-4077-8d1e-2f3b48270a67 tempest-ProjectReaderTests-1030742843 None] Lock "cinder-cf6911b8-14bc-4163-ad5f-6013af940e2e-delete_snapshot" released by "delete_snapshot" :: held 1.470s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:12:45 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e3218b9c-8eab-431d-92aa-190be6b0b055 tempest-ProjectReaderTests-1030742843 None] Acquiring lock "cinder-2e2732c0-89d6-472a-b7f2-b5eeb3189a7f-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:12:45 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e3218b9c-8eab-431d-92aa-190be6b0b055 tempest-ProjectReaderTests-1030742843 None] Lock "cinder-2e2732c0-89d6-472a-b7f2-b5eeb3189a7f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:12:45 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e3218b9c-8eab-431d-92aa-190be6b0b055 tempest-ProjectReaderTests-1030742843 None] Acquiring lock "cinder-quobyte-2e2732c0-89d6-472a-b7f2-b5eeb3189a7f" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:12:45 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e3218b9c-8eab-431d-92aa-190be6b0b055 tempest-ProjectReaderTests-1030742843 None] Lock "cinder-quobyte-2e2732c0-89d6-472a-b7f2-b5eeb3189a7f" acquired by "delete_volume" :: waited 0.017s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:12:45 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[825319ce-44cc-4a23-901e-8e36e8a97e8c]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:12:45 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e3218b9c-8eab-431d-92aa-190be6b0b055 tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2e2732c0-89d6-472a-b7f2-b5eeb3189a7f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:46 devstack sudo[108181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2e2732c0-89d6-472a-b7f2-b5eeb3189a7f Sep 04 18:12:46 devstack sudo[108181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:46 devstack sudo[108181]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e3218b9c-8eab-431d-92aa-190be6b0b055 tempest-ProjectReaderTests-1030742843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2e2732c0-89d6-472a-b7f2-b5eeb3189a7f" returned: 0 in 0.375s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e3218b9c-8eab-431d-92aa-190be6b0b055 tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2e2732c0-89d6-472a-b7f2-b5eeb3189a7f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:46 devstack sudo[108186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2e2732c0-89d6-472a-b7f2-b5eeb3189a7f Sep 04 18:12:46 devstack sudo[108186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:46 devstack sudo[108186]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e3218b9c-8eab-431d-92aa-190be6b0b055 tempest-ProjectReaderTests-1030742843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-2e2732c0-89d6-472a-b7f2-b5eeb3189a7f" returned: 0 in 0.245s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:46 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e3218b9c-8eab-431d-92aa-190be6b0b055 tempest-ProjectReaderTests-1030742843 None] Lock "cinder-quobyte-2e2732c0-89d6-472a-b7f2-b5eeb3189a7f" released by "delete_volume" :: held 0.692s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:12:46 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-e3218b9c-8eab-431d-92aa-190be6b0b055 tempest-ProjectReaderTests-1030742843 None] Created reservations ['9db7b8fc-770f-42e6-8098-cb67529b6a21', 'c5db6fbb-32c6-4831-bf7b-a1499c1a555e', '38c2592c-98a1-42dc-ae59-7c97fcce2869', '758a0ddf-a27e-466b-9ae8-b294f15ad385'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:12:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e3218b9c-8eab-431d-92aa-190be6b0b055 tempest-ProjectReaderTests-1030742843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:12:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e3218b9c-8eab-431d-92aa-190be6b0b055 tempest-ProjectReaderTests-1030742843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:12:46 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e3218b9c-8eab-431d-92aa-190be6b0b055 tempest-ProjectReaderTests-1030742843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:12:46 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-e3218b9c-8eab-431d-92aa-190be6b0b055 tempest-ProjectReaderTests-1030742843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:12:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-e3218b9c-8eab-431d-92aa-190be6b0b055 tempest-ProjectReaderTests-1030742843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:12:46 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e3218b9c-8eab-431d-92aa-190be6b0b055 tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:46 devstack sudo[108189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:12:46 devstack sudo[108189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:47 devstack sudo[108189]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e3218b9c-8eab-431d-92aa-190be6b0b055 tempest-ProjectReaderTests-1030742843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.272s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:47 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-e3218b9c-8eab-431d-92aa-190be6b0b055 tempest-ProjectReaderTests-1030742843 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:12:47 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-e3218b9c-8eab-431d-92aa-190be6b0b055 tempest-ProjectReaderTests-1030742843 None] Deleted volume successfully. Sep 04 18:12:47 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e3218b9c-8eab-431d-92aa-190be6b0b055 tempest-ProjectReaderTests-1030742843 None] Lock "cinder-2e2732c0-89d6-472a-b7f2-b5eeb3189a7f-delete_volume" released by "delete_volume" :: held 1.233s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:12:47 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6e603e6-03ac-4328-9c2a-4d7b5dcd9f3e tempest-ProjectReaderTests-1030742843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:12:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c6e603e6-03ac-4328-9c2a-4d7b5dcd9f3e tempest-ProjectReaderTests-1030742843 None] Flow 'volume_create_manager' (621ef640-e878-4bd1-b2b2-71aa194ed41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:12:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c6e603e6-03ac-4328-9c2a-4d7b5dcd9f3e tempest-ProjectReaderTests-1030742843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29cc90e1-0810-4622-b9a0-94b4f916989e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:12:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c6e603e6-03ac-4328-9c2a-4d7b5dcd9f3e tempest-ProjectReaderTests-1030742843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29cc90e1-0810-4622-b9a0-94b4f916989e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1627444726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a3f9553-fbf7-462a-becc-ce457fcaa3fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25f84d71b6db4272853e1c3fe5986eb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:12:47Z,use_quota=True,user_id='a9c3bac0753c42c8a9ee10b4d904a664',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:12:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c6e603e6-03ac-4328-9c2a-4d7b5dcd9f3e tempest-ProjectReaderTests-1030742843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (401ed4fa-8131-4097-adbd-cc7e022deda3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:12:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c6e603e6-03ac-4328-9c2a-4d7b5dcd9f3e tempest-ProjectReaderTests-1030742843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (401ed4fa-8131-4097-adbd-cc7e022deda3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:12:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c6e603e6-03ac-4328-9c2a-4d7b5dcd9f3e tempest-ProjectReaderTests-1030742843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79faa707-a6dc-4b3b-b81a-71878b32f0c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:12:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c6e603e6-03ac-4328-9c2a-4d7b5dcd9f3e tempest-ProjectReaderTests-1030742843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79faa707-a6dc-4b3b-b81a-71878b32f0c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a3f9553-fbf7-462a-becc-ce457fcaa3fa', 'volume_name': 'volume-9a3f9553-fbf7-462a-becc-ce457fcaa3fa', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:12:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c6e603e6-03ac-4328-9c2a-4d7b5dcd9f3e tempest-ProjectReaderTests-1030742843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31dc9739-82de-4025-afcb-eb58f04d4b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:12:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c6e603e6-03ac-4328-9c2a-4d7b5dcd9f3e tempest-ProjectReaderTests-1030742843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31dc9739-82de-4025-afcb-eb58f04d4b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:12:47 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c6e603e6-03ac-4328-9c2a-4d7b5dcd9f3e tempest-ProjectReaderTests-1030742843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66308afd-eb32-49b9-a333-df9ba668f1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:12:47 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-c6e603e6-03ac-4328-9c2a-4d7b5dcd9f3e tempest-ProjectReaderTests-1030742843 None] Volume 9a3f9553-fbf7-462a-becc-ce457fcaa3fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a3f9553-fbf7-462a-becc-ce457fcaa3fa', 'volume_size': 1} Sep 04 18:12:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c6e603e6-03ac-4328-9c2a-4d7b5dcd9f3e tempest-ProjectReaderTests-1030742843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:12:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c6e603e6-03ac-4328-9c2a-4d7b5dcd9f3e tempest-ProjectReaderTests-1030742843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:12:47 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c6e603e6-03ac-4328-9c2a-4d7b5dcd9f3e tempest-ProjectReaderTests-1030742843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1627444726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a3f9553-fbf7-462a-becc-ce457fcaa3fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25f84d71b6db4272853e1c3fe5986eb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:12:47Z,use_quota=True,user_id='a9c3bac0753c42c8a9ee10b4d904a664',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:12:47 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-c6e603e6-03ac-4328-9c2a-4d7b5dcd9f3e tempest-ProjectReaderTests-1030742843 None] Creating volume 9a3f9553-fbf7-462a-becc-ce457fcaa3fa {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:12:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c6e603e6-03ac-4328-9c2a-4d7b5dcd9f3e tempest-ProjectReaderTests-1030742843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:12:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c6e603e6-03ac-4328-9c2a-4d7b5dcd9f3e tempest-ProjectReaderTests-1030742843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:12:47 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c6e603e6-03ac-4328-9c2a-4d7b5dcd9f3e tempest-ProjectReaderTests-1030742843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:12:47 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c6e603e6-03ac-4328-9c2a-4d7b5dcd9f3e tempest-ProjectReaderTests-1030742843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:12:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c6e603e6-03ac-4328-9c2a-4d7b5dcd9f3e tempest-ProjectReaderTests-1030742843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:12:47 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c6e603e6-03ac-4328-9c2a-4d7b5dcd9f3e tempest-ProjectReaderTests-1030742843 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:12:47 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-c6e603e6-03ac-4328-9c2a-4d7b5dcd9f3e tempest-ProjectReaderTests-1030742843 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:12:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c6e603e6-03ac-4328-9c2a-4d7b5dcd9f3e tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a3f9553-fbf7-462a-becc-ce457fcaa3fa 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:47 devstack sudo[108192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a3f9553-fbf7-462a-becc-ce457fcaa3fa 1073741824 Sep 04 18:12:47 devstack sudo[108192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:47 devstack sudo[108192]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:47 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c6e603e6-03ac-4328-9c2a-4d7b5dcd9f3e tempest-ProjectReaderTests-1030742843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a3f9553-fbf7-462a-becc-ce457fcaa3fa 1073741824" returned: 0 in 0.418s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c6e603e6-03ac-4328-9c2a-4d7b5dcd9f3e tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a3f9553-fbf7-462a-becc-ce457fcaa3fa {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:48 devstack sudo[108197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a3f9553-fbf7-462a-becc-ce457fcaa3fa Sep 04 18:12:48 devstack sudo[108197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:48 devstack sudo[108197]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c6e603e6-03ac-4328-9c2a-4d7b5dcd9f3e tempest-ProjectReaderTests-1030742843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a3f9553-fbf7-462a-becc-ce457fcaa3fa" returned: 0 in 0.237s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:48 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-c6e603e6-03ac-4328-9c2a-4d7b5dcd9f3e tempest-ProjectReaderTests-1030742843 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:12:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-c6e603e6-03ac-4328-9c2a-4d7b5dcd9f3e tempest-ProjectReaderTests-1030742843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:12:48 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c6e603e6-03ac-4328-9c2a-4d7b5dcd9f3e tempest-ProjectReaderTests-1030742843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66308afd-eb32-49b9-a333-df9ba668f1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a3f9553-fbf7-462a-becc-ce457fcaa3fa', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:12:48 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c6e603e6-03ac-4328-9c2a-4d7b5dcd9f3e tempest-ProjectReaderTests-1030742843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7090ed1-2aed-4a21-92b7-54684d950dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:12:48 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-c6e603e6-03ac-4328-9c2a-4d7b5dcd9f3e tempest-ProjectReaderTests-1030742843 None] Volume volume-9a3f9553-fbf7-462a-becc-ce457fcaa3fa (9a3f9553-fbf7-462a-becc-ce457fcaa3fa): created successfully Sep 04 18:12:48 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c6e603e6-03ac-4328-9c2a-4d7b5dcd9f3e tempest-ProjectReaderTests-1030742843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7090ed1-2aed-4a21-92b7-54684d950dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:12:48 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-c6e603e6-03ac-4328-9c2a-4d7b5dcd9f3e tempest-ProjectReaderTests-1030742843 None] Flow 'volume_create_manager' (621ef640-e878-4bd1-b2b2-71aa194ed41f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:12:48 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-c6e603e6-03ac-4328-9c2a-4d7b5dcd9f3e tempest-ProjectReaderTests-1030742843 None] Created volume successfully. Sep 04 18:12:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d75fa6de-c118-4d39-beac-0d053d5c2226 tempest-ProjectReaderTests-1030742843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:12:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d75fa6de-c118-4d39-beac-0d053d5c2226 tempest-ProjectReaderTests-1030742843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:12:48 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-d75fa6de-c118-4d39-beac-0d053d5c2226 tempest-ProjectReaderTests-1030742843 None] Creating offline snapshot ba592fbb-5da2-4d9a-9849-d0b5f9e4b9f0 of volume 9a3f9553-fbf7-462a-becc-ce457fcaa3fa {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 18:12:48 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[52630ec0-07b6-48cd-9742-44371f3e0f15]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:12:48 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d75fa6de-c118-4d39-beac-0d053d5c2226 tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a3f9553-fbf7-462a-becc-ce457fcaa3fa {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:48 devstack sudo[108200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a3f9553-fbf7-462a-becc-ce457fcaa3fa Sep 04 18:12:48 devstack sudo[108200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:49 devstack sudo[108200]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d75fa6de-c118-4d39-beac-0d053d5c2226 tempest-ProjectReaderTests-1030742843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a3f9553-fbf7-462a-becc-ce457fcaa3fa" returned: 0 in 0.370s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d75fa6de-c118-4d39-beac-0d053d5c2226 tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a3f9553-fbf7-462a-becc-ce457fcaa3fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a3f9553-fbf7-462a-becc-ce457fcaa3fa.ba592fbb-5da2-4d9a-9849-d0b5f9e4b9f0 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:49 devstack sudo[108205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a3f9553-fbf7-462a-becc-ce457fcaa3fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a3f9553-fbf7-462a-becc-ce457fcaa3fa.ba592fbb-5da2-4d9a-9849-d0b5f9e4b9f0 1G Sep 04 18:12:49 devstack sudo[108205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:49 devstack sudo[108205]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d75fa6de-c118-4d39-beac-0d053d5c2226 tempest-ProjectReaderTests-1030742843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a3f9553-fbf7-462a-becc-ce457fcaa3fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a3f9553-fbf7-462a-becc-ce457fcaa3fa.ba592fbb-5da2-4d9a-9849-d0b5f9e4b9f0 1G" returned: 0 in 0.394s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d75fa6de-c118-4d39-beac-0d053d5c2226 tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a3f9553-fbf7-462a-becc-ce457fcaa3fa -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a3f9553-fbf7-462a-becc-ce457fcaa3fa.ba592fbb-5da2-4d9a-9849-d0b5f9e4b9f0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:49 devstack sudo[108210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a3f9553-fbf7-462a-becc-ce457fcaa3fa -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a3f9553-fbf7-462a-becc-ce457fcaa3fa.ba592fbb-5da2-4d9a-9849-d0b5f9e4b9f0 Sep 04 18:12:49 devstack sudo[108210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:49 devstack sudo[108210]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d75fa6de-c118-4d39-beac-0d053d5c2226 tempest-ProjectReaderTests-1030742843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a3f9553-fbf7-462a-becc-ce457fcaa3fa -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a3f9553-fbf7-462a-becc-ce457fcaa3fa.ba592fbb-5da2-4d9a-9849-d0b5f9e4b9f0" returned: 0 in 0.304s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:49 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-d75fa6de-c118-4d39-beac-0d053d5c2226 tempest-ProjectReaderTests-1030742843 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a3f9553-fbf7-462a-becc-ce457fcaa3fa.ba592fbb-5da2-4d9a-9849-d0b5f9e4b9f0 is being set with open permissions: ugo+rw Sep 04 18:12:49 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d75fa6de-c118-4d39-beac-0d053d5c2226 tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a3f9553-fbf7-462a-becc-ce457fcaa3fa.ba592fbb-5da2-4d9a-9849-d0b5f9e4b9f0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:49 devstack sudo[108215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a3f9553-fbf7-462a-becc-ce457fcaa3fa.ba592fbb-5da2-4d9a-9849-d0b5f9e4b9f0 Sep 04 18:12:49 devstack sudo[108215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:50 devstack sudo[108215]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d75fa6de-c118-4d39-beac-0d053d5c2226 tempest-ProjectReaderTests-1030742843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a3f9553-fbf7-462a-becc-ce457fcaa3fa.ba592fbb-5da2-4d9a-9849-d0b5f9e4b9f0" returned: 0 in 0.241s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d75fa6de-c118-4d39-beac-0d053d5c2226 tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a3f9553-fbf7-462a-becc-ce457fcaa3fa.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:50 devstack sudo[108218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a3f9553-fbf7-462a-becc-ce457fcaa3fa.info Sep 04 18:12:50 devstack sudo[108218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:50 devstack sudo[108218]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d75fa6de-c118-4d39-beac-0d053d5c2226 tempest-ProjectReaderTests-1030742843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a3f9553-fbf7-462a-becc-ce457fcaa3fa.info" returned: 0 in 0.265s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:50 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-d75fa6de-c118-4d39-beac-0d053d5c2226 tempest-ProjectReaderTests-1030742843 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a3f9553-fbf7-462a-becc-ce457fcaa3fa.info is being set with open permissions: ugo+rw Sep 04 18:12:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d75fa6de-c118-4d39-beac-0d053d5c2226 tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a3f9553-fbf7-462a-becc-ce457fcaa3fa.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:50 devstack sudo[108221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a3f9553-fbf7-462a-becc-ce457fcaa3fa.info Sep 04 18:12:50 devstack sudo[108221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:50 devstack sudo[108221]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-d75fa6de-c118-4d39-beac-0d053d5c2226 tempest-ProjectReaderTests-1030742843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a3f9553-fbf7-462a-becc-ce457fcaa3fa.info" returned: 0 in 0.248s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-d75fa6de-c118-4d39-beac-0d053d5c2226 tempest-ProjectReaderTests-1030742843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.911s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:12:50 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-d75fa6de-c118-4d39-beac-0d053d5c2226 tempest-ProjectReaderTests-1030742843 None] Create snapshot completed successfully Sep 04 18:12:50 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2f679120-8254-4ebd-ab2b-d4ac09d88478 tempest-ProjectReaderTests-1030742843 None] Acquiring lock "cinder-ba592fbb-5da2-4d9a-9849-d0b5f9e4b9f0-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:12:50 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2f679120-8254-4ebd-ab2b-d4ac09d88478 tempest-ProjectReaderTests-1030742843 None] Lock "cinder-ba592fbb-5da2-4d9a-9849-d0b5f9e4b9f0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:12:50 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2f679120-8254-4ebd-ab2b-d4ac09d88478 tempest-ProjectReaderTests-1030742843 None] Acquiring lock "cinder-quobyte-9a3f9553-fbf7-462a-becc-ce457fcaa3fa" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:12:50 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2f679120-8254-4ebd-ab2b-d4ac09d88478 tempest-ProjectReaderTests-1030742843 None] Lock "cinder-quobyte-9a3f9553-fbf7-462a-becc-ce457fcaa3fa" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:12:50 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2f679120-8254-4ebd-ab2b-d4ac09d88478 tempest-ProjectReaderTests-1030742843 None] Acquiring lock "cinder-quobyte-ba592fbb-5da2-4d9a-9849-d0b5f9e4b9f0" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:12:50 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2f679120-8254-4ebd-ab2b-d4ac09d88478 tempest-ProjectReaderTests-1030742843 None] Lock "cinder-quobyte-ba592fbb-5da2-4d9a-9849-d0b5f9e4b9f0" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:12:50 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-2f679120-8254-4ebd-ab2b-d4ac09d88478 tempest-ProjectReaderTests-1030742843 None] Deleting offline snapshot ba592fbb-5da2-4d9a-9849-d0b5f9e4b9f0 of volume 9a3f9553-fbf7-462a-becc-ce457fcaa3fa {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 18:12:50 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-2f679120-8254-4ebd-ab2b-d4ac09d88478 tempest-ProjectReaderTests-1030742843 None] snapshot_file for this snap is: volume-9a3f9553-fbf7-462a-becc-ce457fcaa3fa.ba592fbb-5da2-4d9a-9849-d0b5f9e4b9f0 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 18:12:50 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed07c00-5051-478f-8abc-4bf2ffd514a2]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:12:50 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2f679120-8254-4ebd-ab2b-d4ac09d88478 tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a3f9553-fbf7-462a-becc-ce457fcaa3fa.ba592fbb-5da2-4d9a-9849-d0b5f9e4b9f0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:50 devstack sudo[108260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a3f9553-fbf7-462a-becc-ce457fcaa3fa.ba592fbb-5da2-4d9a-9849-d0b5f9e4b9f0 Sep 04 18:12:50 devstack sudo[108260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:51 devstack sudo[108260]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2f679120-8254-4ebd-ab2b-d4ac09d88478 tempest-ProjectReaderTests-1030742843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a3f9553-fbf7-462a-becc-ce457fcaa3fa.ba592fbb-5da2-4d9a-9849-d0b5f9e4b9f0" returned: 0 in 0.363s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:51 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-2f679120-8254-4ebd-ab2b-d4ac09d88478 tempest-ProjectReaderTests-1030742843 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a3f9553-fbf7-462a-becc-ce457fcaa3fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 18:12:51 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[0963e819-5985-4905-b37b-6acc81795edc]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:12:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2f679120-8254-4ebd-ab2b-d4ac09d88478 tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a3f9553-fbf7-462a-becc-ce457fcaa3fa {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:51 devstack sudo[108265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a3f9553-fbf7-462a-becc-ce457fcaa3fa Sep 04 18:12:51 devstack sudo[108265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:51 devstack sudo[108265]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2f679120-8254-4ebd-ab2b-d4ac09d88478 tempest-ProjectReaderTests-1030742843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a3f9553-fbf7-462a-becc-ce457fcaa3fa" returned: 0 in 0.343s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2f679120-8254-4ebd-ab2b-d4ac09d88478 tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a3f9553-fbf7-462a-becc-ce457fcaa3fa.ba592fbb-5da2-4d9a-9849-d0b5f9e4b9f0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:51 devstack sudo[108270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a3f9553-fbf7-462a-becc-ce457fcaa3fa.ba592fbb-5da2-4d9a-9849-d0b5f9e4b9f0 Sep 04 18:12:51 devstack sudo[108270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:51 devstack sudo[108270]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2f679120-8254-4ebd-ab2b-d4ac09d88478 tempest-ProjectReaderTests-1030742843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a3f9553-fbf7-462a-becc-ce457fcaa3fa.ba592fbb-5da2-4d9a-9849-d0b5f9e4b9f0" returned: 0 in 0.341s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:51 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2f679120-8254-4ebd-ab2b-d4ac09d88478 tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a3f9553-fbf7-462a-becc-ce457fcaa3fa.ba592fbb-5da2-4d9a-9849-d0b5f9e4b9f0 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:51 devstack sudo[108275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a3f9553-fbf7-462a-becc-ce457fcaa3fa.ba592fbb-5da2-4d9a-9849-d0b5f9e4b9f0 Sep 04 18:12:51 devstack sudo[108275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:52 devstack sudo[108275]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:52 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-2f679120-8254-4ebd-ab2b-d4ac09d88478 tempest-ProjectReaderTests-1030742843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a3f9553-fbf7-462a-becc-ce457fcaa3fa.ba592fbb-5da2-4d9a-9849-d0b5f9e4b9f0" returned: 0 in 0.246s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2f679120-8254-4ebd-ab2b-d4ac09d88478 tempest-ProjectReaderTests-1030742843 None] Lock "cinder-quobyte-ba592fbb-5da2-4d9a-9849-d0b5f9e4b9f0" released by "_delete_snapshot" :: held 1.372s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:12:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2f679120-8254-4ebd-ab2b-d4ac09d88478 tempest-ProjectReaderTests-1030742843 None] Lock "cinder-quobyte-9a3f9553-fbf7-462a-becc-ce457fcaa3fa" released by "delete_snapshot" :: held 1.391s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:12:52 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-2f679120-8254-4ebd-ab2b-d4ac09d88478 tempest-ProjectReaderTests-1030742843 None] Created reservations ['f8b69d1f-172b-400d-bad1-95125a01d26c', 'c7248a9c-ca5d-4353-aac3-30a26dadc4f1', '0b98aaf5-c43a-4759-8547-c27ef855ad6a', 'fbc46ae6-685d-4929-a86d-071cf8c9a76b'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:12:52 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-2f679120-8254-4ebd-ab2b-d4ac09d88478 tempest-ProjectReaderTests-1030742843 None] Delete snapshot completed successfully. Sep 04 18:12:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-2f679120-8254-4ebd-ab2b-d4ac09d88478 tempest-ProjectReaderTests-1030742843 None] Lock "cinder-ba592fbb-5da2-4d9a-9849-d0b5f9e4b9f0-delete_snapshot" released by "delete_snapshot" :: held 1.532s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:12:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5fbadc26-6152-4c79-b11b-1adb4ce9cd9e tempest-ProjectReaderTests-1030742843 None] Acquiring lock "cinder-9a3f9553-fbf7-462a-becc-ce457fcaa3fa-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:12:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5fbadc26-6152-4c79-b11b-1adb4ce9cd9e tempest-ProjectReaderTests-1030742843 None] Lock "cinder-9a3f9553-fbf7-462a-becc-ce457fcaa3fa-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:12:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5fbadc26-6152-4c79-b11b-1adb4ce9cd9e tempest-ProjectReaderTests-1030742843 None] Acquiring lock "cinder-quobyte-9a3f9553-fbf7-462a-becc-ce457fcaa3fa" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:12:52 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5fbadc26-6152-4c79-b11b-1adb4ce9cd9e tempest-ProjectReaderTests-1030742843 None] Lock "cinder-quobyte-9a3f9553-fbf7-462a-becc-ce457fcaa3fa" acquired by "delete_volume" :: waited 0.014s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:12:53 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[36674fc6-b955-4c7d-83f2-0762215d980a]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:12:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5fbadc26-6152-4c79-b11b-1adb4ce9cd9e tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a3f9553-fbf7-462a-becc-ce457fcaa3fa {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:53 devstack sudo[108278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a3f9553-fbf7-462a-becc-ce457fcaa3fa Sep 04 18:12:53 devstack sudo[108278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:53 devstack sudo[108278]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5fbadc26-6152-4c79-b11b-1adb4ce9cd9e tempest-ProjectReaderTests-1030742843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a3f9553-fbf7-462a-becc-ce457fcaa3fa" returned: 0 in 0.347s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5fbadc26-6152-4c79-b11b-1adb4ce9cd9e tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a3f9553-fbf7-462a-becc-ce457fcaa3fa {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:53 devstack sudo[108283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a3f9553-fbf7-462a-becc-ce457fcaa3fa Sep 04 18:12:53 devstack sudo[108283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:53 devstack sudo[108283]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5fbadc26-6152-4c79-b11b-1adb4ce9cd9e tempest-ProjectReaderTests-1030742843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-9a3f9553-fbf7-462a-becc-ce457fcaa3fa" returned: 0 in 0.241s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:53 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5fbadc26-6152-4c79-b11b-1adb4ce9cd9e tempest-ProjectReaderTests-1030742843 None] Lock "cinder-quobyte-9a3f9553-fbf7-462a-becc-ce457fcaa3fa" released by "delete_volume" :: held 0.649s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:12:53 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-5fbadc26-6152-4c79-b11b-1adb4ce9cd9e tempest-ProjectReaderTests-1030742843 None] Created reservations ['afb4ce86-5705-4a6b-b65b-3683798bf317', 'd4732f3a-4ef0-4d81-ad96-346a23987ac2', '3258fcd0-d12e-4447-9bc0-5620f79b232b', 'c0049f38-fc11-4391-a7fa-5742b50976a2'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:12:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5fbadc26-6152-4c79-b11b-1adb4ce9cd9e tempest-ProjectReaderTests-1030742843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:12:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5fbadc26-6152-4c79-b11b-1adb4ce9cd9e tempest-ProjectReaderTests-1030742843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:12:53 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5fbadc26-6152-4c79-b11b-1adb4ce9cd9e tempest-ProjectReaderTests-1030742843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:12:53 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5fbadc26-6152-4c79-b11b-1adb4ce9cd9e tempest-ProjectReaderTests-1030742843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:12:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5fbadc26-6152-4c79-b11b-1adb4ce9cd9e tempest-ProjectReaderTests-1030742843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:12:53 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5fbadc26-6152-4c79-b11b-1adb4ce9cd9e tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:53 devstack sudo[108286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:12:53 devstack sudo[108286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:54 devstack sudo[108286]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5fbadc26-6152-4c79-b11b-1adb4ce9cd9e tempest-ProjectReaderTests-1030742843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.254s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:54 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-5fbadc26-6152-4c79-b11b-1adb4ce9cd9e tempest-ProjectReaderTests-1030742843 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:12:54 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-5fbadc26-6152-4c79-b11b-1adb4ce9cd9e tempest-ProjectReaderTests-1030742843 None] Deleted volume successfully. Sep 04 18:12:54 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5fbadc26-6152-4c79-b11b-1adb4ce9cd9e tempest-ProjectReaderTests-1030742843 None] Lock "cinder-9a3f9553-fbf7-462a-becc-ce457fcaa3fa-delete_volume" released by "delete_volume" :: held 1.119s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:12:54 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa27687b-36c8-47ee-a9b8-92a156f57984 tempest-ProjectReaderTests-1030742843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:12:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aa27687b-36c8-47ee-a9b8-92a156f57984 tempest-ProjectReaderTests-1030742843 None] Flow 'volume_create_manager' (5f1a8979-8ab8-41d0-b06e-9f06ba05db8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:12:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aa27687b-36c8-47ee-a9b8-92a156f57984 tempest-ProjectReaderTests-1030742843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36400829-1b89-45c3-8114-83a4d2ed0839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:12:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aa27687b-36c8-47ee-a9b8-92a156f57984 tempest-ProjectReaderTests-1030742843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36400829-1b89-45c3-8114-83a4d2ed0839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:12:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-483271892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36e1c45d-63b3-4e68-b790-28bb5ac02f66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25f84d71b6db4272853e1c3fe5986eb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:12:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:12:55Z,use_quota=True,user_id='a9c3bac0753c42c8a9ee10b4d904a664',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:12:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aa27687b-36c8-47ee-a9b8-92a156f57984 tempest-ProjectReaderTests-1030742843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a95dc89-35d4-4327-851b-9bdec638d1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:12:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aa27687b-36c8-47ee-a9b8-92a156f57984 tempest-ProjectReaderTests-1030742843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a95dc89-35d4-4327-851b-9bdec638d1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:12:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aa27687b-36c8-47ee-a9b8-92a156f57984 tempest-ProjectReaderTests-1030742843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ec0bd2a-aaeb-4a81-a9f7-6bbb764b2047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:12:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aa27687b-36c8-47ee-a9b8-92a156f57984 tempest-ProjectReaderTests-1030742843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ec0bd2a-aaeb-4a81-a9f7-6bbb764b2047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36e1c45d-63b3-4e68-b790-28bb5ac02f66', 'volume_name': 'volume-36e1c45d-63b3-4e68-b790-28bb5ac02f66', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:12:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aa27687b-36c8-47ee-a9b8-92a156f57984 tempest-ProjectReaderTests-1030742843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bc839ad-7268-4245-b229-03d4eaa78e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:12:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aa27687b-36c8-47ee-a9b8-92a156f57984 tempest-ProjectReaderTests-1030742843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bc839ad-7268-4245-b229-03d4eaa78e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:12:54 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aa27687b-36c8-47ee-a9b8-92a156f57984 tempest-ProjectReaderTests-1030742843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85d6dc75-bc04-4b79-8478-b7306ac81029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:12:54 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-aa27687b-36c8-47ee-a9b8-92a156f57984 tempest-ProjectReaderTests-1030742843 None] Volume 36e1c45d-63b3-4e68-b790-28bb5ac02f66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36e1c45d-63b3-4e68-b790-28bb5ac02f66', 'volume_size': 1} Sep 04 18:12:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-aa27687b-36c8-47ee-a9b8-92a156f57984 tempest-ProjectReaderTests-1030742843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:12:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-aa27687b-36c8-47ee-a9b8-92a156f57984 tempest-ProjectReaderTests-1030742843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:12:54 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-aa27687b-36c8-47ee-a9b8-92a156f57984 tempest-ProjectReaderTests-1030742843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:12:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-483271892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36e1c45d-63b3-4e68-b790-28bb5ac02f66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25f84d71b6db4272853e1c3fe5986eb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:12:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:12:55Z,use_quota=True,user_id='a9c3bac0753c42c8a9ee10b4d904a664',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:12:54 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-aa27687b-36c8-47ee-a9b8-92a156f57984 tempest-ProjectReaderTests-1030742843 None] Creating volume 36e1c45d-63b3-4e68-b790-28bb5ac02f66 {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:12:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-aa27687b-36c8-47ee-a9b8-92a156f57984 tempest-ProjectReaderTests-1030742843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:12:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-aa27687b-36c8-47ee-a9b8-92a156f57984 tempest-ProjectReaderTests-1030742843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:12:54 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-aa27687b-36c8-47ee-a9b8-92a156f57984 tempest-ProjectReaderTests-1030742843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:12:54 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-aa27687b-36c8-47ee-a9b8-92a156f57984 tempest-ProjectReaderTests-1030742843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:12:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-aa27687b-36c8-47ee-a9b8-92a156f57984 tempest-ProjectReaderTests-1030742843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:12:54 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-aa27687b-36c8-47ee-a9b8-92a156f57984 tempest-ProjectReaderTests-1030742843 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:12:54 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-aa27687b-36c8-47ee-a9b8-92a156f57984 tempest-ProjectReaderTests-1030742843 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:12:54 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-aa27687b-36c8-47ee-a9b8-92a156f57984 tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-36e1c45d-63b3-4e68-b790-28bb5ac02f66 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:54 devstack sudo[108290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-36e1c45d-63b3-4e68-b790-28bb5ac02f66 1073741824 Sep 04 18:12:54 devstack sudo[108290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:55 devstack sudo[108290]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-aa27687b-36c8-47ee-a9b8-92a156f57984 tempest-ProjectReaderTests-1030742843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-36e1c45d-63b3-4e68-b790-28bb5ac02f66 1073741824" returned: 0 in 0.400s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-aa27687b-36c8-47ee-a9b8-92a156f57984 tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-36e1c45d-63b3-4e68-b790-28bb5ac02f66 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:55 devstack sudo[108296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-36e1c45d-63b3-4e68-b790-28bb5ac02f66 Sep 04 18:12:55 devstack sudo[108296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:55 devstack sudo[108296]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-aa27687b-36c8-47ee-a9b8-92a156f57984 tempest-ProjectReaderTests-1030742843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-36e1c45d-63b3-4e68-b790-28bb5ac02f66" returned: 0 in 0.254s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:55 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-aa27687b-36c8-47ee-a9b8-92a156f57984 tempest-ProjectReaderTests-1030742843 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:12:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-aa27687b-36c8-47ee-a9b8-92a156f57984 tempest-ProjectReaderTests-1030742843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:12:55 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aa27687b-36c8-47ee-a9b8-92a156f57984 tempest-ProjectReaderTests-1030742843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85d6dc75-bc04-4b79-8478-b7306ac81029) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36e1c45d-63b3-4e68-b790-28bb5ac02f66', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:12:55 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aa27687b-36c8-47ee-a9b8-92a156f57984 tempest-ProjectReaderTests-1030742843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2958492-0143-465e-b92c-465d77b4dc0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:12:55 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-aa27687b-36c8-47ee-a9b8-92a156f57984 tempest-ProjectReaderTests-1030742843 None] Volume volume-36e1c45d-63b3-4e68-b790-28bb5ac02f66 (36e1c45d-63b3-4e68-b790-28bb5ac02f66): created successfully Sep 04 18:12:55 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aa27687b-36c8-47ee-a9b8-92a156f57984 tempest-ProjectReaderTests-1030742843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2958492-0143-465e-b92c-465d77b4dc0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:12:55 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-aa27687b-36c8-47ee-a9b8-92a156f57984 tempest-ProjectReaderTests-1030742843 None] Flow 'volume_create_manager' (5f1a8979-8ab8-41d0-b06e-9f06ba05db8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:12:55 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-aa27687b-36c8-47ee-a9b8-92a156f57984 tempest-ProjectReaderTests-1030742843 None] Created volume successfully. Sep 04 18:12:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-edd30ce2-7b94-4d61-b393-7d554cac8f9f tempest-ProjectReaderTests-1030742843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:12:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-edd30ce2-7b94-4d61-b393-7d554cac8f9f tempest-ProjectReaderTests-1030742843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:12:55 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-edd30ce2-7b94-4d61-b393-7d554cac8f9f tempest-ProjectReaderTests-1030742843 None] Creating offline snapshot 2f747106-23a5-4dcb-b166-f59e5ad4ff52 of volume 36e1c45d-63b3-4e68-b790-28bb5ac02f66 {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 18:12:55 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4414ce-a0b4-4191-833b-319f4bcbec63]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:12:55 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-edd30ce2-7b94-4d61-b393-7d554cac8f9f tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-36e1c45d-63b3-4e68-b790-28bb5ac02f66 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:55 devstack sudo[108299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-36e1c45d-63b3-4e68-b790-28bb5ac02f66 Sep 04 18:12:55 devstack sudo[108299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:56 devstack sudo[108299]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-edd30ce2-7b94-4d61-b393-7d554cac8f9f tempest-ProjectReaderTests-1030742843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-36e1c45d-63b3-4e68-b790-28bb5ac02f66" returned: 0 in 0.343s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-edd30ce2-7b94-4d61-b393-7d554cac8f9f tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-36e1c45d-63b3-4e68-b790-28bb5ac02f66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-36e1c45d-63b3-4e68-b790-28bb5ac02f66.2f747106-23a5-4dcb-b166-f59e5ad4ff52 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:56 devstack sudo[108304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-36e1c45d-63b3-4e68-b790-28bb5ac02f66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-36e1c45d-63b3-4e68-b790-28bb5ac02f66.2f747106-23a5-4dcb-b166-f59e5ad4ff52 1G Sep 04 18:12:56 devstack sudo[108304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:56 devstack sudo[108304]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-edd30ce2-7b94-4d61-b393-7d554cac8f9f tempest-ProjectReaderTests-1030742843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-36e1c45d-63b3-4e68-b790-28bb5ac02f66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-36e1c45d-63b3-4e68-b790-28bb5ac02f66.2f747106-23a5-4dcb-b166-f59e5ad4ff52 1G" returned: 0 in 0.379s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-edd30ce2-7b94-4d61-b393-7d554cac8f9f tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36e1c45d-63b3-4e68-b790-28bb5ac02f66 -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-36e1c45d-63b3-4e68-b790-28bb5ac02f66.2f747106-23a5-4dcb-b166-f59e5ad4ff52 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:56 devstack sudo[108309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36e1c45d-63b3-4e68-b790-28bb5ac02f66 -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-36e1c45d-63b3-4e68-b790-28bb5ac02f66.2f747106-23a5-4dcb-b166-f59e5ad4ff52 Sep 04 18:12:56 devstack sudo[108309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:56 devstack sudo[108309]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-edd30ce2-7b94-4d61-b393-7d554cac8f9f tempest-ProjectReaderTests-1030742843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36e1c45d-63b3-4e68-b790-28bb5ac02f66 -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-36e1c45d-63b3-4e68-b790-28bb5ac02f66.2f747106-23a5-4dcb-b166-f59e5ad4ff52" returned: 0 in 0.278s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:56 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-edd30ce2-7b94-4d61-b393-7d554cac8f9f tempest-ProjectReaderTests-1030742843 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-36e1c45d-63b3-4e68-b790-28bb5ac02f66.2f747106-23a5-4dcb-b166-f59e5ad4ff52 is being set with open permissions: ugo+rw Sep 04 18:12:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-edd30ce2-7b94-4d61-b393-7d554cac8f9f tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-36e1c45d-63b3-4e68-b790-28bb5ac02f66.2f747106-23a5-4dcb-b166-f59e5ad4ff52 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:56 devstack sudo[108314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-36e1c45d-63b3-4e68-b790-28bb5ac02f66.2f747106-23a5-4dcb-b166-f59e5ad4ff52 Sep 04 18:12:56 devstack sudo[108314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:56 devstack sudo[108314]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:56 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-edd30ce2-7b94-4d61-b393-7d554cac8f9f tempest-ProjectReaderTests-1030742843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-36e1c45d-63b3-4e68-b790-28bb5ac02f66.2f747106-23a5-4dcb-b166-f59e5ad4ff52" returned: 0 in 0.231s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-edd30ce2-7b94-4d61-b393-7d554cac8f9f tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-36e1c45d-63b3-4e68-b790-28bb5ac02f66.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:57 devstack sudo[108317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-36e1c45d-63b3-4e68-b790-28bb5ac02f66.info Sep 04 18:12:57 devstack sudo[108317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:57 devstack sudo[108317]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-edd30ce2-7b94-4d61-b393-7d554cac8f9f tempest-ProjectReaderTests-1030742843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-36e1c45d-63b3-4e68-b790-28bb5ac02f66.info" returned: 0 in 0.243s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:57 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-edd30ce2-7b94-4d61-b393-7d554cac8f9f tempest-ProjectReaderTests-1030742843 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-36e1c45d-63b3-4e68-b790-28bb5ac02f66.info is being set with open permissions: ugo+rw Sep 04 18:12:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-edd30ce2-7b94-4d61-b393-7d554cac8f9f tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-36e1c45d-63b3-4e68-b790-28bb5ac02f66.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:57 devstack sudo[108320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-36e1c45d-63b3-4e68-b790-28bb5ac02f66.info Sep 04 18:12:57 devstack sudo[108320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:57 devstack sudo[108320]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-edd30ce2-7b94-4d61-b393-7d554cac8f9f tempest-ProjectReaderTests-1030742843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-36e1c45d-63b3-4e68-b790-28bb5ac02f66.info" returned: 0 in 0.238s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-edd30ce2-7b94-4d61-b393-7d554cac8f9f tempest-ProjectReaderTests-1030742843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.790s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:12:57 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-edd30ce2-7b94-4d61-b393-7d554cac8f9f tempest-ProjectReaderTests-1030742843 None] Create snapshot completed successfully Sep 04 18:12:57 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e004eeeb-be13-47e0-abb9-d986b1e62c63 tempest-ProjectReaderTests-1030742843 None] Acquiring lock "cinder-2f747106-23a5-4dcb-b166-f59e5ad4ff52-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:12:57 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e004eeeb-be13-47e0-abb9-d986b1e62c63 tempest-ProjectReaderTests-1030742843 None] Lock "cinder-2f747106-23a5-4dcb-b166-f59e5ad4ff52-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:12:57 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e004eeeb-be13-47e0-abb9-d986b1e62c63 tempest-ProjectReaderTests-1030742843 None] Acquiring lock "cinder-quobyte-36e1c45d-63b3-4e68-b790-28bb5ac02f66" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:12:57 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e004eeeb-be13-47e0-abb9-d986b1e62c63 tempest-ProjectReaderTests-1030742843 None] Lock "cinder-quobyte-36e1c45d-63b3-4e68-b790-28bb5ac02f66" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:12:57 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e004eeeb-be13-47e0-abb9-d986b1e62c63 tempest-ProjectReaderTests-1030742843 None] Acquiring lock "cinder-quobyte-2f747106-23a5-4dcb-b166-f59e5ad4ff52" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:12:57 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e004eeeb-be13-47e0-abb9-d986b1e62c63 tempest-ProjectReaderTests-1030742843 None] Lock "cinder-quobyte-2f747106-23a5-4dcb-b166-f59e5ad4ff52" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:12:57 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-e004eeeb-be13-47e0-abb9-d986b1e62c63 tempest-ProjectReaderTests-1030742843 None] Deleting offline snapshot 2f747106-23a5-4dcb-b166-f59e5ad4ff52 of volume 36e1c45d-63b3-4e68-b790-28bb5ac02f66 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 18:12:57 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-e004eeeb-be13-47e0-abb9-d986b1e62c63 tempest-ProjectReaderTests-1030742843 None] snapshot_file for this snap is: volume-36e1c45d-63b3-4e68-b790-28bb5ac02f66.2f747106-23a5-4dcb-b166-f59e5ad4ff52 {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 18:12:57 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c18335-4488-4a3d-abc3-1ca66bfb778a]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:12:57 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e004eeeb-be13-47e0-abb9-d986b1e62c63 tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-36e1c45d-63b3-4e68-b790-28bb5ac02f66.2f747106-23a5-4dcb-b166-f59e5ad4ff52 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:58 devstack sudo[108323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-36e1c45d-63b3-4e68-b790-28bb5ac02f66.2f747106-23a5-4dcb-b166-f59e5ad4ff52 Sep 04 18:12:58 devstack sudo[108323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:58 devstack sudo[108323]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e004eeeb-be13-47e0-abb9-d986b1e62c63 tempest-ProjectReaderTests-1030742843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-36e1c45d-63b3-4e68-b790-28bb5ac02f66.2f747106-23a5-4dcb-b166-f59e5ad4ff52" returned: 0 in 0.335s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:58 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-e004eeeb-be13-47e0-abb9-d986b1e62c63 tempest-ProjectReaderTests-1030742843 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36e1c45d-63b3-4e68-b790-28bb5ac02f66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 18:12:58 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fea8323-35d2-4650-9599-2906c4330a78]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:12:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e004eeeb-be13-47e0-abb9-d986b1e62c63 tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-36e1c45d-63b3-4e68-b790-28bb5ac02f66 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:58 devstack sudo[108328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-36e1c45d-63b3-4e68-b790-28bb5ac02f66 Sep 04 18:12:58 devstack sudo[108328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:58 devstack sudo[108328]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e004eeeb-be13-47e0-abb9-d986b1e62c63 tempest-ProjectReaderTests-1030742843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-36e1c45d-63b3-4e68-b790-28bb5ac02f66" returned: 0 in 0.347s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e004eeeb-be13-47e0-abb9-d986b1e62c63 tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-36e1c45d-63b3-4e68-b790-28bb5ac02f66.2f747106-23a5-4dcb-b166-f59e5ad4ff52 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:58 devstack sudo[108333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-36e1c45d-63b3-4e68-b790-28bb5ac02f66.2f747106-23a5-4dcb-b166-f59e5ad4ff52 Sep 04 18:12:58 devstack sudo[108333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:58 devstack sudo[108333]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e004eeeb-be13-47e0-abb9-d986b1e62c63 tempest-ProjectReaderTests-1030742843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-36e1c45d-63b3-4e68-b790-28bb5ac02f66.2f747106-23a5-4dcb-b166-f59e5ad4ff52" returned: 0 in 0.318s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:58 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e004eeeb-be13-47e0-abb9-d986b1e62c63 tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-36e1c45d-63b3-4e68-b790-28bb5ac02f66.2f747106-23a5-4dcb-b166-f59e5ad4ff52 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:12:58 devstack sudo[108339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-36e1c45d-63b3-4e68-b790-28bb5ac02f66.2f747106-23a5-4dcb-b166-f59e5ad4ff52 Sep 04 18:12:58 devstack sudo[108339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:12:59 devstack sudo[108339]: pam_unix(sudo:session): session closed for user root Sep 04 18:12:59 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-e004eeeb-be13-47e0-abb9-d986b1e62c63 tempest-ProjectReaderTests-1030742843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-36e1c45d-63b3-4e68-b790-28bb5ac02f66.2f747106-23a5-4dcb-b166-f59e5ad4ff52" returned: 0 in 0.236s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:12:59 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e004eeeb-be13-47e0-abb9-d986b1e62c63 tempest-ProjectReaderTests-1030742843 None] Lock "cinder-quobyte-2f747106-23a5-4dcb-b166-f59e5ad4ff52" released by "_delete_snapshot" :: held 1.319s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:12:59 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e004eeeb-be13-47e0-abb9-d986b1e62c63 tempest-ProjectReaderTests-1030742843 None] Lock "cinder-quobyte-36e1c45d-63b3-4e68-b790-28bb5ac02f66" released by "delete_snapshot" :: held 1.342s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:12:59 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-e004eeeb-be13-47e0-abb9-d986b1e62c63 tempest-ProjectReaderTests-1030742843 None] Created reservations ['bc203372-e6de-4312-8ab2-691421ad27f8', 'd4150e4e-1e0a-4102-9c94-4900b34cdb1a', '67ebea98-824d-40dd-b811-c73507e50d42', '61ea45ad-42b6-4dee-b85e-784c6992f55c'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:12:59 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-e004eeeb-be13-47e0-abb9-d986b1e62c63 tempest-ProjectReaderTests-1030742843 None] Delete snapshot completed successfully. Sep 04 18:12:59 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-e004eeeb-be13-47e0-abb9-d986b1e62c63 tempest-ProjectReaderTests-1030742843 None] Lock "cinder-2f747106-23a5-4dcb-b166-f59e5ad4ff52-delete_snapshot" released by "delete_snapshot" :: held 1.464s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:12:59 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-65e0bbda-9cfe-4b5e-a966-8136efd3d413 tempest-ProjectReaderTests-1030742843 None] Acquiring lock "cinder-36e1c45d-63b3-4e68-b790-28bb5ac02f66-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:13:00 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-65e0bbda-9cfe-4b5e-a966-8136efd3d413 tempest-ProjectReaderTests-1030742843 None] Lock "cinder-36e1c45d-63b3-4e68-b790-28bb5ac02f66-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:13:00 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-65e0bbda-9cfe-4b5e-a966-8136efd3d413 tempest-ProjectReaderTests-1030742843 None] Acquiring lock "cinder-quobyte-36e1c45d-63b3-4e68-b790-28bb5ac02f66" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:13:00 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-65e0bbda-9cfe-4b5e-a966-8136efd3d413 tempest-ProjectReaderTests-1030742843 None] Lock "cinder-quobyte-36e1c45d-63b3-4e68-b790-28bb5ac02f66" acquired by "delete_volume" :: waited 0.015s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:13:00 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0756282-d222-402d-bcba-2a671d0afa12]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:13:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-65e0bbda-9cfe-4b5e-a966-8136efd3d413 tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-36e1c45d-63b3-4e68-b790-28bb5ac02f66 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:13:00 devstack sudo[108342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-36e1c45d-63b3-4e68-b790-28bb5ac02f66 Sep 04 18:13:00 devstack sudo[108342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:13:00 devstack sudo[108342]: pam_unix(sudo:session): session closed for user root Sep 04 18:13:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-65e0bbda-9cfe-4b5e-a966-8136efd3d413 tempest-ProjectReaderTests-1030742843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-36e1c45d-63b3-4e68-b790-28bb5ac02f66" returned: 0 in 0.352s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:13:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-65e0bbda-9cfe-4b5e-a966-8136efd3d413 tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-36e1c45d-63b3-4e68-b790-28bb5ac02f66 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:13:00 devstack sudo[108348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-36e1c45d-63b3-4e68-b790-28bb5ac02f66 Sep 04 18:13:00 devstack sudo[108348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:13:00 devstack sudo[108348]: pam_unix(sudo:session): session closed for user root Sep 04 18:13:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-65e0bbda-9cfe-4b5e-a966-8136efd3d413 tempest-ProjectReaderTests-1030742843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-36e1c45d-63b3-4e68-b790-28bb5ac02f66" returned: 0 in 0.234s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:13:00 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-65e0bbda-9cfe-4b5e-a966-8136efd3d413 tempest-ProjectReaderTests-1030742843 None] Lock "cinder-quobyte-36e1c45d-63b3-4e68-b790-28bb5ac02f66" released by "delete_volume" :: held 0.647s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:13:00 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:INSERT=49,cinder:UPDATE=140,cinder:SELECT=98,cinder:DELETE=14 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 18:13:00 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=124,cinder:UPDATE=149,cinder:DELETE=10,cinder:INSERT=31 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 18:13:00 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-65e0bbda-9cfe-4b5e-a966-8136efd3d413 tempest-ProjectReaderTests-1030742843 None] Created reservations ['dda3a282-c523-4106-8adf-f32549b1a8b0', 'f552e7ca-2525-4bd1-acbe-c09d4124348f', '172f010a-01d5-4897-ad24-c04a786eb8f5', 'ac0d4551-449a-4814-8784-df17154eacf1'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:13:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-65e0bbda-9cfe-4b5e-a966-8136efd3d413 tempest-ProjectReaderTests-1030742843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:13:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-65e0bbda-9cfe-4b5e-a966-8136efd3d413 tempest-ProjectReaderTests-1030742843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:13:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-65e0bbda-9cfe-4b5e-a966-8136efd3d413 tempest-ProjectReaderTests-1030742843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:13:00 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-65e0bbda-9cfe-4b5e-a966-8136efd3d413 tempest-ProjectReaderTests-1030742843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:13:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-65e0bbda-9cfe-4b5e-a966-8136efd3d413 tempest-ProjectReaderTests-1030742843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:13:00 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-65e0bbda-9cfe-4b5e-a966-8136efd3d413 tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:13:00 devstack sudo[108351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:13:00 devstack sudo[108351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:13:01 devstack sudo[108351]: pam_unix(sudo:session): session closed for user root Sep 04 18:13:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-65e0bbda-9cfe-4b5e-a966-8136efd3d413 tempest-ProjectReaderTests-1030742843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.235s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:13:01 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-65e0bbda-9cfe-4b5e-a966-8136efd3d413 tempest-ProjectReaderTests-1030742843 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:13:01 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-65e0bbda-9cfe-4b5e-a966-8136efd3d413 tempest-ProjectReaderTests-1030742843 None] Deleted volume successfully. Sep 04 18:13:01 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-65e0bbda-9cfe-4b5e-a966-8136efd3d413 tempest-ProjectReaderTests-1030742843 None] Lock "cinder-36e1c45d-63b3-4e68-b790-28bb5ac02f66-delete_volume" released by "delete_volume" :: held 1.095s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:13:01 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b89b70a-693b-495e-93eb-7fd0621c8c8b tempest-ProjectReaderTests-1030742843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:13:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5b89b70a-693b-495e-93eb-7fd0621c8c8b tempest-ProjectReaderTests-1030742843 None] Flow 'volume_create_manager' (55bba818-23ae-4f13-9c91-8b99e3579f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:13:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5b89b70a-693b-495e-93eb-7fd0621c8c8b tempest-ProjectReaderTests-1030742843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f494c21-2d79-48a2-b77c-b7af7e5ee107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:13:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5b89b70a-693b-495e-93eb-7fd0621c8c8b tempest-ProjectReaderTests-1030742843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f494c21-2d79-48a2-b77c-b7af7e5ee107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:13:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-275310332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b40cfa94-89e2-41c7-b8ca-24cc074133ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25f84d71b6db4272853e1c3fe5986eb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:13:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:13:02Z,use_quota=True,user_id='a9c3bac0753c42c8a9ee10b4d904a664',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:13:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5b89b70a-693b-495e-93eb-7fd0621c8c8b tempest-ProjectReaderTests-1030742843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fca2c4d3-e050-4096-af51-93d21ce3efd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:13:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5b89b70a-693b-495e-93eb-7fd0621c8c8b tempest-ProjectReaderTests-1030742843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fca2c4d3-e050-4096-af51-93d21ce3efd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:13:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5b89b70a-693b-495e-93eb-7fd0621c8c8b tempest-ProjectReaderTests-1030742843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b384c478-9b30-4902-b4b2-84eb8f4d58b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:13:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5b89b70a-693b-495e-93eb-7fd0621c8c8b tempest-ProjectReaderTests-1030742843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b384c478-9b30-4902-b4b2-84eb8f4d58b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b40cfa94-89e2-41c7-b8ca-24cc074133ab', 'volume_name': 'volume-b40cfa94-89e2-41c7-b8ca-24cc074133ab', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:13:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5b89b70a-693b-495e-93eb-7fd0621c8c8b tempest-ProjectReaderTests-1030742843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1f37eef-824e-417a-9f91-14761e5911af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:13:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5b89b70a-693b-495e-93eb-7fd0621c8c8b tempest-ProjectReaderTests-1030742843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1f37eef-824e-417a-9f91-14761e5911af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:13:01 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5b89b70a-693b-495e-93eb-7fd0621c8c8b tempest-ProjectReaderTests-1030742843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0ea9573-7e86-433f-adcf-c44c607f87d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:13:01 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-5b89b70a-693b-495e-93eb-7fd0621c8c8b tempest-ProjectReaderTests-1030742843 None] Volume b40cfa94-89e2-41c7-b8ca-24cc074133ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b40cfa94-89e2-41c7-b8ca-24cc074133ab', 'volume_size': 1} Sep 04 18:13:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5b89b70a-693b-495e-93eb-7fd0621c8c8b tempest-ProjectReaderTests-1030742843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:13:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5b89b70a-693b-495e-93eb-7fd0621c8c8b tempest-ProjectReaderTests-1030742843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:13:01 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5b89b70a-693b-495e-93eb-7fd0621c8c8b tempest-ProjectReaderTests-1030742843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:13:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-275310332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b40cfa94-89e2-41c7-b8ca-24cc074133ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25f84d71b6db4272853e1c3fe5986eb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:13:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:13:02Z,use_quota=True,user_id='a9c3bac0753c42c8a9ee10b4d904a664',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:13:01 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-5b89b70a-693b-495e-93eb-7fd0621c8c8b tempest-ProjectReaderTests-1030742843 None] Creating volume b40cfa94-89e2-41c7-b8ca-24cc074133ab {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:13:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5b89b70a-693b-495e-93eb-7fd0621c8c8b tempest-ProjectReaderTests-1030742843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:13:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5b89b70a-693b-495e-93eb-7fd0621c8c8b tempest-ProjectReaderTests-1030742843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:13:01 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5b89b70a-693b-495e-93eb-7fd0621c8c8b tempest-ProjectReaderTests-1030742843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:13:01 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5b89b70a-693b-495e-93eb-7fd0621c8c8b tempest-ProjectReaderTests-1030742843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:13:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5b89b70a-693b-495e-93eb-7fd0621c8c8b tempest-ProjectReaderTests-1030742843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:13:01 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5b89b70a-693b-495e-93eb-7fd0621c8c8b tempest-ProjectReaderTests-1030742843 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:13:01 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-5b89b70a-693b-495e-93eb-7fd0621c8c8b tempest-ProjectReaderTests-1030742843 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:13:01 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5b89b70a-693b-495e-93eb-7fd0621c8c8b tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b40cfa94-89e2-41c7-b8ca-24cc074133ab 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:13:01 devstack sudo[108360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b40cfa94-89e2-41c7-b8ca-24cc074133ab 1073741824 Sep 04 18:13:01 devstack sudo[108360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:13:02 devstack sudo[108360]: pam_unix(sudo:session): session closed for user root Sep 04 18:13:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5b89b70a-693b-495e-93eb-7fd0621c8c8b tempest-ProjectReaderTests-1030742843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b40cfa94-89e2-41c7-b8ca-24cc074133ab 1073741824" returned: 0 in 0.425s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:13:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5b89b70a-693b-495e-93eb-7fd0621c8c8b tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b40cfa94-89e2-41c7-b8ca-24cc074133ab {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:13:02 devstack sudo[108366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b40cfa94-89e2-41c7-b8ca-24cc074133ab Sep 04 18:13:02 devstack sudo[108366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:13:02 devstack sudo[108366]: pam_unix(sudo:session): session closed for user root Sep 04 18:13:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5b89b70a-693b-495e-93eb-7fd0621c8c8b tempest-ProjectReaderTests-1030742843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b40cfa94-89e2-41c7-b8ca-24cc074133ab" returned: 0 in 0.253s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:13:02 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-5b89b70a-693b-495e-93eb-7fd0621c8c8b tempest-ProjectReaderTests-1030742843 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:13:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-5b89b70a-693b-495e-93eb-7fd0621c8c8b tempest-ProjectReaderTests-1030742843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:13:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5b89b70a-693b-495e-93eb-7fd0621c8c8b tempest-ProjectReaderTests-1030742843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0ea9573-7e86-433f-adcf-c44c607f87d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b40cfa94-89e2-41c7-b8ca-24cc074133ab', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:13:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5b89b70a-693b-495e-93eb-7fd0621c8c8b tempest-ProjectReaderTests-1030742843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa3c0d8a-efb0-42fe-be80-5a671bafcdfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:13:02 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-5b89b70a-693b-495e-93eb-7fd0621c8c8b tempest-ProjectReaderTests-1030742843 None] Volume volume-b40cfa94-89e2-41c7-b8ca-24cc074133ab (b40cfa94-89e2-41c7-b8ca-24cc074133ab): created successfully Sep 04 18:13:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5b89b70a-693b-495e-93eb-7fd0621c8c8b tempest-ProjectReaderTests-1030742843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa3c0d8a-efb0-42fe-be80-5a671bafcdfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:13:02 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-5b89b70a-693b-495e-93eb-7fd0621c8c8b tempest-ProjectReaderTests-1030742843 None] Flow 'volume_create_manager' (55bba818-23ae-4f13-9c91-8b99e3579f9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:13:02 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-5b89b70a-693b-495e-93eb-7fd0621c8c8b tempest-ProjectReaderTests-1030742843 None] Created volume successfully. Sep 04 18:13:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-03b81df4-5853-42e7-a112-1bf3c7378de8 tempest-ProjectReaderTests-1030742843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:13:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-03b81df4-5853-42e7-a112-1bf3c7378de8 tempest-ProjectReaderTests-1030742843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:13:02 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-03b81df4-5853-42e7-a112-1bf3c7378de8 tempest-ProjectReaderTests-1030742843 None] Creating offline snapshot 5475b182-56e5-48ee-9b7d-b2391a87419c of volume b40cfa94-89e2-41c7-b8ca-24cc074133ab {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 18:13:02 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cdf54ed-c393-47f6-90f9-5ec65e2eaa61]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:13:02 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-03b81df4-5853-42e7-a112-1bf3c7378de8 tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b40cfa94-89e2-41c7-b8ca-24cc074133ab {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:13:02 devstack sudo[108371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b40cfa94-89e2-41c7-b8ca-24cc074133ab Sep 04 18:13:02 devstack sudo[108371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:13:03 devstack sudo[108371]: pam_unix(sudo:session): session closed for user root Sep 04 18:13:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-03b81df4-5853-42e7-a112-1bf3c7378de8 tempest-ProjectReaderTests-1030742843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b40cfa94-89e2-41c7-b8ca-24cc074133ab" returned: 0 in 0.350s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:13:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-03b81df4-5853-42e7-a112-1bf3c7378de8 tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b40cfa94-89e2-41c7-b8ca-24cc074133ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b40cfa94-89e2-41c7-b8ca-24cc074133ab.5475b182-56e5-48ee-9b7d-b2391a87419c 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:13:03 devstack sudo[108376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b40cfa94-89e2-41c7-b8ca-24cc074133ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b40cfa94-89e2-41c7-b8ca-24cc074133ab.5475b182-56e5-48ee-9b7d-b2391a87419c 1G Sep 04 18:13:03 devstack sudo[108376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:13:03 devstack sudo[108376]: pam_unix(sudo:session): session closed for user root Sep 04 18:13:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-03b81df4-5853-42e7-a112-1bf3c7378de8 tempest-ProjectReaderTests-1030742843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b40cfa94-89e2-41c7-b8ca-24cc074133ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b40cfa94-89e2-41c7-b8ca-24cc074133ab.5475b182-56e5-48ee-9b7d-b2391a87419c 1G" returned: 0 in 0.380s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:13:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-03b81df4-5853-42e7-a112-1bf3c7378de8 tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b40cfa94-89e2-41c7-b8ca-24cc074133ab -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b40cfa94-89e2-41c7-b8ca-24cc074133ab.5475b182-56e5-48ee-9b7d-b2391a87419c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:13:03 devstack sudo[108381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b40cfa94-89e2-41c7-b8ca-24cc074133ab -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b40cfa94-89e2-41c7-b8ca-24cc074133ab.5475b182-56e5-48ee-9b7d-b2391a87419c Sep 04 18:13:03 devstack sudo[108381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:13:03 devstack sudo[108381]: pam_unix(sudo:session): session closed for user root Sep 04 18:13:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-03b81df4-5853-42e7-a112-1bf3c7378de8 tempest-ProjectReaderTests-1030742843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b40cfa94-89e2-41c7-b8ca-24cc074133ab -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b40cfa94-89e2-41c7-b8ca-24cc074133ab.5475b182-56e5-48ee-9b7d-b2391a87419c" returned: 0 in 0.277s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:13:03 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-03b81df4-5853-42e7-a112-1bf3c7378de8 tempest-ProjectReaderTests-1030742843 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b40cfa94-89e2-41c7-b8ca-24cc074133ab.5475b182-56e5-48ee-9b7d-b2391a87419c is being set with open permissions: ugo+rw Sep 04 18:13:03 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-03b81df4-5853-42e7-a112-1bf3c7378de8 tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b40cfa94-89e2-41c7-b8ca-24cc074133ab.5475b182-56e5-48ee-9b7d-b2391a87419c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:13:03 devstack sudo[108386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b40cfa94-89e2-41c7-b8ca-24cc074133ab.5475b182-56e5-48ee-9b7d-b2391a87419c Sep 04 18:13:03 devstack sudo[108386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:13:04 devstack sudo[108386]: pam_unix(sudo:session): session closed for user root Sep 04 18:13:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-03b81df4-5853-42e7-a112-1bf3c7378de8 tempest-ProjectReaderTests-1030742843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b40cfa94-89e2-41c7-b8ca-24cc074133ab.5475b182-56e5-48ee-9b7d-b2391a87419c" returned: 0 in 0.235s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:13:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-03b81df4-5853-42e7-a112-1bf3c7378de8 tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b40cfa94-89e2-41c7-b8ca-24cc074133ab.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:13:04 devstack sudo[108390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b40cfa94-89e2-41c7-b8ca-24cc074133ab.info Sep 04 18:13:04 devstack sudo[108390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:13:04 devstack sudo[108390]: pam_unix(sudo:session): session closed for user root Sep 04 18:13:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-03b81df4-5853-42e7-a112-1bf3c7378de8 tempest-ProjectReaderTests-1030742843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b40cfa94-89e2-41c7-b8ca-24cc074133ab.info" returned: 0 in 0.242s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:13:04 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-03b81df4-5853-42e7-a112-1bf3c7378de8 tempest-ProjectReaderTests-1030742843 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b40cfa94-89e2-41c7-b8ca-24cc074133ab.info is being set with open permissions: ugo+rw Sep 04 18:13:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-03b81df4-5853-42e7-a112-1bf3c7378de8 tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b40cfa94-89e2-41c7-b8ca-24cc074133ab.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:13:04 devstack sudo[108393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b40cfa94-89e2-41c7-b8ca-24cc074133ab.info Sep 04 18:13:04 devstack sudo[108393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:13:04 devstack sudo[108393]: pam_unix(sudo:session): session closed for user root Sep 04 18:13:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-03b81df4-5853-42e7-a112-1bf3c7378de8 tempest-ProjectReaderTests-1030742843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b40cfa94-89e2-41c7-b8ca-24cc074133ab.info" returned: 0 in 0.240s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:13:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-03b81df4-5853-42e7-a112-1bf3c7378de8 tempest-ProjectReaderTests-1030742843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.796s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:13:04 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-03b81df4-5853-42e7-a112-1bf3c7378de8 tempest-ProjectReaderTests-1030742843 None] Create snapshot completed successfully Sep 04 18:13:04 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5da5aa13-f8de-435a-95cc-5e79aebcbabc tempest-ProjectReaderTests-1030742843 None] Acquiring lock "cinder-5475b182-56e5-48ee-9b7d-b2391a87419c-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:13:04 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5da5aa13-f8de-435a-95cc-5e79aebcbabc tempest-ProjectReaderTests-1030742843 None] Lock "cinder-5475b182-56e5-48ee-9b7d-b2391a87419c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:13:04 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5da5aa13-f8de-435a-95cc-5e79aebcbabc tempest-ProjectReaderTests-1030742843 None] Acquiring lock "cinder-quobyte-b40cfa94-89e2-41c7-b8ca-24cc074133ab" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:13:04 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5da5aa13-f8de-435a-95cc-5e79aebcbabc tempest-ProjectReaderTests-1030742843 None] Lock "cinder-quobyte-b40cfa94-89e2-41c7-b8ca-24cc074133ab" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:13:04 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5da5aa13-f8de-435a-95cc-5e79aebcbabc tempest-ProjectReaderTests-1030742843 None] Acquiring lock "cinder-quobyte-5475b182-56e5-48ee-9b7d-b2391a87419c" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:13:04 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5da5aa13-f8de-435a-95cc-5e79aebcbabc tempest-ProjectReaderTests-1030742843 None] Lock "cinder-quobyte-5475b182-56e5-48ee-9b7d-b2391a87419c" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:13:04 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-5da5aa13-f8de-435a-95cc-5e79aebcbabc tempest-ProjectReaderTests-1030742843 None] Deleting offline snapshot 5475b182-56e5-48ee-9b7d-b2391a87419c of volume b40cfa94-89e2-41c7-b8ca-24cc074133ab {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 18:13:04 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-5da5aa13-f8de-435a-95cc-5e79aebcbabc tempest-ProjectReaderTests-1030742843 None] snapshot_file for this snap is: volume-b40cfa94-89e2-41c7-b8ca-24cc074133ab.5475b182-56e5-48ee-9b7d-b2391a87419c {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 18:13:04 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a76fa0-a3e1-44a4-bc07-07e4b97cb31d]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:13:04 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5da5aa13-f8de-435a-95cc-5e79aebcbabc tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b40cfa94-89e2-41c7-b8ca-24cc074133ab.5475b182-56e5-48ee-9b7d-b2391a87419c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:13:05 devstack sudo[108396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b40cfa94-89e2-41c7-b8ca-24cc074133ab.5475b182-56e5-48ee-9b7d-b2391a87419c Sep 04 18:13:05 devstack sudo[108396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:13:05 devstack sudo[108396]: pam_unix(sudo:session): session closed for user root Sep 04 18:13:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5da5aa13-f8de-435a-95cc-5e79aebcbabc tempest-ProjectReaderTests-1030742843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b40cfa94-89e2-41c7-b8ca-24cc074133ab.5475b182-56e5-48ee-9b7d-b2391a87419c" returned: 0 in 0.360s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:13:05 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-5da5aa13-f8de-435a-95cc-5e79aebcbabc tempest-ProjectReaderTests-1030742843 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b40cfa94-89e2-41c7-b8ca-24cc074133ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 18:13:05 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[334fc350-529e-4304-920c-f82c0ba0d603]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:13:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5da5aa13-f8de-435a-95cc-5e79aebcbabc tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b40cfa94-89e2-41c7-b8ca-24cc074133ab {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:13:05 devstack sudo[108401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b40cfa94-89e2-41c7-b8ca-24cc074133ab Sep 04 18:13:05 devstack sudo[108401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:13:05 devstack sudo[108401]: pam_unix(sudo:session): session closed for user root Sep 04 18:13:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5da5aa13-f8de-435a-95cc-5e79aebcbabc tempest-ProjectReaderTests-1030742843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b40cfa94-89e2-41c7-b8ca-24cc074133ab" returned: 0 in 0.345s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:13:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5da5aa13-f8de-435a-95cc-5e79aebcbabc tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b40cfa94-89e2-41c7-b8ca-24cc074133ab.5475b182-56e5-48ee-9b7d-b2391a87419c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:13:05 devstack sudo[108406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b40cfa94-89e2-41c7-b8ca-24cc074133ab.5475b182-56e5-48ee-9b7d-b2391a87419c Sep 04 18:13:05 devstack sudo[108406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:13:05 devstack sudo[108406]: pam_unix(sudo:session): session closed for user root Sep 04 18:13:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5da5aa13-f8de-435a-95cc-5e79aebcbabc tempest-ProjectReaderTests-1030742843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b40cfa94-89e2-41c7-b8ca-24cc074133ab.5475b182-56e5-48ee-9b7d-b2391a87419c" returned: 0 in 0.316s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:13:05 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5da5aa13-f8de-435a-95cc-5e79aebcbabc tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b40cfa94-89e2-41c7-b8ca-24cc074133ab.5475b182-56e5-48ee-9b7d-b2391a87419c {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:13:06 devstack sudo[108411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b40cfa94-89e2-41c7-b8ca-24cc074133ab.5475b182-56e5-48ee-9b7d-b2391a87419c Sep 04 18:13:06 devstack sudo[108411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:13:06 devstack sudo[108411]: pam_unix(sudo:session): session closed for user root Sep 04 18:13:06 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-5da5aa13-f8de-435a-95cc-5e79aebcbabc tempest-ProjectReaderTests-1030742843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b40cfa94-89e2-41c7-b8ca-24cc074133ab.5475b182-56e5-48ee-9b7d-b2391a87419c" returned: 0 in 0.237s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:13:06 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5da5aa13-f8de-435a-95cc-5e79aebcbabc tempest-ProjectReaderTests-1030742843 None] Lock "cinder-quobyte-5475b182-56e5-48ee-9b7d-b2391a87419c" released by "_delete_snapshot" :: held 1.338s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:13:06 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5da5aa13-f8de-435a-95cc-5e79aebcbabc tempest-ProjectReaderTests-1030742843 None] Lock "cinder-quobyte-b40cfa94-89e2-41c7-b8ca-24cc074133ab" released by "delete_snapshot" :: held 1.358s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:13:06 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-5da5aa13-f8de-435a-95cc-5e79aebcbabc tempest-ProjectReaderTests-1030742843 None] Created reservations ['201e0497-1bb6-47f3-9838-5c548a7f46f9', '75d51d07-687b-48f7-9e22-6b1da9fc0e1e', '033b99d4-f99a-4878-b2dd-422fd18fa3d6', '2c81a3fb-2910-4491-b8d3-465978acb0d7'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:13:06 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-5da5aa13-f8de-435a-95cc-5e79aebcbabc tempest-ProjectReaderTests-1030742843 None] Delete snapshot completed successfully. Sep 04 18:13:06 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-5da5aa13-f8de-435a-95cc-5e79aebcbabc tempest-ProjectReaderTests-1030742843 None] Lock "cinder-5475b182-56e5-48ee-9b7d-b2391a87419c-delete_snapshot" released by "delete_snapshot" :: held 1.491s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:13:07 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f5f7b925-4348-4e8f-98d7-75a2d7de8b17 tempest-ProjectReaderTests-1030742843 None] Acquiring lock "cinder-b40cfa94-89e2-41c7-b8ca-24cc074133ab-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:13:07 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f5f7b925-4348-4e8f-98d7-75a2d7de8b17 tempest-ProjectReaderTests-1030742843 None] Lock "cinder-b40cfa94-89e2-41c7-b8ca-24cc074133ab-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:13:07 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f5f7b925-4348-4e8f-98d7-75a2d7de8b17 tempest-ProjectReaderTests-1030742843 None] Acquiring lock "cinder-quobyte-b40cfa94-89e2-41c7-b8ca-24cc074133ab" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:13:07 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f5f7b925-4348-4e8f-98d7-75a2d7de8b17 tempest-ProjectReaderTests-1030742843 None] Lock "cinder-quobyte-b40cfa94-89e2-41c7-b8ca-24cc074133ab" acquired by "delete_volume" :: waited 0.016s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:13:07 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[7595c290-97b1-4f1d-aa6e-26da12b46e16]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:13:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f5f7b925-4348-4e8f-98d7-75a2d7de8b17 tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b40cfa94-89e2-41c7-b8ca-24cc074133ab {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:13:07 devstack sudo[108414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b40cfa94-89e2-41c7-b8ca-24cc074133ab Sep 04 18:13:07 devstack sudo[108414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:13:07 devstack sudo[108414]: pam_unix(sudo:session): session closed for user root Sep 04 18:13:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f5f7b925-4348-4e8f-98d7-75a2d7de8b17 tempest-ProjectReaderTests-1030742843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b40cfa94-89e2-41c7-b8ca-24cc074133ab" returned: 0 in 0.351s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:13:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f5f7b925-4348-4e8f-98d7-75a2d7de8b17 tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b40cfa94-89e2-41c7-b8ca-24cc074133ab {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:13:07 devstack sudo[108420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b40cfa94-89e2-41c7-b8ca-24cc074133ab Sep 04 18:13:07 devstack sudo[108420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:13:07 devstack sudo[108420]: pam_unix(sudo:session): session closed for user root Sep 04 18:13:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f5f7b925-4348-4e8f-98d7-75a2d7de8b17 tempest-ProjectReaderTests-1030742843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-b40cfa94-89e2-41c7-b8ca-24cc074133ab" returned: 0 in 0.245s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:13:07 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f5f7b925-4348-4e8f-98d7-75a2d7de8b17 tempest-ProjectReaderTests-1030742843 None] Lock "cinder-quobyte-b40cfa94-89e2-41c7-b8ca-24cc074133ab" released by "delete_volume" :: held 0.652s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:13:07 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-f5f7b925-4348-4e8f-98d7-75a2d7de8b17 tempest-ProjectReaderTests-1030742843 None] Created reservations ['b49c9f6a-200a-49e2-9201-cb756fc24109', '120fe4e6-f79c-4009-9b1d-2f7ab1f8c9b7', 'b9e9b16f-957a-4dc7-9656-9ab29a13cb71', '388df877-c515-4e7d-af65-667c0bae02b6'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:13:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f5f7b925-4348-4e8f-98d7-75a2d7de8b17 tempest-ProjectReaderTests-1030742843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:13:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f5f7b925-4348-4e8f-98d7-75a2d7de8b17 tempest-ProjectReaderTests-1030742843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:13:07 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f5f7b925-4348-4e8f-98d7-75a2d7de8b17 tempest-ProjectReaderTests-1030742843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:13:07 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-f5f7b925-4348-4e8f-98d7-75a2d7de8b17 tempest-ProjectReaderTests-1030742843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:13:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-f5f7b925-4348-4e8f-98d7-75a2d7de8b17 tempest-ProjectReaderTests-1030742843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:13:07 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f5f7b925-4348-4e8f-98d7-75a2d7de8b17 tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:13:07 devstack sudo[108423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:13:07 devstack sudo[108423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:13:08 devstack sudo[108423]: pam_unix(sudo:session): session closed for user root Sep 04 18:13:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-f5f7b925-4348-4e8f-98d7-75a2d7de8b17 tempest-ProjectReaderTests-1030742843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.228s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:13:08 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-f5f7b925-4348-4e8f-98d7-75a2d7de8b17 tempest-ProjectReaderTests-1030742843 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:13:08 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-f5f7b925-4348-4e8f-98d7-75a2d7de8b17 tempest-ProjectReaderTests-1030742843 None] Deleted volume successfully. Sep 04 18:13:08 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-f5f7b925-4348-4e8f-98d7-75a2d7de8b17 tempest-ProjectReaderTests-1030742843 None] Lock "cinder-b40cfa94-89e2-41c7-b8ca-24cc074133ab-delete_volume" released by "delete_volume" :: held 1.063s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:13:08 devstack cinder-volume[87314]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3cd6056-8ff7-49da-ac20-e97860c68eec tempest-ProjectReaderTests-1030742843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87314) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 18:13:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a3cd6056-8ff7-49da-ac20-e97860c68eec tempest-ProjectReaderTests-1030742843 None] Flow 'volume_create_manager' (772fa77f-9b13-4db1-bbb4-e0ec324d6959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:13:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a3cd6056-8ff7-49da-ac20-e97860c68eec tempest-ProjectReaderTests-1030742843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eccab6cf-bf7b-4571-9080-cfcbcf5a8830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:13:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a3cd6056-8ff7-49da-ac20-e97860c68eec tempest-ProjectReaderTests-1030742843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eccab6cf-bf7b-4571-9080-cfcbcf5a8830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:13:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-905407891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25f84d71b6db4272853e1c3fe5986eb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:13:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:13:09Z,use_quota=True,user_id='a9c3bac0753c42c8a9ee10b4d904a664',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:13:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a3cd6056-8ff7-49da-ac20-e97860c68eec tempest-ProjectReaderTests-1030742843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1a53216-e994-4d43-914c-2ec59f073cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:13:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a3cd6056-8ff7-49da-ac20-e97860c68eec tempest-ProjectReaderTests-1030742843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1a53216-e994-4d43-914c-2ec59f073cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:13:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a3cd6056-8ff7-49da-ac20-e97860c68eec tempest-ProjectReaderTests-1030742843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22459b8a-9a7c-4a98-8e2e-1381e93a094f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:13:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a3cd6056-8ff7-49da-ac20-e97860c68eec tempest-ProjectReaderTests-1030742843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22459b8a-9a7c-4a98-8e2e-1381e93a094f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f', 'volume_name': 'volume-7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:13:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a3cd6056-8ff7-49da-ac20-e97860c68eec tempest-ProjectReaderTests-1030742843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78e73a6b-a5ae-42ed-af8d-e93fa43cae52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:13:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a3cd6056-8ff7-49da-ac20-e97860c68eec tempest-ProjectReaderTests-1030742843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78e73a6b-a5ae-42ed-af8d-e93fa43cae52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:13:08 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a3cd6056-8ff7-49da-ac20-e97860c68eec tempest-ProjectReaderTests-1030742843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (298b102a-85af-4b65-8ecc-d133ed85128f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:13:08 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-a3cd6056-8ff7-49da-ac20-e97860c68eec tempest-ProjectReaderTests-1030742843 None] Volume 7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f', 'volume_size': 1} Sep 04 18:13:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a3cd6056-8ff7-49da-ac20-e97860c68eec tempest-ProjectReaderTests-1030742843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:13:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a3cd6056-8ff7-49da-ac20-e97860c68eec tempest-ProjectReaderTests-1030742843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:13:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a3cd6056-8ff7-49da-ac20-e97860c68eec tempest-ProjectReaderTests-1030742843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T16:13:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-905407891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25f84d71b6db4272853e1c3fe5986eb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T16:13:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T16:13:09Z,use_quota=True,user_id='a9c3bac0753c42c8a9ee10b4d904a664',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e33e889-aa4a-4578-83c0-eccd8e674cc8),volume_type_id=7e33e889-aa4a-4578-83c0-eccd8e674cc8)}" {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 18:13:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-a3cd6056-8ff7-49da-ac20-e97860c68eec tempest-ProjectReaderTests-1030742843 None] Creating volume 7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f {{(pid=87314) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 18:13:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a3cd6056-8ff7-49da-ac20-e97860c68eec tempest-ProjectReaderTests-1030742843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:13:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a3cd6056-8ff7-49da-ac20-e97860c68eec tempest-ProjectReaderTests-1030742843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:13:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a3cd6056-8ff7-49da-ac20-e97860c68eec tempest-ProjectReaderTests-1030742843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:13:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a3cd6056-8ff7-49da-ac20-e97860c68eec tempest-ProjectReaderTests-1030742843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:13:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a3cd6056-8ff7-49da-ac20-e97860c68eec tempest-ProjectReaderTests-1030742843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:13:08 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a3cd6056-8ff7-49da-ac20-e97860c68eec tempest-ProjectReaderTests-1030742843 None] Selected osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a as target Quobyte volume. {{(pid=87314) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 18:13:08 devstack cinder-volume[87314]: INFO cinder.volume.drivers.remotefs [None req-a3cd6056-8ff7-49da-ac20-e97860c68eec tempest-ProjectReaderTests-1030742843 None] casted to osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a Sep 04 18:13:08 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a3cd6056-8ff7-49da-ac20-e97860c68eec tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f 1073741824 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:13:08 devstack sudo[108426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f 1073741824 Sep 04 18:13:08 devstack sudo[108426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:13:09 devstack sudo[108426]: pam_unix(sudo:session): session closed for user root Sep 04 18:13:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a3cd6056-8ff7-49da-ac20-e97860c68eec tempest-ProjectReaderTests-1030742843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f 1073741824" returned: 0 in 0.384s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:13:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a3cd6056-8ff7-49da-ac20-e97860c68eec tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:13:09 devstack sudo[108432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f Sep 04 18:13:09 devstack sudo[108432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:13:09 devstack sudo[108432]: pam_unix(sudo:session): session closed for user root Sep 04 18:13:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-a3cd6056-8ff7-49da-ac20-e97860c68eec tempest-ProjectReaderTests-1030742843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f" returned: 0 in 0.235s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:13:09 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-a3cd6056-8ff7-49da-ac20-e97860c68eec tempest-ProjectReaderTests-1030742843 None] <== create_volume: return (662ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'} {{(pid=87314) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 18:13:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-a3cd6056-8ff7-49da-ac20-e97860c68eec tempest-ProjectReaderTests-1030742843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.664s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:13:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a3cd6056-8ff7-49da-ac20-e97860c68eec tempest-ProjectReaderTests-1030742843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (298b102a-85af-4b65-8ecc-d133ed85128f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f', 'volume_size': 1}' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:13:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a3cd6056-8ff7-49da-ac20-e97860c68eec tempest-ProjectReaderTests-1030742843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdd4e719-2086-49a5-9d0a-6e2a35d92a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 18:13:09 devstack cinder-volume[87314]: INFO cinder.volume.flows.manager.create_volume [None req-a3cd6056-8ff7-49da-ac20-e97860c68eec tempest-ProjectReaderTests-1030742843 None] Volume volume-7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f (7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f): created successfully Sep 04 18:13:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a3cd6056-8ff7-49da-ac20-e97860c68eec tempest-ProjectReaderTests-1030742843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdd4e719-2086-49a5-9d0a-6e2a35d92a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87314) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 18:13:09 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-a3cd6056-8ff7-49da-ac20-e97860c68eec tempest-ProjectReaderTests-1030742843 None] Flow 'volume_create_manager' (772fa77f-9b13-4db1-bbb4-e0ec324d6959) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87314) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 18:13:09 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-a3cd6056-8ff7-49da-ac20-e97860c68eec tempest-ProjectReaderTests-1030742843 None] Created volume successfully. Sep 04 18:13:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-960a4641-5ba8-4834-8afd-8f2f6a63f301 tempest-ProjectReaderTests-1030742843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:13:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-960a4641-5ba8-4834-8afd-8f2f6a63f301 tempest-ProjectReaderTests-1030742843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:13:09 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-960a4641-5ba8-4834-8afd-8f2f6a63f301 tempest-ProjectReaderTests-1030742843 None] Creating offline snapshot 97d7903c-0784-4992-8d42-f00ae1b90f4d of volume 7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f {{(pid=87314) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 18:13:09 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[c298c35a-0cad-44fc-aa12-c1d533fbd95a]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:13:09 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-960a4641-5ba8-4834-8afd-8f2f6a63f301 tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:13:09 devstack sudo[108435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f Sep 04 18:13:09 devstack sudo[108435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:13:10 devstack sudo[108435]: pam_unix(sudo:session): session closed for user root Sep 04 18:13:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-960a4641-5ba8-4834-8afd-8f2f6a63f301 tempest-ProjectReaderTests-1030742843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f" returned: 0 in 0.351s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:13:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-960a4641-5ba8-4834-8afd-8f2f6a63f301 tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f.97d7903c-0784-4992-8d42-f00ae1b90f4d 1G {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:13:10 devstack sudo[108440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f.97d7903c-0784-4992-8d42-f00ae1b90f4d 1G Sep 04 18:13:10 devstack sudo[108440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:13:10 devstack sudo[108440]: pam_unix(sudo:session): session closed for user root Sep 04 18:13:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-960a4641-5ba8-4834-8afd-8f2f6a63f301 tempest-ProjectReaderTests-1030742843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f.97d7903c-0784-4992-8d42-f00ae1b90f4d 1G" returned: 0 in 0.387s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:13:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-960a4641-5ba8-4834-8afd-8f2f6a63f301 tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f.97d7903c-0784-4992-8d42-f00ae1b90f4d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:13:10 devstack sudo[108445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f.97d7903c-0784-4992-8d42-f00ae1b90f4d Sep 04 18:13:10 devstack sudo[108445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:13:10 devstack sudo[108445]: pam_unix(sudo:session): session closed for user root Sep 04 18:13:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-960a4641-5ba8-4834-8afd-8f2f6a63f301 tempest-ProjectReaderTests-1030742843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f -F qcow2 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f.97d7903c-0784-4992-8d42-f00ae1b90f4d" returned: 0 in 0.298s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:13:10 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-960a4641-5ba8-4834-8afd-8f2f6a63f301 tempest-ProjectReaderTests-1030742843 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f.97d7903c-0784-4992-8d42-f00ae1b90f4d is being set with open permissions: ugo+rw Sep 04 18:13:10 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-960a4641-5ba8-4834-8afd-8f2f6a63f301 tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f.97d7903c-0784-4992-8d42-f00ae1b90f4d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:13:10 devstack sudo[108450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f.97d7903c-0784-4992-8d42-f00ae1b90f4d Sep 04 18:13:10 devstack sudo[108450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:13:11 devstack sudo[108450]: pam_unix(sudo:session): session closed for user root Sep 04 18:13:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-960a4641-5ba8-4834-8afd-8f2f6a63f301 tempest-ProjectReaderTests-1030742843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f.97d7903c-0784-4992-8d42-f00ae1b90f4d" returned: 0 in 0.245s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:13:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-960a4641-5ba8-4834-8afd-8f2f6a63f301 tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:13:11 devstack sudo[108453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f.info Sep 04 18:13:11 devstack sudo[108453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:13:11 devstack sudo[108453]: pam_unix(sudo:session): session closed for user root Sep 04 18:13:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-960a4641-5ba8-4834-8afd-8f2f6a63f301 tempest-ProjectReaderTests-1030742843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f.info" returned: 0 in 0.255s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:13:11 devstack cinder-volume[87314]: WARNING cinder.volume.drivers.remotefs [None req-960a4641-5ba8-4834-8afd-8f2f6a63f301 tempest-ProjectReaderTests-1030742843 None] /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f.info is being set with open permissions: ugo+rw Sep 04 18:13:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-960a4641-5ba8-4834-8afd-8f2f6a63f301 tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f.info {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:13:11 devstack sudo[108456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f.info Sep 04 18:13:11 devstack sudo[108456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:13:11 devstack sudo[108456]: pam_unix(sudo:session): session closed for user root Sep 04 18:13:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-960a4641-5ba8-4834-8afd-8f2f6a63f301 tempest-ProjectReaderTests-1030742843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f.info" returned: 0 in 0.237s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:13:11 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-960a4641-5ba8-4834-8afd-8f2f6a63f301 tempest-ProjectReaderTests-1030742843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.854s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:13:11 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-960a4641-5ba8-4834-8afd-8f2f6a63f301 tempest-ProjectReaderTests-1030742843 None] Create snapshot completed successfully Sep 04 18:13:11 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c48f29ec-525d-4de0-850a-34b1bde52f91 tempest-ProjectReaderTests-1030742843 None] Acquiring lock "cinder-97d7903c-0784-4992-8d42-f00ae1b90f4d-delete_snapshot" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:13:11 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c48f29ec-525d-4de0-850a-34b1bde52f91 tempest-ProjectReaderTests-1030742843 None] Lock "cinder-97d7903c-0784-4992-8d42-f00ae1b90f4d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:13:11 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c48f29ec-525d-4de0-850a-34b1bde52f91 tempest-ProjectReaderTests-1030742843 None] Acquiring lock "cinder-quobyte-7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f" by "delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:13:11 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c48f29ec-525d-4de0-850a-34b1bde52f91 tempest-ProjectReaderTests-1030742843 None] Lock "cinder-quobyte-7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:13:11 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c48f29ec-525d-4de0-850a-34b1bde52f91 tempest-ProjectReaderTests-1030742843 None] Acquiring lock "cinder-quobyte-97d7903c-0784-4992-8d42-f00ae1b90f4d" by "_delete_snapshot" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:13:11 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c48f29ec-525d-4de0-850a-34b1bde52f91 tempest-ProjectReaderTests-1030742843 None] Lock "cinder-quobyte-97d7903c-0784-4992-8d42-f00ae1b90f4d" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:13:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-c48f29ec-525d-4de0-850a-34b1bde52f91 tempest-ProjectReaderTests-1030742843 None] Deleting offline snapshot 97d7903c-0784-4992-8d42-f00ae1b90f4d of volume 7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 18:13:11 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-c48f29ec-525d-4de0-850a-34b1bde52f91 tempest-ProjectReaderTests-1030742843 None] snapshot_file for this snap is: volume-7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f.97d7903c-0784-4992-8d42-f00ae1b90f4d {{(pid=87314) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 18:13:12 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9be505-afd9-4272-9500-9b8e312770e7]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:13:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c48f29ec-525d-4de0-850a-34b1bde52f91 tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f.97d7903c-0784-4992-8d42-f00ae1b90f4d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:13:12 devstack sudo[108459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f.97d7903c-0784-4992-8d42-f00ae1b90f4d Sep 04 18:13:12 devstack sudo[108459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:13:12 devstack sudo[108459]: pam_unix(sudo:session): session closed for user root Sep 04 18:13:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c48f29ec-525d-4de0-850a-34b1bde52f91 tempest-ProjectReaderTests-1030742843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f.97d7903c-0784-4992-8d42-f00ae1b90f4d" returned: 0 in 0.350s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:13:12 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.remotefs [None req-c48f29ec-525d-4de0-850a-34b1bde52f91 tempest-ProjectReaderTests-1030742843 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87314) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 18:13:12 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc396ec-52a6-449d-9fed-fc9d96a8aac7]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:13:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c48f29ec-525d-4de0-850a-34b1bde52f91 tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:13:12 devstack sudo[108464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f Sep 04 18:13:12 devstack sudo[108464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:13:12 devstack sudo[108464]: pam_unix(sudo:session): session closed for user root Sep 04 18:13:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c48f29ec-525d-4de0-850a-34b1bde52f91 tempest-ProjectReaderTests-1030742843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f" returned: 0 in 0.359s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:13:12 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c48f29ec-525d-4de0-850a-34b1bde52f91 tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f.97d7903c-0784-4992-8d42-f00ae1b90f4d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:13:12 devstack sudo[108469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f.97d7903c-0784-4992-8d42-f00ae1b90f4d Sep 04 18:13:12 devstack sudo[108469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:13:13 devstack sudo[108469]: pam_unix(sudo:session): session closed for user root Sep 04 18:13:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c48f29ec-525d-4de0-850a-34b1bde52f91 tempest-ProjectReaderTests-1030742843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f.97d7903c-0784-4992-8d42-f00ae1b90f4d" returned: 0 in 0.338s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:13:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c48f29ec-525d-4de0-850a-34b1bde52f91 tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f.97d7903c-0784-4992-8d42-f00ae1b90f4d {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:13:13 devstack sudo[108474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f.97d7903c-0784-4992-8d42-f00ae1b90f4d Sep 04 18:13:13 devstack sudo[108474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:13:13 devstack sudo[108474]: pam_unix(sudo:session): session closed for user root Sep 04 18:13:13 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-c48f29ec-525d-4de0-850a-34b1bde52f91 tempest-ProjectReaderTests-1030742843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f.97d7903c-0784-4992-8d42-f00ae1b90f4d" returned: 0 in 0.268s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:13:13 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c48f29ec-525d-4de0-850a-34b1bde52f91 tempest-ProjectReaderTests-1030742843 None] Lock "cinder-quobyte-97d7903c-0784-4992-8d42-f00ae1b90f4d" released by "_delete_snapshot" :: held 1.401s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:13:13 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c48f29ec-525d-4de0-850a-34b1bde52f91 tempest-ProjectReaderTests-1030742843 None] Lock "cinder-quobyte-7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f" released by "delete_snapshot" :: held 1.423s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:13:13 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-c48f29ec-525d-4de0-850a-34b1bde52f91 tempest-ProjectReaderTests-1030742843 None] Created reservations ['5ed93410-7309-4e18-84fd-7e7426157822', 'b63ea927-b0c2-4e76-8382-4b069a54ddc6', '25d8e01f-ca99-464e-8921-623e2d3a5eea', '45b22351-0676-48a6-b40b-8d7098af67bb'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:13:13 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-c48f29ec-525d-4de0-850a-34b1bde52f91 tempest-ProjectReaderTests-1030742843 None] Delete snapshot completed successfully. Sep 04 18:13:13 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-c48f29ec-525d-4de0-850a-34b1bde52f91 tempest-ProjectReaderTests-1030742843 None] Lock "cinder-97d7903c-0784-4992-8d42-f00ae1b90f4d-delete_snapshot" released by "delete_snapshot" :: held 1.563s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:13:14 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3d1e8f23-f45c-4fcc-a2ee-cc8447337483 tempest-ProjectReaderTests-1030742843 None] Acquiring lock "cinder-7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f-delete_volume" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:13:14 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3d1e8f23-f45c-4fcc-a2ee-cc8447337483 tempest-ProjectReaderTests-1030742843 None] Lock "cinder-7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:13:14 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3d1e8f23-f45c-4fcc-a2ee-cc8447337483 tempest-ProjectReaderTests-1030742843 None] Acquiring lock "cinder-quobyte-7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f" by "delete_volume" {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 18:13:14 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3d1e8f23-f45c-4fcc-a2ee-cc8447337483 tempest-ProjectReaderTests-1030742843 None] Lock "cinder-quobyte-7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f" acquired by "delete_volume" :: waited 0.015s {{(pid=87314) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 18:13:14 devstack cinder-volume[87314]: DEBUG oslo.privsep.daemon [-] privsep: reply[f418494d-d33d-40fc-a9e8-d5c5246b3eb7]: (4, 'qcow2') {{(pid=88537) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 18:13:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3d1e8f23-f45c-4fcc-a2ee-cc8447337483 tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:13:14 devstack sudo[108478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f Sep 04 18:13:14 devstack sudo[108478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:13:14 devstack sudo[108478]: pam_unix(sudo:session): session closed for user root Sep 04 18:13:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3d1e8f23-f45c-4fcc-a2ee-cc8447337483 tempest-ProjectReaderTests-1030742843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f" returned: 0 in 0.369s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:13:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3d1e8f23-f45c-4fcc-a2ee-cc8447337483 tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:13:14 devstack sudo[108483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f Sep 04 18:13:14 devstack sudo[108483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:13:14 devstack sudo[108483]: pam_unix(sudo:session): session closed for user root Sep 04 18:13:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3d1e8f23-f45c-4fcc-a2ee-cc8447337483 tempest-ProjectReaderTests-1030742843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5/volume-7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f" returned: 0 in 0.234s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:13:14 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3d1e8f23-f45c-4fcc-a2ee-cc8447337483 tempest-ProjectReaderTests-1030742843 None] Lock "cinder-quobyte-7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f" released by "delete_volume" :: held 0.655s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:13:14 devstack cinder-volume[87314]: DEBUG cinder.quota [None req-3d1e8f23-f45c-4fcc-a2ee-cc8447337483 tempest-ProjectReaderTests-1030742843 None] Created reservations ['62ed06c6-3f39-4ffa-8af6-4e540628f0a9', 'b8fc368a-1edc-428b-9481-523b937a49f0', 'ee5fa637-fa36-40ff-9553-4ec82956d914', 'd9fecd2c-158d-480a-beda-278c275554e6'] {{(pid=87314) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 18:13:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3d1e8f23-f45c-4fcc-a2ee-cc8447337483 tempest-ProjectReaderTests-1030742843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:13:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3d1e8f23-f45c-4fcc-a2ee-cc8447337483 tempest-ProjectReaderTests-1030742843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:13:14 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-3d1e8f23-f45c-4fcc-a2ee-cc8447337483 tempest-ProjectReaderTests-1030742843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:13:14 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-3d1e8f23-f45c-4fcc-a2ee-cc8447337483 tempest-ProjectReaderTests-1030742843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:13:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-3d1e8f23-f45c-4fcc-a2ee-cc8447337483 tempest-ProjectReaderTests-1030742843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:13:14 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3d1e8f23-f45c-4fcc-a2ee-cc8447337483 tempest-ProjectReaderTests-1030742843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:13:14 devstack sudo[108486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:13:14 devstack sudo[108486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:13:15 devstack sudo[108486]: pam_unix(sudo:session): session closed for user root Sep 04 18:13:15 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-3d1e8f23-f45c-4fcc-a2ee-cc8447337483 tempest-ProjectReaderTests-1030742843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.257s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:13:15 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-3d1e8f23-f45c-4fcc-a2ee-cc8447337483 tempest-ProjectReaderTests-1030742843 None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:13:15 devstack cinder-volume[87314]: INFO cinder.volume.manager [None req-3d1e8f23-f45c-4fcc-a2ee-cc8447337483 tempest-ProjectReaderTests-1030742843 None] Deleted volume successfully. Sep 04 18:13:15 devstack cinder-volume[87314]: DEBUG cinder.coordination [None req-3d1e8f23-f45c-4fcc-a2ee-cc8447337483 tempest-ProjectReaderTests-1030742843 None] Lock "cinder-7a4692e1-5b39-446b-a9c7-bdcf6f1fbe6f-delete_volume" released by "delete_volume" :: held 1.103s {{(pid=87314) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 18:13:21 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 18:13:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 18:13:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 18:13:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a': None} {{(pid=87314) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 18:13:21 devstack cinder-volume[87314]: DEBUG cinder.volume.drivers.quobyte [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-740f37e2-ea10-4885-a51d-b44b0801f96a'] {{(pid=87314) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 18:13:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.lockutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87314) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 18:13:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:13:21 devstack sudo[108493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5 Sep 04 18:13:21 devstack sudo[108493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:13:21 devstack sudo[108493]: pam_unix(sudo:session): session closed for user root Sep 04 18:13:21 devstack cinder-volume[87314]: DEBUG oslo_concurrency.processutils [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bdfcb339947795faad3b608bbd7dc5a5" returned: 0 in 0.246s {{(pid=87314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:13:21 devstack cinder-volume[87314]: DEBUG cinder.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Notifying Schedulers of capabilities ... {{(pid=87314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:13:21 devstack cinder-volume[87314]: DEBUG oslo_service.periodic_task [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] Running periodic task VolumeManager._thread_info {{(pid=87314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 18:13:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] thread count: 28 {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 18:13:21 devstack cinder-volume[87314]: DEBUG cinder.volume.manager [None req-126b0a70-0a9d-4e6a-a18a-7bc4c8157e12 None None] thread info: [<_MainThread(MainThread, started 139900377723008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 18:13:24 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:INSERT=13,cinder:UPDATE=46,cinder:SELECT=28,cinder:DELETE=3 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 18:13:25 devstack cinder-volume[87314]: DEBUG dbcounter [-] [87314] Writing DB stats cinder:SELECT=34,cinder:INSERT=11,cinder:UPDATE=41,cinder:DELETE=4 {{(pid=87314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}